Population Health Management
Multi-stakeholder benefits decisions where employer groups, brokers, and members must align on coverage and cost.
Inside this journey
-
Pre-Discovery
Align the room on outcomes, decision process, and constraints before deeper discovery.
-
Stakeholder Alignment
Confirm decision roles, timeline, data owners, and success metrics across clinical, care management, IT, and finance to ensure readiness for addressing reconciliation gaps.
Alignment Questions
The Moment That Made You Look Up
- Briefly describe the reconciliation result that prompted this conversation (what changed, and when did you notice it?)
- Which contract type and population did the shortfall appear in?
- How large was the variance vs. projection (choose the range that best fits)?
- Who first raised the alarm internally about the reconciliation gap?
- How urgent is fixing this before the next reconciliation cycle?
Are We Underestimating Who Decides?
- Who outside your immediate team can veto a pilot or force a different solution if they don’t see the right evidence?
- Across clinical, care management, IT, and finance — who is the single named owner for decisions in each domain? Please list names and roles.
- Which stakeholder’s buy-in is most fragile and why?
- Who will be the ultimate signatory for a pilot that requires data sharing and a proof-of-value clause?
- If we show projected savings, what is the decision timeline to move from pilot to scale?
Where Are Your Blind Spots Hidden?
- Which data sources would embarrass you if they were missing or low quality when we run a 12‑month backtest?
- Describe the most common failure modes you saw in last year’s reconciliation that let rising‑risk members become high‑cost (specific examples please).
- What attribution rules do you currently use to decide which members are 'ours' for value-based calculations?
- How often do you receive complete claims for the prior month (select the closest match)?
- Do you have a recent reconciliation report or sample case we could review in a pilot? If yes, when can you share it?
Who Owns the Problem, Day-to-Day?
- If rising‑risk members are consistently missed today, whose daily job would change the most to stop that from happening?
- How do care managers currently receive and action patient lists (select all that apply)?
- Do care managers perform duplicate data entry today? If yes, describe the most painful example.
- What is the average caseload per care manager and typical outreach cadence for rising‑risk patients?
- Tell us about a recent workflow change you implemented—what worked, what didn’t, and why?
What Would Real, Measurable Success Feel Like?
- Which single outcome would convince your board the platform is worth scaling: admissions avoided, ED visits reduced, net medical spend lowered, or improved reconciliation accuracy?
- What target reduction in avoidable admissions or ED visits would you need to see during a pilot to call it successful (choose a range)?
- Which financial acceptance criteria would you require for pilot success (select all that apply)?
- Beyond hard metrics, what qualitative signals would make you confident (examples: care manager satisfaction, clinician trust, smoother workflows)?
- What is the minimum pilot population size (members or attributed lives) you consider statistically meaningful?
What Would Make Your Team Trust an Algorithm?
- What single feature or validation would most change a clinician’s mind about acting on an automated risk alert?
- How comfortable are you with model recalibration using your 12 months of claims and clinical examples?
- Which model characteristics matter most for you (select up to three)?
- What false positive rate is acceptable before care managers reject the alerts (give a percent or descriptive threshold)?
- Would clinicians require patient-level narratives/examples from past cohorts before trusting outreach recommendations?
If We Tried a Pilot Tomorrow, What Would Break?
- What single legal, technical, or operational hurdle would stop deployment this quarter if it couldn’t be resolved quickly?
- Which legal or data modules must be in place before data can be shared (select all that apply)?
- Do you have named technical owners for ETL, API endpoints, and EHR integration? Please provide names and expected availability.
- How quickly can you deliver a one-month sample of 12 months of claims and clinical data for backtesting?
- If initial sample data shows quality issues, what fallback would you prefer: pause, do a partial pilot, or proceed with caution and additional validation?
How Do We Keep This From Fizzling?
- When early wins are modest or mixed, who in your organization is most likely to fight for continued funding and scale?
- What governance cadence would you want for a pilot (review frequency and attendees)?
- If the pilot meets clinical thresholds but misses financial targets by 10%, how should we proceed?
- What contract or commercial term would be a deal-breaker for you (examples: long lock-in, lack of data portability, excessive up-front costs)?
- What immediate next step would you need from us to make progress in the next 14 days (examples: sample data intake form, technical kickoff, legal template)?
-
Current State Mapping
Document existing data sources, attribution rules, care management workflows, recent reconciliation results, and failure modes that led to missed rising‑risk members.
Current State
Quick Snapshot: Who You Are and What You're Protecting
- In one sentence, how would you describe your organization and the attributed population we should focus on for this review?
- Which stakeholder group do you represent in this conversation?
- Approximately how many attributed members are in scope for your value-based contracts today?
- How many months of clean, accessible claims + clinical data could you reasonably share for an initial test?
- What's the single most important outcome you need this engagement to demonstrate in the pilot?
Are You Comfortable Missing the Members Who Will Make or Break Your Reconciliation?
- When your last full reconciliation landed below projection, what surprised you most about the missed savings?
- How large was the reconciliation shortfall that triggered this review (ballpark)?
- Who inside the organization felt the greatest pressure once that shortfall became visible?
- How has that reconciliation result shifted your priorities or sense of urgency for finding rising‑risk members?
- Tell us about one specific instance where a rising‑risk patient was missed and later became high-cost—what happened and why does it still matter?
Where Does Your Data Live — and Where Does It Fall Apart?
- If I told you one fragmented data feed is driving most missed rising‑risk flags, which feed would you point to first?
- List the primary sources of member data you currently ingest or rely on (claim types, EHRs, pharmacy, labs, SDoH).
- How are claims currently delivered to your analytics team (choose all that apply)?
- How frequently are feeds refreshed for operational use (e.g., care manager workflows)?
- Describe one recurring data quality issue you've seen (timeliness, missing CPT/ICD codes, duplicate members, delayed adjudication) and its downstream impact.
- Have you run a reconciliation or retrospective analysis that maps missed rising‑risk members to specific data failures in the last 12 months?
Which Attribution Rules Are Quietly Costing You Money?
- If your current attribution rules were a gatekeeper, where are they letting the wrong members in—or letting the right ones slip out?
- Which attribution model do you use today for your value contracts?
- How often do attribution disagreements occur between payer and provider partners?
- Give an example where attribution rules directly caused a rising‑risk member to be outside the scope of outreach—what would have needed to change?
- Who in your organization is the ultimate owner of attribution rules and reconciliation logic?
How Do Care Managers Actually Work — Not How You Hope They Do
- If I shadowed a care manager for a day, what three tools or screens would they use most?
- Where do care manager tasks and outreach activities originate today?
- How much of a care manager's time is spent on navigation/administrative work versus direct member outreach (best estimate)?
- Describe a typical handoff between referral sources (e.g., utilization team) and care management—where does it break down?
- What would feel unacceptable to your care managers in terms of workflow change (e.g., extra clicks, duplicate documentation, new inboxes)?
- Are there existing care‑manager scripts, risk-stratification thresholds, or outreach templates you expect any new platform to honor or replicate?
When Risk Models Miss the Moment, What Fails Downstream?
- Tell us about a time a model underestimated risk and an avoidable admission occurred—what were the warning signs you wish you'd seen?
- Which of these common failure modes have you observed in your risk stratification?
- How frequently do you recalibrate or validate risk models against known high-cost cohorts?
- Do you have labeled cohorts (e.g., known rising‑risk that became high-cost) we can use for back-testing? If so, how many examples?
- What is the worst-case human impact you worry about when rising-risk members are missed?
If We Could Prove We Found the Missing Members, What Would Change?
- If a test showed we could identify X% of previously missed rising‑risk members, how would that change leadership's appetite for a pilot?
- Which outcome measures would convince you this approach is working (choose up to three)?
- What minimum improvement in reconciliation delta (in dollars or percentage) would you need to justify scaling?
- If the pilot proves successful, what would be the key elements of your scale decision (e.g., ROI threshold, clinical champion, integration completion)?
- What concerns would you have about operationalizing a system that re-prioritizes members for outreach based on algorithmic risk?
Data & Integration Practicalities — Let’s Test the Hidden Assumptions
- Which EHR(s) and care management systems must we integrate with for a successful pilot?
- Do you have API endpoints or technical contacts ready for integration testing?
- Which legal or data-sharing constraints could slow sample data delivery (select all that apply)?
- What cadence of data refresh would you need in production for care managers to act reliably?
- Who is your named owner for data engineering or integration work (name & role)?
- Are there specific PHI or data governance checks we should run on sample data before any analysis?
Quick Validation: Can You Show Us the Receipts?
- Can you provide 12 months of claims plus clinical encounters for a retrospective validation?
- What file formats do you prefer or have available for sample extracts?
- Which retrospective cohort would be highest value for back-testing (e.g., members with unplanned admission within 12 months)?
- Do you have prior 'loss analyses' or reconciliation reports we can compare our test results against?
- Who would sign off on us using de-identified or limited PHI samples for this validation?
Decision Dynamics — Who Moves the Needle?
- If we deliver evidence that we find the previously missed rising‑risk members, who needs to be convinced to move to pilot and full scale?
- What is your typical procurement cadence for pilot-level engagements?
- Where does budget for pilots usually come from in your organization?
- Who in your team would be the day-to-day sponsor for a pilot (name & role)?
- What are the top three blockers that would stop this pilot from starting on your ideal timeline?
-
-
Outcome Discovery
Define target clinical and financial outcomes, acceptance criteria, and pilot KPIs (avoidable admissions/ED reductions and reconciliation thresholds).
Discovery Questions
Opening: What’s Top of Mind Right Now?
- Tell us, in one sentence, what outcome from your last reconciliation surprised you the most?
- How urgent is this for your organization on a scale from 'business-as-usual' to 'mission-critical'?
- Who will be the primary sponsor(s) we should engage with during discovery and a pilot (names or roles)?
- Have you previously tested any tools or processes to catch rising-risk members earlier? If so, what happened?
- Do you already have 12 months of linked claims + clinical data available for a pilot evaluation?
What If You Kept Losing Ground?
- If next year’s reconciliation flips you from shared savings to shared losses, what would that mean for your team and priorities?
- How large is the reconciliation gap you’re trying to recover or prevent (choose closest)?
- What minimum annualized financial return or PMPM improvement would make a pilot worth continuing?
- How much operational investment (FTEs, vendor fees, integrations) are you willing to commit to a 6–12 month pilot?
- What emotional response do you expect if the pilot fails to move the needle (e.g., relieved, disappointed, escalated scrutiny)?
When 'Avoidable' Isn’t Clear: How Do You Define It?
- What does the phrase 'avoidable admission' or 'avoidable ED visit' mean to your clinical and financial teams today?
- Which of these approaches do you currently use to classify avoidability?
- Give a specific example of a missed rising‑risk member from the past year and what, in hindsight, could have prevented their escalation.
- How tolerant are you of false positives (contacting members who wouldn't have escalated) vs. false negatives (missing someone who does escalate)?
- Who signs off on the clinical rules that define 'avoidable'—and how often are those rules reviewed?
If This Pilot Succeeds, What Would 'Win' Actually Look Like?
- Imagine a successful 6‑month pilot: what three measurable changes would convince you to scale?
- Which primary KPI do you want to focus on for the pilot (pick one)?
- Which secondary KPIs are important to track alongside the primary metric?
- What absolute reduction or percent change in the primary KPI would you need to see to consider the pilot a success?
- How will you measure baseline performance so changes during the pilot are statistically and clinically meaningful?
- Over what minimum population size or number of attributed members do you believe the pilot must run to be credible?
Who Needs to Say Yes — and What Will Convince Them?
- If you had to name the three stakeholders who will veto the pilot, who are they and why?
- Which stakeholder cares most about clinical validity vs. financial return vs. operational feasibility?
- For each of these roles, what is a single, non-negotiable acceptance criterion they will require to greenlight scale (e.g., <X% false positives, $Y ROI, EHR integration completed)?
- Who will be the named owner for pilot governance, and who will decide the go/no-go at the end?
- What level of care manager adoption (e.g., % of tasks completed, % of outreach attempted) would be considered acceptable during the pilot?
- Are there existing legal or commercial constraints (contracts, attribution rules) that might block pilot activities or data sharing?
Data That Will Prove the Point — Is It Ready?
- If we asked for a 12‑month extract of claims + clinical + pharmacy + lab + SDoH, which datasets are immediately available?
- What percentage of your member population typically matches across claims and EHR identifiers today (estimated merge rate)?
- Describe any known data quality issues that have previously degraded analytics (e.g., missing dates, partial encounter types, lagging claims).
- Are you comfortable providing a de‑identified sample dataset for model calibration and parallel validation?
- How frequently can we receive refreshed data during the pilot (pick cadence)?
What Tradeoffs Are You Willing to Make?
- If achieving higher recall (finding more rising‑risk members) meant more false positives, where would you draw the line?
- How many extra outreach tasks per care manager per week is operationally feasible without hiring more staff?
- Are you open to a phased threshold approach (start conservative, then loosen to increase reach) during the pilot?
- What consequences would you accept for occasional incorrect prioritization (e.g., unnecessary outreach): purely operational cost, documented clinical review, or member harm mitigation steps?
- Is the organization prepared to change attribution or outreach rules based on pilot learning, or must rules stay fixed for contractual reasons?
Ready to Measure, Learn, and Decide?
- Who will own pilot measurement and reporting cadence (weekly, bi-weekly, monthly) and how will insights be routed?
- What is your preferred reporting cadence for early signals vs. final evaluation?
- What statistical or clinical thresholds will determine a go/no-go decision at pilot end (e.g., p<0.05, >X% reduction, agreed $ return)?
- If early results are mixed, what escalation path would you prefer—optimize and extend, pivot to a new cohort, or stop?
- Assuming success, what three items must be in place before you will commit to scale (e.g., contract terms, integrations, staffing, ROI guarantee)?
- Finally, how soon would you be ready to kick off a pilot if data access and commercial terms were aligned?
-
Solution Experience
Validate how the platform will find missed rising‑risk cohorts using the customer’s 12 months of claims/clinical examples and demonstrate embedded care‑manager workflows in that context.
Experience Meetings
- Solution Experience Kickoff — Confirm Current State, Consequence & Scope
- Data & Cohort Validation Workshop — Ingest, QA & Reproduce Known Misses
- Live Solution Experience — Diagnosis, Proof & Forced Validation with Customer Examples
- Post-Experience Calibration & Pilot Decision Meeting
Issues & Enhancements
- Introductions & Meeting Objectives
- Verify the dataset is ingestible and identify any data fixes required prior to the Live Solution Experience.
- Measure initial match/reproduction rate against the customer's known missed cohort and surface key gaps.
- Agree concrete remediation actions, responsible owners, and dates to reach an ingest-ready state for the Live session.
- Document failure modes that explain why rising-risk members were historically missed to ensure demonstration ties to real problems.
- Seller: Re-run ingest with mapping fixes and deliver updated match-rate report for the known cohort within 3 business days.
- Customer: Provide clarifications on ambiguous fields and any additional files (e.g., roster attribution) required for matching.
- Customer IT: Enable secure access for re-ingest and confirm schedule window for large file transfer.
- Seller: Prepare 4–6 representative patient case files (anonymized) for the Live Solution Experience based on reproduced matches.
- Context Recap: Verified Current State, Consequence & Future State
- Demonstrate with customer examples that the platform reliably identifies members who were historically missed.
- Validate that the embedded care-manager workflows map to the customer's operational handoffs and EHR integration expectations.
- Obtain explicit customer validation (yes/no and specific changes) for each proof element and each representative patient.
- Agree on initial model thresholds, prioritization rules, and target KPI deltas to be used in pilot projection.
- Customer & Seller: Capture validation responses per patient case and list required changes (model inputs, workflow fields or prioritization rules).
- Seller: Produce an updated match/recall report and projected KPI impact incorporating customer feedback within 5 business days.
- Seller/Product: Adjust model thresholds or feature usage per agreed prioritization rules and schedule re-run for final calibration.
- Customer: Confirm preferred EHR handoff mechanism (task API, CCD push, secure email) for pilot integration.
- Executive Summary of Experience Results
- Obtain an explicit decision to move to pilot or a prioritized remediation list required to earn pilot approval.
- Agree measurable pilot success criteria, pilot population, timeline and named owners for execution.
- Align legal and commercial next steps necessary to start the pilot (data modules, SOW, contract milestones).
- Schedule Pre-Deployment Readiness and confirm immediate handoffs to deployment team if pilot approved.
- Customer: Sign pilot SOW or provide written list of blockers with owners and dates to resolve.
- Seller: Deliver final ROI one-pager and pilot SOW with agreed KPIs and timelines within 3 business days.
- Customer IT: Provision production-like data feed endpoints and access for Pre-Deployment Readiness.
- Both Parties: Schedule the Pre-Deployment Readiness meeting and assign participants for deployment kickoff.
- Customer and seller share a crystal-clear one-sentence current state and one-sentence future state.
- Quantify the consequence in operational and financial terms relevant to the reconciliation gap.
- Agree the exact datasets, sample patient list, success metrics, timeline, and owners required to run the Solution Experience.
- Establish secure data transfer approach and necessary legal/IT contacts to avoid delays.
- Customer: Deliver de-identified 12-month claims + clinical extract and a list of 10–20 known missed high-cost members by agreed date.
- Seller: Send data mapping template, secure transfer instructions, and sample ingestion checklist within 24 hours.
- Customer IT/Legal: Confirm BAAs/DTAs or secure transfer mechanism required for ingest.
- Seller: Schedule Data & Cohort Validation Workshop and provision sandbox environment access.
- Prework Recap & Dataset Inventory
- Customer Case Selection Confirmation
- Field Mapping & Ingest Walkthrough
- One-line Current State (Customer confirms)
- Refined Future State & Success Criteria
- Diagnosis: Why these members were missed historically
- Pilot Scope, Population & Duration
- Consequence Quantification
- Data Quality Assessment
- Proof: Platform Identification of Rising-Risk Cohort
- One-line Future State (Operational outcome)
- Operational Roles, Training & Governance
- Reproduce Known High-Cost Cohort
- Commercial & Legal Next Steps
- Scope for the Experience & Success Metrics
- Proof: Embedded Care-Manager Workflow in Context
- Discuss Failure Modes & Edge Cases
- Data & Prework Checklist
- Simulation: Outreach -> Task Completion -> Outcome Tracking
- Calibration Plan & Next Ingest Steps
- Decision & Timeline
- Close: Schedule Pre-Deployment Readiness
- Roles, Timeline & Logistics
- Forced Validation: Explicit Customer Confirmation
- Discussion: Thresholds, Prioritization & False Positives
-
Solution Scope
Define required data feeds, risk model calibration, EHR/workflow integrations, pilot population, responsibilities, and measurable ROI targets.
Scope Configuration
- Ingest 12 months claims, clinical, pharmacy, and lab data
- Normalize and map data to common clinical data model
- Enrich member records with social determinant data
- Deploy risk stratification engine for rising-risk detection
- Calibrate risk models to local historical claims
- Generate prioritized rising-risk member lists with drivers
- Auto-create care manager tasks with outreach scripts
- Embed care manager tasks into EHR via FHIR
- Activate automated outreach across IVR, SMS, email, phone
- Close-loop intervention and referral tracking
- Produce monthly avoidable ED and admissions reports
- Train care teams on platform workflows and scripts
- Integrate pharmacy fill and medication adherence feeds
- Configure quality measure gap logic and alerts
Scope Questions
Ingest 12 months claims, clinical, pharmacy, and lab data
- Do you have up to 12 months of historical data available for each feed (claims, clinical, pharmacy, labs)?
- Which technical formats are your feeds currently delivered in?
- Who are the named data owners and technical contacts for each feed (list names, roles, and contact emails)?
- What is the expected cadence for each feed during pilot and production?
- Are there known data quality issues (e.g., missing member IDs, claim lag, incomplete labs) we should plan for?
- Are there contractual, privacy or DUA requirements (BAA, scoping restrictions) that will impact ingestion?
Normalize and map data to common clinical data model
- Which target clinical data model do you prefer for normalized data?
- Do you require vendor-managed mapping or will your team provide mappings?
- Which code systems are present in your data and must be mapped (select all that apply)?
- Are there custom local codes or payer-specific fields that need special mapping? Please list examples.
- What is your acceptable turnaround time for initial mapping and validation?
- Do you require ongoing delta-mapping for newly encountered codes post-launch?
Enrich member records with social determinant data
- Do you want SDOH enrichment included in the pilot scope?
- Which SDOH sources do you expect to use or allow (select all that apply)?
- At what geographic granularity should enrichment be applied?
- Are there consent or privacy considerations for enrichment we need to honor?
- Which SDOH attributes are highest priority to include (e.g., food insecurity, housing instability, transportation)?
- What refresh cadence do you want for SDOH enrichment?
Deploy risk stratification engine for rising-risk detection
- Which modeling approach do you prefer for rising-risk detection?
- What prediction horizon should the model target for rising-risk identification?
- Which operating point trade-off do you prefer: prioritize sensitivity, specificity, or balance?
- Do you require real-time scoring or is batch scoring acceptable?
- What inputs (claims, labs, meds, SDOH) are required by your clinicians for score interpretation?
- Will clinicians review model outputs prior to outreach (clinical validation workflow)?
Calibrate risk models to local historical claims
- Can you provide the labeled historical outcomes (e.g., high-cost cases, admissions) needed for calibration?
- What is the primary calibration objective?
- Which evaluation metrics will you use to accept calibration?
- Who will govern model changes and approvals (customer, vendor, joint committee)?
- What is the acceptable timeline to complete initial calibration and validation?
- Do you require periodic re-calibration after pilot (schedule/frequency)?
Generate prioritized rising-risk member lists with drivers
- What sorting/prioritization rules should be applied to lists (select all that apply)?
- Which risk drivers and explanatory variables must be surfaced on each record?
- In what formats do you need the lists delivered?
- How frequently should prioritized lists be regenerated?
- What inclusion thresholds or business rules determine which members appear (please specify risk percentile, score cutoff, or rule logic)?
- Should lists include an assigned owner or remain unassigned for routing rules to apply?
Auto-create care manager tasks with outreach scripts
- Do you want vendor-provided outreach scripts, customer-provided scripts, or a joint development approach?
- What task assignment rules should we support (select all that apply)?
- What task fields are required for your care managers (e.g., contact info, risk drivers, suggested script, next steps)?
- Should tasks include branching scripts or suggested escalation criteria?
- Do care managers need the ability to edit scripts or task content before outreach?
- Which languages/localizations must outreach scripts support?
Embed care manager tasks into EHR via FHIR
- Which EHR vendor(s) and versions will tasks be embedded into? List all in-scope products.
- Which FHIR version(s) do your EHR endpoints support?
- Are FHIR endpoints and credentials available for the pilot environment now?
- Which authentication mechanism is required for EHR integration?
- Do you require bidirectional sync (task status updates sent back to platform and EHR)?
- What is the acceptable latency for task creation/updating in the EHR?
Activate automated outreach across IVR, SMS, email, phone
- Which outreach channels should be included in the pilot?
- Do you have documented member consent/opt-in for each channel?
- Are there existing telephony or messaging vendors we must integrate with (list vendor names)?
- Do you require message templates and A/B testing for outreach content?
- What throttling, frequency or escalation rules should govern outreach to individual members?
- How should opt-outs and do-not-contact lists be enforced across channels?
Close-loop intervention and referral tracking
- Do you currently track referrals and confirmations to external community or specialty partners?
- What referral data elements must be captured to consider a loop closed (e.g., appointment date, attendance, discharge summary)?
- Do you require automated confirmations from partner systems or will manual closure be recorded by staff?
- Which partner systems or platforms must we integrate with for closed-loop (name systems/APIs)?
- What SLA timeline defines a closed-loop update (e.g., within 7 days of referral)?
- What reporting is required to demonstrate closed-loop effectiveness (metrics, frequency, recipients)?
-
Mutual Commit
Agree commercial terms, data sharing and legal modules, attribution rules, success criteria, and governance for the pilot and scale decision.
Agreement Modules
- Master Services Agreement (MSA)
- Statement of Work (SOW)
- Business Associate Agreement (BAA)
- Data Processing / Data Sharing Agreement (DPA/DSA)
- Security & Risk Acceptance Addendum
- Commercial Terms & Pricing Schedule
- Attribution Rules & Success Criteria Addendum
- Pilot Governance & Steering Committee Charter
- Integration & EHR Interface Appendix
- Service Level Agreement (SLA)
- Change Order & Scope Amendment Procedures
- Intellectual Property & Licensing Terms
- Termination, Wind-Down & Renewal Terms
- Member Outreach & Consent Authorization
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Pre-Deployment Readiness
Confirm data access, sample data quality, EHR integration endpoints, named owners, and risk controls prior to build.
Readiness Questions
Quick Check — Who's in the Room?
- Who are the primary people we should invite to confirm pre-deployment readiness?
- If we need a single day for a kickoff working session, who is the one person who must attend?
- What's your target window for starting technical builds (calendar date or month)?
- How urgent is resolving rising-risk identification for your organization on a scale from calm to critical?
- Have you run any previous integrations or pilots with external analytics platforms? If yes, briefly describe what went well and what blocked progress.
If This Goes Wrong, What Keeps You Up at Night?
- How confident are you that missed rising-risk members are the primary driver of the recent reconciliation gap?
- What is the single worst operational outcome you fear during deployment (e.g., incorrect outreach, data breach, clinician pushback, missed SLAs)?
- Tell us about a past integration or pilot that went poorly—what happened and why (people, data, governance, or tech)?
- How much tolerance does your leadership have for initial false positives/negatives in risk stratification during a calibration period?
- What political or contractual constraints (payer/provider attribution, commercial terms) could derail a pilot if not addressed up front?
Show Me Your Data — Where Does the Truth Live?
- Which of these data sources can you provide access to for a 12-month historical extract (select all that apply)?
- For each selected source, what is the current method of access you can support?
- Please provide the typical delivery cadence and latency for those feeds (e.g., daily, weekly, 30–90 day claims lag).
- Do you have a named data steward or owner for each feed? If yes, list role/name and contact for the top 3 feeds.
- What sample size (member count or time range) can you deliver first for our validation tests?
How Accurate Is 'Accurate' for Your Team?
- What level of completeness do you expect for critical fields (diagnosis codes, dates of service, patient identifiers) during initial validation?
- What are the most common data quality issues you've experienced (pick up to three)?
- Do you track formal data quality metrics today (e.g., field-level completeness, duplication rates)? If so, which metrics and typical values?
- Share an example story where poor data quality directly impacted patient outreach or financial reconciliation.
- What remediation cadence would you accept during calibration (e.g., daily fixes, weekly patches, monthly backlog)?
Can Your EHR & Workflows Talk to Ours?
- Which EHR(s) and versions are used by the care teams who will receive tasks from the platform?
- Do your care managers use a single EHR-integrated workflow today, or do they operate across multiple tools?
- Which technical integration patterns can you support for task and workflow handoffs?
- Who owns EHR change control and how long does a typical minor workflow configuration take to approve and deploy?
- Describe any SSO, role-mapping, or patient-matching constraints we should plan for during integration.
Who's Driving This Boat — Roles, Decisions, and Escalation
- Who is the executive sponsor for this pilot and what measurable outcome will they use to judge success?
- Which person or committee has final sign-off authority for go/no-go on pilot deployment?
- List the named owners (role + name) for: data delivery, integration/ETL, care management operations, and security/compliance.
- How do you prefer to handle escalation when a blocking issue arises during build (daily standup, weekly steering, ad-hoc war room)?
- Are there existing KPIs or dashboards the team will use to monitor pilot performance, or should we propose baseline metrics?
What Would Count as 'Safe' to Launch?
- What hard stop conditions would cause you to pause deployment (e.g., >X% misclassification, PHI exposure, EHR task failure)?
- Which security and privacy controls must be demonstrably in place before we begin build (check all that apply)?
- What validation threshold for risk-stratification accuracy would you require during the validation checklist to accept the pilot (e.g., PPV, sensitivity targets)?
- Do you require a rollback or canary plan that lets us limit outreach volume while monitoring outcomes? If yes, describe preferred limits.
- Who signs off that controls and testing are sufficient for launch (role/name)?
If Nothing Changes in 30 Days, What Will Break?
- What are the critical milestones you expect in the first 30 days (data handoff, samples validated, API access, model calibration)?
- Please provide target dates for the top three deliverables you want completed in the next 30 days.
- Who will be available for daily technical check-ins during the initial build window?
- What resources can you commit from your side for testing and validation (FTEs, environment access, test patients)?
- How will success be signed off at 30 days — who provides acceptance and what artifacts do you need (test report, sample outputs, UAT session)?
Confirmations, Attachments, and the Things We Can't Build Without
- Please confirm which of the following you can provide within 5 business days (select all that apply).
- If any of the items above are not available within 5 business days, specify which and why.
- Please upload or link to any existing reconciliation reports, recent care management performance reports, or prior risk-model validation documents (or describe where they live).
- Are there legal, procurement, or privacy approvals pending that will block access to data or EHR endpoints? If so, what is the expected clearance timeline?
- Is there anything else — political, operational, or technical — we should know now that will change the plan?
-
Deployment Enablement
Execute ETL/integration, calibrate risk models against known cohorts, configure care‑manager workflows, and deliver training with clear sequencing and owners.
-
Validation Checklist
Run pilot validations against historical high‑cost members, verify stratification accuracy, test workflow handoffs, and measure initial impact on avoidable admissions/ED visits.
Validation Questions
Start: The Moment That Made You Look Up
- In one short paragraph, what specific result or event prompted you to explore solutions for finding missed rising‑risk members?
- Approximately how large was the reconciliation gap that triggered this review?
- Who first raised concern inside your organization (role or team)?
- How urgent does this feel on a scale from tactical problem to existential threat for next year’s financials?
- If you had to name one feeling tied to this moment (e.g., frustrated, anxious, determined), what would it be and why?
When Savings Turned Into Alarm Bells
- What would it mean to your organization if next year’s reconciliation moved you from shared savings into shared losses?
- How have past reconciliation shortfalls influenced leadership conversations about risk‑bearing strategy?
- Which financial/contracting metrics are you most focused on improving as a result (select up to three)?
- How would missing another year of projected savings affect staffing, budgets, or strategic plans?
- Who in your executive chain will be most directly accountable for reversing this trend?
Who’s Holding the Reins—and Who’s Getting Left Out?
- To what extent are clinical, care management, IT, and finance aligned on who owns rising‑risk identification and outreach?
- Which roles would you expect to be named owners for: decision authority, data ownership, pilot governance, and day‑to‑day care management? Please list names or titles.
- What timeline do decision‑makers expect for a pilot decision (months until go/no‑go) and for scale if successful?
- Where have past cross‑functional efforts stalled—policy, risk attribution, data access, or frontline adoption?
- How comfortable are your care managers with algorithmic prioritization versus clinician judgment?
Where Your Data Might Be Hiding the People You Need
- Tell us about the most important data sources you rely on today to identify rising‑risk members (claims, EHR, pharmacy, labs, social determinants). Which are you confident in, and which worry you?
- What are the typical delays or gaps in the data feeds you use (claims lag, missing payers, incomplete SDoH, etc.)?
- Which of the following best describes your current data integration posture for a 12‑month test: single payer claims only, multiple payers consolidated, EHR + claims linked, or other?
- How frequently do you run reconciliation or retrospective reviews today (quarterly, annually, ad hoc)?
- If we asked for a sample of 12 months of claims + clinical records to test model accuracy, what logistical or compliance hurdles would most likely slow you down?
The Missed Members — Stories That Hurt (and Teach)
- Think of a high‑cost member from last year you wish you'd reached sooner—what was their story and what warning signs were visible earlier?
- How often do your retrospective reviews reveal the same failure modes (e.g., attribution mismatch, mis‑timed risk scores, care manager capacity)?
- Which failure modes have driven the largest missed opportunity in dollars or outcomes?
- Have you documented specific cases where EHR‑native tools missed rising risk that cross‑payer claims would have revealed? If so, describe briefly.
- How much variability is there across provider groups in identifying and escalating rising‑risk members (consistent, moderate, high)?
Workflows That Will Move the Needle—or Get Ignored
- If a new platform added prioritized tasks to your care managers, what would need to change in their day for it to be adopted instead of ignored?
- Which care management tools do your teams use today and where do they prefer workflows to live?
- How important is embedded, one‑click task creation (with contact info, outreach script, and history) versus a report that requires manual action?
- What staffing or training constraints would limit how quickly care managers could take on new outreach from a pilot?
- Describe a recent workflow change that succeeded—what made adoption stick (leadership support, incentives, simplicity, etc.)?
If We Could Guarantee One Outcome—Which One Would You Choose?
- If a pilot could demonstrably prevent a quantifiable number of avoidable admissions or ED visits in 12 months, how would you value that success?
- Which KPIs would you require to declare the pilot a success (select up to three)?
- What minimum magnitude of improvement on your top KPI would justify scale in your view (percentage or absolute number)?
- Which timeframe feels realistic to measure meaningful impact from a pilot (3, 6, 9, 12 months)?
- What non‑financial signals (clinician trust, care manager satisfaction, member experience) would you want tracked alongside dollars?
What Would Make a Pilot Unignorable (and Governance You Can Live With)
- If we asked you to sign onto a pilot today, what commercial or legal terms would be absolute deal‑stoppers versus negotiable?
- How do you prefer data sharing and PHI governance to be structured for a test: joint environment, secure vendor environment, or federation of queries?
- Who must sign off on attribution rules and success criteria before a pilot can begin?
- What cadence and format for governance reviews would make you confident in moving from pilot to scale (weekly operational, monthly leadership, quarterly steering)?
- What is the minimum executive commitment or resource allocation you would need to greenlight a meaningful pilot?
-
-
Success
Review pilot outcomes versus success signals, agree on scale or optimization steps, and maintain a shared issues & enhancement backlog for continuous improvement.
Success Reviews
- Pilot Outcomes Review — Executive & Clinical
- Scale vs Optimize Decision Workshop
- Issues & Enhancement Backlog Prioritization Workshop
- Technical Validation & Data Quality Deep Dive
- Continuous Improvement Governance & Cadence Setup
Issues & Enhancements
- Define monitoring controls and escalation paths to prevent recurrence of key issues.
- Define measurable milestones and ROI targets tied to the decision.
- Produce a one‑page execution plan for the selected path with milestones, owners, and budget.
- Legal/commercial teams to draft necessary contract amendments within defined SLA.
- Ops/Tech leads to produce a 30/60/90 day readiness plan with dependencies.
- Backlog Intake & Categories
- Create a prioritized backlog with clear owners and timelines for top items.
- Tie each prioritized item to an explicit consequence and measurable acceptance criteria.
- Agree a delivery cadence and governance for backlog changes.
- Populate prioritized items into the shared backlog tool with owners and SLAs.
- Owners to provide initial implementation estimates and proposed timelines for top 5 items.
- Schedule weekly backlog triage sessions and a monthly stakeholder review.
- One‑Sentence Data State & Known Gaps
- Validate that data feeds and model calibration reach the minimum thresholds required for scaling.
- Agree a concrete remediation plan with timelines and owners for any data or calibration gaps.
- Opening & One‑Sentence Current State
- Tech to deliver cleaned sample datasets and run a full calibration within agreed window.
- Build and enable monitoring dashboards and alerts for ETL failures and model drift.
- Schedule follow‑up validation run after remediation work completes.
- Governance Roles & RACI
- Create a clear governance model with owners and meeting cadence to drive continuous improvement.
- Agree a concise KPI set and thresholds that trigger remediation or executive attention.
- Set SLAs and an escalation path for critical operational issues.
- Publish governance RACI and calendar invites for the agreed recurring cadence.
- Enable the KPI dashboard and configure alerting to named owners.
- Distribute a one‑page communications template for monthly executive summary updates.
- Confirm whether the pilot met the predefined success signals and why.
- Make a provisional decision (scale, optimize, extend, or stop) with aligned executives and clinicians.
- Surface financial and clinical consequences clearly enough to create urgency for the chosen path.
- Assign owners and timelines for all immediate follow-up work.
- Deliver the full metrics pack (raw and reconciled) and representative member case pack for executive review.
- Owner(s) to draft recommended path with resource & timeline estimates for the Scale vs Optimize decision.
- Schedule technical deep‑dive (data/model) within 7 business days if optimization path chosen.
- Prework Recap & Decision Criteria
- Make a formal, resourced decision on path forward with executive sponsor approval.
- Agree commercial/legal changes required and ownership to draft amendments.
- Option 1 — Scale As‑Is
- Success Signal Review (Metrics Pack)
- Recurring Cadence Design
- Sample Validation Results
- Impact (Consequence) Scoring
- Core KPIs & Alert Thresholds
- Model Calibration Against Known High‑Cost Cohorts
- Financial Consequence & Projection
- Option 2 — Scale With Optimizations
- Effort & Risk Scoring
- Clinical Impact & Care Manager Feedback
- Prioritization & Owner Assignment
- Option 3 — Pilot Extension or Stop
- Integration & EHR Workflow Handoff Tests
- Issue Escalation & SLA Rules
- Stakeholder Communication Plan
- Root Cause Summary (Why missed rising‑risk?)
- Define Acceptance Criteria & Success Signals
- Risk & Mitigation Assessment
- Remediation Plan & Data Controls
- Commercial & Legal Implications
- Decision Framing — Scale vs Optimize vs Extend vs Stop
- Release Planning & Cadence
- Confirm Next Steps & Owners