Asset Performance Management
Complex deployments where integration, safety, and operational handoff determine production success.
Inside this journey
-
Pre-Discovery
Align the room on outcomes, decision process, and constraints before deeper discovery.
-
Stakeholder Alignment
Confirm sponsors, plant and IT decision roles, timeline, and measurable success metrics.
Alignment Questions
Before we start — who’s championing this?
- Who is the executive sponsor we should be aligned with for this initiative?
- Please provide the sponsor’s name, title, and the best contact (email/phone).
- Who are the primary plant and IT decision-makers who must sign off before purchase and before deployment?
- How urgent is leadership about making a decision on this project?
- What are the sponsor’s top three expectations from a successful deployment (names, KPIs, or outcomes)?
Who will feel the heat if we miss the mark?
- If this program fails to deliver, whose performance or KPIs will be most exposed and why?
- Which roles will be held accountable for uptime, and which will own the results day-to-day?
- Which business units, production lines, or product families are most vulnerable to costly unplanned downtime?
- Can you share a recent event where downtime or asset failure had a material impact? Please describe the event, cost (if known), and who reacted.
- How do affected stakeholders usually respond emotionally when downtime spikes—frustration, urgency to spend, finger-pointing, or something else?
Why hasn’t this been solved already?
- What has blocked progress on reliability or predictive initiatives in the past—even when the problem was obvious?
- Which one or two of those blockers have been most persistent for your site?
- Tell us about a prior project that stalled: what was tried, where it stopped, and the root cause.
- How long have these blockers been in place (for example: months, years, since a merger, after an ERP upgrade)?
- What small changes have actually helped mitigate these blockers previously—if any—and why did they stick or fail?
What would “better” actually look like for your site?
- Imagine six months after go‑live your team says: “We made the right choice.” What does that day-to-day look like?
- Which of the following outcome targets would make you feel confident this project paid off?
- What predictive model accuracy (precision/recall or lead time) would you need before you act on a recommendation?
- Beyond metrics, what change in team behavior or capability would signal success (e.g., technicians trusting alerts, planning fewer emergencies)?
- Who on your team will be most energized by these improvements and who might resist them?
Which KPIs will prove the business case?
- Which 3 metrics will leaders use to justify continued investment if this program proceeds?
- Of those metrics, which are currently tracked in your systems (CMMS, historian, ERP) and where is each stored?
- Who owns each chosen KPI today and how frequently are they reviewed at site/executive levels?
- What specific targets or thresholds would trigger executive intervention or additional funding?
- Which of these KPIs do you expect to move first during a pilot, and why?
How will the decision get made (and who closes it)?
- When scope, timeline, or price are in dispute, who has final decision authority and what criteria do they use?
- What procurement or legal milestones must we clear (e.g., security review, insurance, vendor approval board)?
- What is your preferred approval timeline from pilot to enterprise roll‑out?
- What are the budget constraints or funding windows we should know about (fiscal year closings, capital vs. OPEX)?
- What would make the procurement team say “yes” today—price, references, delivery timeline, or risk allocation?
Name the biggest risk—and how we prove it’s managed
- What single risk, if it happens after deployment, would make leadership wish they hadn’t approved the project?
- From this list, which three risks are most relevant to you right now?
- For each top risk you selected, what practical mitigation has worked or would feel convincing to you?
- Who must sign off on data access, and are there any known technical or policy constraints (segmentation, air-gapped systems)?
- How confident are you that your existing data sources (sensors, historian, CMMS) will support an initial pilot?
What small, persuasive step proves momentum?
- What low-risk pilot would convince leadership this is working (single critical asset, line, plant, or use-case)?
- Who will be the named owner and the working team for that pilot (names/roles)?
- How long do you expect a pilot to run before we can report a reliable signal (days/weeks/months)?
- What budget, people, and system access has already been committed to run a pilot?
- What would constitute a successful pilot (specific metric shifts, technician adoption targets, or acceptance criteria)?
-
Current State Mapping
Document asset fleets, failure modes, existing CMMS/historians/SCADA/ERP, and data quality gaps.
Current State
Getting Comfortable — a quick site snapshot
- Which site or logical fleet are we focusing on in this conversation?
- Who is the executive sponsor and the primary operational sponsor for this effort? (name & role)
- Roughly how many production-critical assets are in scope for this initial phase?
- What’s the most important outcome your leadership talks about when they approve reliability investments?
- Tell us briefly about a recent maintenance problem that frustrated you or your team (what happened, who felt the pain, and why it stuck)
Show Me What’s Under the Hood
- If I asked an operator to sketch the asset train that most often causes shutdowns, would anyone on your team be able to do that from memory—and what would they get wrong?
- Which asset categories are highest priority for reliability improvements right now?
- For each high-priority asset type, what percentage of failures are mechanical vs. electrical vs. process/control?
- Do you have an asset registry or CMDB that maps serial numbers, locations, and BOMs for these fleets? If yes, where is it maintained?
- What documentation or tribal knowledge exists today for failure signatures (photos, sound recordings, historical work-orders, tribal notes)?
Why Does This Keep Happening?
- When an asset fails today, do you find the team fixing symptoms (quick patch) more often than addressing root cause—and what does that cost you in repeat failures?
- Which failure modes produce the worst financial or safety impact at your site (name top 3 and an example incident for each)?
- How often do you perform formal root-cause analysis (RCA) after significant incidents?
- What is your current average time-to-repair (MTTR) and average time-between-failures (MTBF) for the highest-priority assets?
- How does unplanned downtime show up in your operating metrics and conversations (lost throughput, penalties, safety stoppages)? Give a recent quantified example if possible.
Where Does Your Data Trip You Up?
- If your predictive analytics had one glaring blind spot today, where would it be—missing sensors, noisy signals, disconnected work-orders, or something else?
- Which systems hold your operation and maintenance data today?
- For signals you rely on (vibration, temp, pressure, current), what are typical sample rates and retention periods?
- How reliable is the mapping between sensor tags and physical assets today (can you programmatically connect a tag to an asset record)?
- Where do you experience the most data friction—permissions/security, network segmentation, field instrument calibration, or historical cleanliness? Please describe with examples.
Integration Reality Check (IT & OT)
- Which integrations feel like 'no-brainers' to your IT team—and which ones would they tell leadership are risky if asked bluntly?
- Do you have any of the following constraints that affect integrations or cloud access?
- Which of these integration touchpoints must be included for a minimal viable deployment?
- Who in IT/OT will need to sign off on network changes and data feeds, and how long does that approval typically take?
- Are there preferred protocols or middleware (OPC UA, MQTT, REST APIs, MQTT over VPN) that we should plan to use?
Who Owns the Problem (and the Solution)?
- If a high-confidence failure alert arrived at shift start, whose team is expected to act—and would that person have the authority and spare capacity to respond?
- Who will be the day-to-day owner for validating model outputs and converting them into work-orders?
- How do technicians currently receive and complete work-orders (paper, mobile app, CMMS mobile, other)?
- What level of mobile adoption do field teams have today—are they comfortable using an app for guided inspections and closing tasks?
- Who inside the organization will champion adoption and training, and what has worked for them in prior rollouts?
What Would Real Value Feel Like?
- If we reduced your unplanned downtime by 30% in 12 months, how would that change conversations with your CEO/COO—what would they celebrate or demand next?
- Which success metrics will your team use to judge a pilot: downtime hours avoided, work-orders reduced, OEE lift, MTBF improvement, parts-cost reduction, or something else?
- What level of predictive accuracy or lead time would make an alert actionable for your team (e.g., 80% accurate with 7 days lead time)?
- How do you want outcomes documented and reported (dashboard cadence, automated reports, integrated CMMS tickets)?
- What are realistic timelines you’d accept for measurable value (90 days, 6 months, 12 months)?
Roadblocks & Deal Breakers
- What single technical or organizational issue would cause you to pause or cancel a deployment no matter the price or promise?
- Which of these risks worry you most about adopting a predictive platform?
- How strict are your validation & acceptance gates for new tooling (do you require POC acceptance, formal FAT/SAT, security penetration testing)?
- Have you run pilots with other vendors recently? If yes, what specifically led to success or why they failed?
- Are there contractual or insurance constraints about analytics models, data residency, or third-party algorithms we should know now?
Quick Wins & Low‑Regret First Steps
- Where could we demonstrate clear, measurable impact inside 90 days — which 1–3 assets or processes are the best low-risk bets?
- Which of the following is most commonly available for those candidate assets today?
- What minimal data access would you approve quickly for a pilot (historian read-only, CMMS sample export, edge interface)?
- Who needs to be in the room for a 4‑week scoping sprint to unblock a pilot (names/roles)?
- What early success signal would change the political dynamic internally (reduced emergency work-orders, one avoided shutdown, technician adoption)?
Let’s Commit to the Next Visible Step
- If we could guarantee one measurable pilot outcome in 90 days, would you be willing to commit the needed data and one asset group to prove it?
- What approvals or procurements must happen before data access and integration work can begin, and who owns obtaining them?
- Which communication cadence do you prefer during a pilot (weekly tactical, biweekly steering, monthly exec), and who should receive each update?
- What would make you feel confident we’re the right partner after the first 90 days (transparency of models, clear ROI, documented runbook, technician buy-in)?
- Is there anything else we should know that would change how we scope data ingestion, model selection, or pilot success criteria?
-
-
Outcome Discovery
Define target reductions in unplanned downtime, OEE improvements, predictive-accuracy thresholds, and acceptance criteria.
Discovery Questions
Start Here: What's most pressing for your team right now?
- Which single outcome would you prioritize over the next 12 months?
- Tell us the current baseline for the priority above (give numbers you track today: hours of downtime per month, current OEE %, maintenance $/year, etc.)
- Roughly, what is the typical cost to the business when a critical asset is down for one day?
- Which asset classes cause the most worry today? (pick up to three)
- How soon do you need measurable improvement for executive confidence?
If we can’t prevent the next major shutdown, what will change?
- Imagine the next preventable shutdown still happens — what are the immediate business consequences you worry about most?
- How often are preventable, unplanned shutdowns occurring at your site today?
- Which of these impacts would create the most pressure from leadership if they occurred? (select one)
- Who in the business feels this pressure the most when a shutdown happens? (choose all that apply)
- How does a major failure typically impact team morale and decision-making in the following weeks?
What would it feel like when we really turned this around?
- If we achieved your ideal outcome, which of these would be true on the shop floor?
- What target percent reduction in unplanned downtime would you consider a meaningful win?
- What OEE improvement (absolute percentage points) would convince you the solution is working?
- Give an example of a behavior or decision that would change once the outcome is real (who does what differently)?
- Who must publicly acknowledge the improvement for it to be considered ‘successful’ internally?
- If you had to set a single success metric for a pilot, what would it be and why?
How accurate do your predictions actually need to be to change behavior?
- What minimum predictive accuracy would you require to act on an alert (choose the closest band)?
- What level of false positives is tolerable before technicians start ignoring alerts?
- How much lead time before failure do you need to plan effective intervention?
- Which failure signals matter most for you (select up to three)?
- Would you prefer fewer, highly confident alerts or more, earlier alerts with lower initial confidence?
Who will own the scoreboard — and how will we know they’re pleased?
- Which role is accountable for accepting outcome success at the end of a pilot?
- What reporting cadence and format convinces stakeholders (choose all that apply)?
- Which dashboard metrics would you require to be visible day‑to‑day? (pick up to five)
- How will you validate model performance — what specific tests or gates must pass?
- Who needs to be in the room for the final acceptance review?
Barriers, skepticism, and hidden risks — let’s name them now
- Which of these has been the biggest barrier in past analytics or PdM efforts?
- What specific data quality issues do your teams see most often? (pick all that apply)
- Have you run a predictive or condition‑monitoring pilot before? If yes, what ultimately caused it to succeed or fail?
- On a scale from 1–5, how worried are you about technician resistance to new mobile workflows and alerts?
- If a prediction turns out to be wrong, what consequence is most concerning?
- What would you define as an acceptable fallback if predictive accuracy or integrations take longer than expected?
The decision & acceptance playbook — how do we get to yes?
- Which commercial model best fits how you want to buy value?
- What pilot duration would you consider realistic to demonstrate value at your site?
- Which acceptance criteria must be satisfied before moving from pilot to production? (select up to four)
- Who needs to sign off commercially and operationally to begin a pilot (list names, titles, and contact preference)?
- What specific data access or security approvals will slow a project if not started early?
- If we propose a measurable pilot, what would be a realistic next step and timeline to get started from your side?
-
Solution Experience
Walk through how the platform delivers the agreed outcomes using the customer’s assets, failure modes, and data realities.
Experience Meetings
- Solution Experience Kickoff
- Data & Asset Validation Workshop
- Failure-Mode Use-Case Walkthrough
- Predictive Model Proof & Acceptance Testing
- Solution Experience Validation & Sign-off
- Document risk mitigation steps and monitoring approach for model performance post-deployment.
- Seller to run a light data health check and deliver a 1-page data quality summary with recommended fixes.
- Owner to confirm prioritized assets for the model proof and finalize incident examples to replay.
- One-sentence Recap (State/Consequence/Future)
- Prove, with customer data and incidents, that the platform's workflows produce the defined future state for prioritized failure modes.
- Quantify expected reductions in downtime or earlier detection lead-time for each scenario.
- Obtain direct validation from operational SMEs that the shown workflows are actionable and would be adopted.
- Seller to document scenario outcomes with quantitative estimates (lead time gained, downtime avoided) and assumptions.
- Customer SME to capture any required changes to technician workflows or acceptance criteria identified during the walkthrough.
- Plan follow-up model-proof session showing tuned thresholds and metrics.
- Model Overview & Assumptions
- Validate that model performance meets the customer's predictive-accuracy and lead-time acceptance thresholds.
- Agree the exact pass/fail acceptance tests and measurement period for deployment readiness.
- Introductions & Objectives
- Seller to deliver a model performance report including case-level evidence, chosen thresholds, and expected operational impact.
- Customer to review and sign off acceptance-test definitions and the measurement window.
- If thresholds fail tests, create a remediation plan (data enrichment, label correction, additional sensors) with owners and timeline.
- One-sentence Recap (Current/Consequence/Future)
- Obtain sponsor confirmation that the Solution Experience proved the future state or capture required remediation to achieve it.
- Agree the acceptance-test results and the conditions for moving into Solution Scope and commercial discussions.
- Assign owners and a short plan to resolve any outstanding gaps before Scope phase.
- Capture formal sign-off or list of remediation items with owners and due dates.
- Create a handoff packet (proof artifacts, data maps, acceptance-test logs, risks) and schedule the Solution Scope workshop.
- If remediation required, schedule necessary data fixes, retest windows, and interim checkpoints.
- Document a single-sentence current state that all stakeholders accept.
- Surface a quantified consequence that creates urgency for change.
- Agree a one-sentence future state expressed as operational outcomes and success metrics.
- Confirm the pre-work deliverables, owners, and schedule for the live experience sessions.
- Customer to provide asset registry, prioritized asset list, failure-mode library, three recent incident reports with downtime/costs, and sample historian/SCADA/ERP extracts.
- Assign named contacts for data access and the operational SME for scenario validation.
- Schedule Data & Asset Validation Workshop and Failure-Mode Walkthrough dates.
- Recap Pre-work and Objectives
- Confirm the exact list of prioritized assets and their owning SMEs for the Solution Experience.
- Validate that historical data quality is sufficient for model proof or specify required remediation.
- Produce a short remediation plan and timeline for any data gaps that would block credible proof.
- Customer to grant read access to sample historian/SCADA extracts and provide mapping file (tag->asset->failure mode).
- Summary of Proofs & Results
- Performance on Historical Incidents
- Scenario 1: Historical Incident Replay
- Asset Registry Walkthrough
- One-sentence Current State
- Sensor & Historian Mapping
- Explicit Consequence Statement
- Review Acceptance Criteria & Test Outcomes
- Scenario 2: Near-miss / Prevented Failure
- Threshold Tuning & Business Impact
- Define Future State (one sentence)
- Decision & Sign-off
- Data Quality Assessment
- Run Acceptance Tests
- Tieback to Consequence
- Transition to Solution Scope
- Experience Plan & Pre-work
- Edge Cases & Data Gaps
- Agree Asset Priority for Live Scenarios
- Risk & Mitigation Plan
- Remediation Plan for Gaps
- Validation Checkpoint
- Schedule & Roles
-
Solution Scope
Define modules, integration points, data ownership, training, timelines, and measurable deliverables.
Scope Configuration
- Asset registry setup and physical tagging
- Integrate SCADA/OPC-UA and PLC data streams
- Historian and ERP bi-directional integration
- IoT data ingestion, normalization, and cleansing
- Deploy condition-monitoring sensors and dashboards
- Deploy predictive analytics models for asset types
- Publish failure-mode library and asset mappings
- Configure RCM analytics and criticality scoring engine
- Configure CMMS work-order templates and forms
- Automatic work-order generation from condition alerts
- Configure MRO inventory, parts catalog, and reorder rules
- Deploy mobile technician app with offline capability and training
- Implement spare-parts kitting and BOM linkage
Scope Questions
Asset registry setup and physical tagging
- Do you currently have an asset registry or CMMS with an asset hierarchy?
- How many physical assets (rotating equipment, pumps, compressors, vessels, motors) will be in scope for initial deployment?
- Do you require physical tagging (barcode/QR/RFID) for assets or will you use logical identifiers only?
- Which tag types are acceptable for your site (choose all that apply)?
- Who will own asset master data and ongoing updates (role or team)?
- What timeline do you expect for completing registry setup and physical tagging?
Integrate SCADA/OPC-UA and PLC data streams
- Which PLC/SCADA vendors and protocols are in use (e.g., OPC-UA, Modbus, DNP3)?
- Are the SCADA/PLC endpoints accessible over the same network as the integration host or will DMZ / gateway configuration be required?
- How many distinct SCADA/PLC data points or tags do you anticipate integrating initially?
- Are there naming standards or tag dictionaries we should map to, or is tag mapping required from scratch?
- What availability and latency requirements do you have for SCADA data in the platform (e.g., real-time, near real-time, batch)?
- Are change-control and maintenance windows required for connecting to PLCs/SCADA? If yes, please describe.
Historian and ERP bi-directional integration
- Which historian platforms (OSIsoft/PI, Honeywell, AspenTech, other) do you use?
- Which ERP system manages work orders, part masters and purchase orders (e.g., SAP, Oracle, Infor)?
- Is bi-directional integration required (read/write), or read-only access to historian/ERP is sufficient initially?
- What business processes will require ERP write-back (e.g., create work orders, update spare levels, post labor)?
- Do you have API endpoints or middleware (e.g., enterprise bus, PI AF) we should use for integration?
- What SLAs or data freshness expectations do you require between historian/ERP and our platform?
IoT data ingestion, normalization, and cleansing
- What types of IoT sources will feed the platform (edge gateways, telemetry devices, third-party cloud feeds)?
- Do incoming data streams have consistent timestamps, units, and naming or will unit- and time-normalization be required?
- How do you want us to handle poor-quality or missing data (reject, impute, flag for review)?
- Do you require historical backfill of IoT/historian data for model training? If yes, how much history (months/years)?
- Are there data retention or compliance policies (e.g., purge after X months) that would affect ingestion?
- Who will own data normalization rules and exception handling (role/team)?
Deploy condition-monitoring sensors and dashboards
- Which condition-monitoring sensor types are required (vibration, temperature, ultrasound, oil analysis, current, others)?
- Do you have existing sensors that can be reused, or is full new sensor deployment required?
- What dashboard audiences and KPIs are needed (operations, reliability, maintenance; e.g., health score, trend alerts)?
- What level of dashboard customization is required (out-of-the-box templates, configuration, fully custom development)?
- Are there secure network or physical access constraints for installing sensors (e.g., confined space permits, hazardous area ratings)?
- What timeline and pilot scope do you propose for sensor deployment and initial dashboard roll-out?
Deploy predictive analytics models for asset types
- Which asset types do you want predictive models for in phase 1 (select all that apply)?
- Do you require pre-built models from our failure-mode library or fully bespoke models for your assets?
- What prediction horizon do you expect (e.g., remaining useful life in days/weeks, failure probability in next 30 days)?
- What minimum predictive accuracy or KPI (precision, recall, AUC) do you require for model acceptance?
- Do you have labeled failure events or run-to-failure records available for model training and validation?
- Who will validate model outputs operationally and sign off on model readiness (roles)?
Publish failure-mode library and asset mappings
- Do you use an existing failure-mode taxonomy (e.g., FMEA) that we should import?
- How many failure modes per asset type do you typically track and want published initially?
- Do you require custom failure-mode descriptions, root-cause guidance, and inspection steps included?
- Who will own approval of mappings between failure modes and asset tags/IDs?
- Should failure-mode mappings be version controlled and subject to change approvals?
- Do you want failure-mode library accessible in mobile app checklists and work-order templates?
Configure RCM analytics and criticality scoring engine
- Do you have existing criticality scores or RCM outputs to import, or should we run a new criticality assessment?
- Which factors should feed criticality scoring (safety, environmental, production loss $/hour, redundancy, repair time)?
- Do you require configurable weighting for scoring factors or fixed formulae?
- What stakeholder approvals or governance are required for final criticality lists?
- Do you want RCM outputs to drive PM frequencies, spares allocation, or priority work-order routing?
- What cadence do you expect for re-running criticality scoring (annual, quarterly, after incidents)?
Configure CMMS work-order templates and forms
- Which CMMS does your organization use and do we have admin access for template creation?
- What standard work-order types and workflows are required (corrective, preventive, predictive, inspection)?
- What fields and data must be captured on each work order (failure mode, root cause, parts used, labor hours, downtime)?
- Do you require approvals, safety checks, or lockout-tagout steps embedded into templates?
- Should mobile forms pre-populate fields from asset registry or sensors?
- Who will own template maintenance and periodic updates?
Automatic work-order generation from condition alerts
- Do you want condition alerts to auto-create work orders in CMMS or create draft tasks for review?
- What alert thresholds or severity levels should trigger automatic work orders?
- Which fields should be auto-filled on generated work orders (priority, asset, failure mode, estimated labor)?
- Do automatic work orders need approval workflows before dispatch?
- What rate limits or throttling rules are required to prevent work-order floods from noisy alerts?
- Who will be responsible for triage and assignment of auto-generated work orders?
-
Mutual Commit
Agree commercial terms, implementation milestones, risk allocations, and mutual acceptance criteria.
Agreement Modules
- Non-Disclosure Agreement (NDA)
- Master Services Agreement (MSA)
- Statement of Work (SOW)
- Commercial Terms & Pricing Schedule
- Implementation Milestones & Acceptance Plan
- Service Level Agreement (SLA) & Support
- Data Processing & Ownership Agreement (DPA)
- Security & Compliance Attestation
- Risk Allocation & Liability Schedule
- Change Order & Scope Management
- Pilot / Proof-of-Concept (POC) Agreement
- Training & Knowledge Transfer Plan
- Escrow & IP / Model Explainability Agreement
- Governance & Steering Committee Charter
- Termination, Renewal & Exit Plan
- Insurance & Indemnity Certificates
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Pre-Deployment Readiness
Verify data feeds, historian/SCADA/ERP access, sensor mappings, environments, and named owners are ready.
Readiness Questions
A Fast Siting Check — Getting Everyone on the Same Page
- Which site or plant are we preparing for this deployment (site name, region, and business unit)?
- Who is the reliability executive sponsor for this site, and who will be our primary day-to-day contact?
- What is the target go-live window for the initial deployment (earliest possible date and any immovable deadlines)?
- Which production lines, units, or asset classes are in scope for Day One (list top 3–5 priority assets or systems)?
- Is there an existing project or change freeze window we must avoid during cutover (dates or recurring blackout periods)?
If Your Data Could Talk — How Honest Would It Be?
- How confident are you that historical sensor and historian data are complete and trustworthy enough to seed our predictive models?
- Which historian, SCADA, or time-series platforms store the sensor signals we need (select all that apply)?
- How do you typically access historical data for analytics today?
- Can you share a recent example where data quality impaired decision-making or caused a false alarm? Tell us what happened and how it felt for the team.
- What are the most common data quality issues you expect us to encounter (select all that apply)?
Do We Really Have the Right Sensors Where It Counts?
- What would surprise you if we told you an asset lacked the sensor coverage required for reliable predictions?
- For the top priority assets, which physical signals are available today (temperature, vibration, pressure, flow, current, etc.)? Please list by asset or asset group.
- Are there undocumented or 'zombie' tags in your systems that teams still reference informally?
- How often are field sensors calibrated or replaced, and who owns that maintenance schedule?
- If we find missing or mis-labeled sensors during mapping, how do you prefer we handle remediation planning?
Who’s Holding the Rope — Roles, Responsibility, and Real Availability
- If production alarms start firing during a cutover, who has authority to pause or push the cutover back — and how fast can they be reached?
- Do you have named owners assigned for these areas: data access provisioning, tag mapping validation, security approvals, and technician enablement?
- How available will your SMEs (control systems, reliability, and operations) be for workshops, validation, and rapid triage during the first four weeks?
- Describe the ideal escalation path for production-impacting issues during deployment (who gets notified, in what order, and SLA for response).
- Are there union, shift, or contractor constraints that affect who can perform cutovers or sensor work and when?
If Deployment Fails — What Does That Cost (and Who Notices)?
- What is the material impact if a deployment mistake causes an asset shutdown or production loss during the cutover window?
- Which integration points are most sensitive and must be validated first (e.g., EAM/CMMS work-order creation, ERP inventory sync, historian writes, real-time control loops)?
- How closely does your test/staging environment mirror production for these systems and integrations?
- Do you have rollback or back-out procedures for integrations and cutovers? If yes, please summarize how long rollback takes.
- Who signs the 'stop-the-press' approval if an integration test reveals a critical risk during deployment?
How Will We Know Day One Worked — Defining Real Acceptance
- What are the three measurable acceptance criteria that would convince you Day One is a success (e.g., model uptime, data completeness %, number of validated alerts)?
- For predictive models, what minimum performance would you accept before we move from pilot to full use (precision/recall, lead time, or KPI improvements)?
- Which reports or dashboards must be populated and verified on Day One for operations and reliability teams to trust the system?
- How will you formally sign off on acceptance tests (who signs, format: email, ticket, signed doc)?
- If the first month shows model drift or higher false alarms than expected, what remedial actions are you willing to commit to (re-training cadence, additional sensors, operational tuning)?
Practical Logistics — Access, Security, and Data Handshake
- What method will your IT/OT team use to grant us access to systems: VPN, site DMZ service account, API keys, SAML service principal, or on-prem agent?
- Which data transfer protocols and interfaces must we support or plan for (select all that apply)?
- Are there formal security or vendor onboarding requirements we must complete before any credentials are issued (e.g., risk assessment, pentest, insurance, background checks)?
- What level of logging and auditability do you require for data access and model actions (retention window, SOC report needs, SIEM integration)?
- Who in IT/OT will complete access provisioning and what typical lead time do they need for creating service accounts and firewall rules?
Training, Handover, and Making This Stick
- What style of technician enablement works best at your site: hands-on shadowing, short focused workshops, distributed e-learning, or train-the-trainer?
- How many technicians and supervisors need access to mobile workflows on Day One, and what devices/OS do they use (iOS, Android, rugged devices)?
- What change-resistance have you seen historically when introducing new digital workflows to technicians, and what helped overcome it?
- Who will own post-deployment governance: maintaining tag mappings, model retraining cadence, and user access reviews?
- What success communications would reassure leadership after cutover (example: 7-day status, 30-day KPI snapshot, executive one-pager)?
Making a Real Plan — Who Signs, What We Need, and Next Milestones
- From your perspective, what are the non-negotiable artifacts we must have before starting cutover (access tickets, owner list, test plan, rollback plan)?
- Please provide the names and email addresses (or ticket numbers) of the individuals who will approve each of these artifacts.
- What is the single biggest risk that would make you pause deployment today, and what would it take to mitigate that concern?
- How quickly can your teams provide the first set of mapped tags and historical sample extracts for our initial model validation?
- Are you willing to schedule a 60–90 minute readiness workshop this week to review access, mappings, and sign-off on the Day One acceptance criteria?
-
Deployment Enablement
Schedule tasks, run integrations, perform cutovers, and deliver technician enablement with clear owners and timelines.
-
Validation Checklist
Execute acceptance tests for predictive models, integration points, mobile workflows, and capture formal sign-offs.
Validation Questions
Start Here: Scope, People, and Why We’re Talking
- Which site(s) or asset classes should we focus on for this discovery?
- Who is sponsoring this initiative and who will be our primary operational contact?
- What is the immediate trigger that pushed this project onto your agenda now?
- Do you have a target decision date or event (budget cycle, audit, outage) driving timing?
- Who will need to sign off for go-live and who controls budget approval (names/titles)?
- What would success look like to your sponsor in the first 6 months—briefly describe top outcomes?
What If We’re Underestimating How Much It’s Costing You?
- If your most critical unit went down for one full day, roughly how much would it cost the business?
- Describe the most recent unplanned shutdown for scope assets—what failed, how long did it take to recover, and what was the root cause?
- How many unplanned stops have those asset classes experienced in the last 12 months?
- Which of the following hidden costs occur when outages happen at your site?
- Who currently owns the calculation and reporting of downtime cost and production loss?
- How do these failures feel to the teams who respond—are they outraged, resigned, constantly firefighting, or something else?
What’s Actually Running Under the Hood (Assets, Systems, and Access)
- How complete is your asset registry for the target scope (tags, hierarchy, BOMs)?
- Which systems currently hold the critical data we’ll need?
- Do you have a single canonical asset ID mapped across those systems, or will we need to build and validate mappings?
- What sensor and signal types are available on priority assets (select all that apply)?
- How accessible are real-time and historical time-series feeds (streaming API, historian extracts, only manual reports)?
- Who will be our technical data contacts for each system and how quickly can they provide credentials or extracts?
Where the Data Quietly Breaks (Quality, Labels, and Gaps)
- Which of these data issues most often undermines analytics accuracy at your site?
- Estimate the percentage of historical data you would trust for model training without significant cleaning.
- What existing processes, if any, do you use to validate or clean historian/sensor data?
- How often do you discover sensors or tags were misconfigured only after a failure occurs?
- For supervised model training, approximately how many high-confidence labeled failure events can you provide for your top 5 asset types?
- Are you willing to allocate engineering time to tag cleanup, historian retention changes, or sensor recalibration if it materially improves model outcomes?
Who Pulls the Emergency Lever? Decision Roles, Incentives, and Politics
- Which stakeholders’ KPIs are most likely to conflict during evaluation and procurement?
- Please list named decision-makers and a one-line summary of what success looks like to each (name, title, top priority).
- Which commercial model do you prefer or expect (so we can align proposals)?
- What procurement gates and timeline should we plan for (legal, security review, steering committee)?
- Who will own acceptance testing and who signs operational acceptance at the plant?
- How do you prefer executive updates during the project (cadence and format)?
If Predictions Were Right, What Would Actually Change?
- Select the measurable targets you want to achieve in year one.
- What minimum predictive performance would you accept before operations act on an alert (choose the best match)?
- Which actions should be automated immediately on an alert versus require manual supervisor approval?
- What KPIs and reporting cadence will you use to declare the project a success (and how are those KPIs measured today)?
- If early pilot results don’t hit targets, which corrective actions would you consider acceptable?
What Could Derail This Before We Start (Risks, Constraints, and Past Lessons)
- Which single risk worries you most for a digital reliability project?
- How confident are you that we can complete integrations to historian / CMMS / ERP within your desired timeline?
- What change-management or training resources have you allocated to ensure technicians adopt mobile workflows?
- Have past digital initiatives faced internal resistance—what happened, and what did you learn?
- Which constraints (budget, headcount, OT security, regulatory) would force us to pause work?
- Who will be responsible for ongoing model monitoring, triage of false alerts, and continuous improvement?
How We’ll Validate Together—and Who Signs Off
- What acceptance tests must pass before you will sign operational acceptance (pick all that apply)?
- Which assets or production lines should be included in the validation pilot (please list names/tags)?
- What minimum sample size or duration will you accept for a valid pilot (events or weeks)?
- Who must provide formal sign-off at pilot completion and in what format (email, CFT approval, PO)?
- Which metrics should appear in the validation report and dashboard to convince your team to move to full deployment?
- What are acceptable thresholds for mobile workflow UAT (for example: completion rate, data capture completeness)?
-
-
Success
Review outcomes against success signals, document lessons, and maintain a shared channel for issues and enhancements.
Success Reviews
- Executive Success Outcomes Review
- Operational Validation & Model Performance Review
- Lessons Learned & Continuous Improvement Workshop
- Support Handoff & Shared Channel Configuration
- ROI Validation & Expansion Planning
Issues & Enhancements
- Ensure runbooks and KB ownership are assigned and update cadence is set.
- Project Timeline & Decision Log Recap
- Produce a documented 'lessons learned' artifact capturing concrete changes to process, data handling, and delivery.
- Create a prioritized enhancement backlog with owners and target timelines.
- Agree the governance model and cadence for ongoing backlog reviews via the shared channel.
- Publish the lessons learned document and RCA summaries to the shared channel.
- Create prioritized backlog tickets in the agreed tracking tool and assign owners.
- Establish the recurring backlog review meeting invite and roster.
- Support Model & Roles Overview
- Have a production-ready shared channel with correct access and alerting configured.
- Agree on a documented escalation matrix and SLAs for incident handling.
- Introductions & Meeting Objectives
- Create the shared channel, invite the named owners, and set the initial alert rules.
- Publish the escalation matrix and SLA document into the channel and KB.
- Schedule the onboarding session and a short escalation drill within the next 30 days.
- ROI Methodology & Assumptions Recap
- Confirm the validated ROI and the business case for continued investment.
- Identify and prioritize expansion targets with preliminary feasibility notes.
- Agree required commercial steps, proposal owners, and a timeline for the expansion decision.
- Prepare a validated ROI deck and one-page business case for executive review.
- Draft an expansion proposal for the top-priority target including scope, timeline, and estimated cost.
- Schedule the executive decision meeting with required approvers and attach the ROI deck.
- Confirm that the deployment met the documented success signals or capture gap items requiring remediation.
- Obtain executive-level sign-off or documented conditional acceptance tied to specific remediation actions.
- Ensure the business impact (financial and operational) is explicitly recorded and agreed upon.
- Establish the governance cadence and owner for ongoing success monitoring.
- Publish an executive summary report showing baseline, measured outcomes, quantified business impact, and signatories.
- Create remediation tickets for any acceptance gaps with owners and target close dates.
- Schedule the recurring success-monitoring cadence (monthly/quarterly) and invite the governance stakeholders.
- Pre-work Check & Evidence Requirements
- Verify all technical acceptance tests are evidenced and either passed or have assigned remediation plans.
- Confirm predictive models meet performance thresholds for operational use or agree tuning actions.
- Ensure operational workflows (mobile/CMMS/integrations) work end-to-end in production-like scenarios.
- Establish owners and timelines for any re-tests and model tuning tasks.
- Assign model-tuning tasks with specific metric targets and owners.
- Update acceptance-test artifacts with pass/fail evidence and publish to the shared channel.
- Schedule a re-test session for any failed acceptance items with required participants.
- Issue Severity Definitions & SLA Targets
- Validated ROI Presentation
- Crystal Current State (Baseline)
- Acceptance Test Results Walkthrough
- Structured What-Went-Well / What-Should-Change
- Expansion Opportunities & Operational Fit
- Measured Outcomes vs Success Signals
- Root-Cause Analysis of Top Issues
- Model Performance Deep-Dive
- Shared Channel Setup & Alerting
- Knowledge Base, Runbooks & Access
- Enhancement Backlog Creation & Prioritization
- Operational Workflow & Mobile Validation
- Consequence / Business Impact Quantification
- Commercial Options & Timeline
- Decision Points & Next Steps
- Remediation & Re-test Plan
- Governance for Shared Channel & Backlog Cadence
- Acceptance Criteria Validation & Sign-off
- Onboarding & Escalation Drills
- Next Steps & Executive Decisions