Learning Management
Multi-stakeholder institutional decisions where academic mission, student outcomes, and financial sustainability converge.
Inside this journey
-
Pre-Discovery
Align the room on outcomes, decision process, and constraints before deeper discovery.
-
Stakeholder Alignment
Confirm decision roles, faculty governance constraints, timeline, and prioritized success signals (accessibility, analytics, integrations, uptime).
Alignment Questions
Starting Warm: Help Us See Your Campus
- To get us oriented, which best describes your institution?
- Roughly how many students (FTE) does your institution serve?
- Who will be the primary executive sponsor for an LMS decision at your institution?
- What is your target decision or renewal window?
- What single trigger brought this evaluation to the top of your list right now?
- Which of these factors are motivating this change? (select all that apply)
Are You Settling for Slow Crises?
- How frequently do performance problems (slow page loads, timeouts, outages) materially disrupt teaching or exams?
- Tell us briefly about the most recent incident that impacted instruction—what happened and who felt the impact?
- Which of these consequences have you seen from peak failures? (select all that apply)
- Who currently runs incident response and communication during an LMS outage?
- How long, on average, does it take to restore full service after a major disruption?
Who's Really Calling the Shots?
- If faculty governance pushed back hard on a platform choice, could the project proceed without their buy-in?
- Please list the groups or committees that must sign off before a final contract is executed (e.g., faculty senate, procurement, IT governance).
- How formal is your faculty governance process for instructional tools?
- When IT and faculty priorities conflict (e.g., security vs. tool freedom), how do you typically resolve it?
- Are there external stakeholders (state boards, unions, accreditation bodies) who can overturn or materially delay a decision?
Where the Integrations Break Our Flow
- Which integrations have forced you into permanent custom workarounds that cause ongoing maintenance headaches?
- Which SIS does your institution use?
- How are roster and grade syncs currently implemented?
- Do your publisher partners support LTI 1.3 and deep gradebook integration, or do you still build bespoke bridges?
- Approximately how many distinct third‑party tools would need reliable integrations for a representative pilot?
- What has been the longest delivery timeline you've experienced for a single integration (from spec to production)?
When Accessibility Isn't Optional
- If a compliance complaint escalated to an external review, how exposed would the institution be on accessibility grounds?
- Have you conducted formal WCAG 2.1 AA audits in the past 24 months?
- Which accessibility failures cause the most operational pain (select all that apply)?
- How do faculty typically check content accessibility today?
- Who owns remediation actions and timelines when content is flagged (role or office)?
- What SLA for remediation of flagged course content before a term starts would you consider acceptable?
If Success Had a KPI, What Would It Be?
- Which single metric, if improved, would convince executive leadership this change was worth the investment?
- What pilot acceptance criteria must we hit for you to expand beyond the pilot? Please list the top 3.
- Which analytics signals are highest value to your advisors and provost (select all that apply)?
- Do you have baseline values for those metrics today (so we can define a meaningful improvement)?
- How often do decision stakeholders want performance dashboards during a pilot?
What Would a Smooth Pilot Feel Like?
- If faculty left a pilot debrief, what would they say if the experience felt genuinely effortless and useful?
- How many courses and instructors constitute a pilot that both stresses integrations and feels credible to faculty governance?
- Which program types must be included to represent realistic variance (select all that apply)?
- What level of data migration do you expect for pilot courses (select one)?
- Which pilot acceptance tests are non‑negotiable? (select all that apply)
- Who will be authorized to sign off that the pilot met acceptance criteria?
What's the Real Cost of Doing Nothing?
- Conservatively, which annual impact band best describes the combined cost of doing nothing (lost tuition, staff time, remediation, risk)?
- Estimate the annual helpdesk or staff hours spent resolving LMS-related instructional issues.
- Have departments created parallel systems or workarounds that create data silos or compliance risks?
- Has lack of reliable analytics previously impacted accreditation reporting or grant compliance?
- What is the single greatest internal barrier preventing action today?
Deciding Together: Timeline, Risks, and Owners
- If everything aligned, what is the earliest realistic term you could begin a pilot?
- Which top risks would most likely derail a pilot or initial go‑live? (select up to three)
- Who will act as the day‑to‑day vendor coordinator and project lead from your side (name and role)?
- Are there procurement, legal, or state rules we must design around (e.g., fixed budget cycles, vendor prequalification)?
- Which hosting model do you prefer we scope for initial discussions?
- Who should be invited to the shared project/channel for ongoing communications?
-
Current State Mapping
Document the incumbent LMS failures, peak-load risks, integration debt with SIS/publishers, and faculty pain points to quantify consequences of status quo.
Current State
Opening: Tell Us About Today
- What's the immediate trigger that's led you to explore a new LMS right now?
- Who at your institution is pushing hardest for a change (role or group)?
- How do you expect a new LMS decision to be made—fast, deliberate, or political? Tell us the likely cadence.
- What's the one outcome that would convince leadership this was worth doing? (If you had to pick a single metric.)
Are You Comfortable With 'Good Enough'?
- What are you quietly tolerating today that you suspect is actually costing the institution money, time, or trust?
- How often do these tolerated issues surface where they cause real harm—lost registrations, angry faculty, accreditation questions, or escalations?
- Can you share one or two concrete incidents (dates, course, impact) where the LMS failure materially affected operations or reputation?
- Who bears the hidden operational cost when these problems happen (IT overtime, instructor rework, student refunds, vendor engineers)?
- If we put a dollar figure on recurring pain (time, remediation, lost enrollment), what's your best estimate for annual impact?
When Finals Break, Who Gets Blamed?
- How confident are you that the current LMS will survive peak loads (registration, midterms, finals) without service degradation?
- Describe the last peak-load incident: what failed, how long it lasted, and who had to respond.
- What monitoring or load-testing do you currently perform, and how often are those tests run?
- What SLA or uptime level during registration and finals would feel non-negotiable for your leadership?
- If an outage occurred during finals next term, what would the immediate operational consequences be (list owners, costs, and reputational impact)?
Where Do Integrations Fall Apart?
- Which integration currently causes the most firefighting—SIS roster/grade sync, publisher LTI tools, library auth, or something else?
- How many custom integrations or one-off connectors has IT built and now maintains for production courses?
- When you add a new publisher tool or department app, how long does it typically take from request to reliable, graded integration?
- Who owns integration documentation, credentials, and change control today—central IT, individual departments, or vendors?
- What recurring errors or data mismatches do you see between systems (grade sync failures, roster lags, broken links)? Please list examples.
Faculty: Silent Resignation or Active Rebellion?
- How would faculty describe their relationship with the LMS—indifferent, frustrated, actively avoiding it, or enthusiastic?
- Can you name common ‘workarounds’ faculty use because the LMS doesn't support their workflow (shared drives, email submissions, publisher portals)?
- What percent of courses use external publisher tools or third-party apps that must integrate with one central gradebook?
- Tell us about faculty support and training today—how do instructors learn the LMS and who steps in when they hit a problem?
- How often do faculty complaints escalate to the provost or faculty senate, and what's the typical ask in those escalations?
Accessibility: How Much Risk Are You Carrying?
- If an accessibility audit happened tomorrow, where would you most expect to fail against WCAG 2.1 AA—course content, media, navigation, or assessments?
- What accessibility remediation workflows exist today (automated flags, human remediation, faculty training)?
- Have you received formal accessibility complaints or legal notices in the last 3 years? If yes, what was the outcome?
- Who is accountable for accessibility compliance—DSS, central IT, academic tech, or department chairs?
- How would accessibility improvements change faculty or student behavior if addressed well (examples: increased enrollment, lower accommodation requests)?
If We Do Nothing, What's the Price Tag?
- Projecting forward 12–36 months, what are the top three negative outcomes that will most likely occur if the LMS remains as-is?
- Which stakeholders would be most affected by those outcomes (list names/roles) and how might they react?
- Are there accreditation, regulatory, or audit dates coming up that make timing critical? Please list target months/years.
- What would it take to make the business case internally—estimated savings, reduction in complaints, or a risk mitigation narrative?
- If we documented the status quo consequences in one slide for your board or provost, what single metric would they care about most?
Short-Term Wins vs Long-Term Change
- Which outcomes would you prioritize for the first 90 days of a pilot to prove momentum—performance, accessibility, integrations, or faculty satisfaction?
- What pilot scope feels believable and manageable—single course, program-level, or institution-wide sample? Explain the rationale.
- Who needs to be on the pilot steering committee for approvals and rapid decisions (list roles and names if possible)?
- What controls or acceptance criteria would you require to consider a pilot successful (examples: grade sync accuracy, load handling, faculty NPS)?
- Realistically, what internal obstacles could stall a pilot even if the tech works—policy, governance, faculty time, or procurement?
Decision Signals: Who Says Yes (and Why)?
- Who holds the final budget authority and who holds final academic approval for an LMS selection?
- What are the non-negotiable contract terms or SLA elements that must be in place for you to sign a multi-year agreement?
- How will you measure success 6 months after deployment—what dashboards, KPIs, or qualitative signals will prove the investment paid off?
- What timeline would be acceptable from vendor selection to a pilot start (months)?
- What's the single biggest barrier we should help you remove to make a compelling decision faster?
-
-
Outcome Discovery
Define measurable institutional outcomes—pilot acceptance metrics, WCAG 2.1 AA compliance, analytics signals for retention, and acceptable SLA levels.
Discovery Questions
Start With What You Can't Compromise
- Which of these outcomes are non‑negotiable for your institution this procurement cycle?
- What is your target decision timeline (award to full production)?
- Who will be the ultimate signatory(s) for outcome acceptance (role/title)?
- Which existing data points do you already use to show whether the LMS is meeting goals (please list dashboards, reports, or KPIs)?
- Imagine you could only keep two success signals forever—what would they be and why?
If This Fails During Finals, Who Suffers?
- When peak load spikes during registration or finals, how would you describe the real institutional impact—not just the tech metrics but the human and reputational costs?
- How often in the last three years has the incumbent LMS experienced performance or outage events that affected grading, exam delivery, or registration?
- How do those events translate into measurable consequences for the university (e.g., delayed grades, appeals, emergency IT overtime, student complaints, enrollment effects)? Provide any numbers or examples.
- Who historically owns incident communications to students and faculty when outages occur?
- What mitigation or contingency steps have you used during past peaks, and how long did it take to restore normal operations?
- Which of the following peak‑load scenarios concern you most (select all that apply)?
Are We Mistaking Uptime for Reliability?
- If an SLA says 99.9% but students still experience slow grading and intermittent failures during critical windows, does that SLA actually protect your mission?
- Which SLA target feels acceptable to your leadership for registration and finals windows?
- Beyond an uptime percentage, what remediation or operational commitments must be in an SLA to feel meaningful (alerts, dedicated support, rollback/compensation)?
- What recovery time objectives (RTO) and recovery point objectives (RPO) for student/grade data are acceptable to you?
- Who in your organization must approve SLA language and who will manage SLA compliance afterward?
What Would Make Faculty Say “This Is Better”?
- If faculty could vocalize one thing that would make them love the LMS, what do you think it would be?
- For the pilot, what acceptance thresholds would indicate faculty buy‑in (e.g., % of pilot faculty who continue using it after term, % of courses using gradebook, NPS score)?
- How do you currently surface faculty pain—formal surveys, faculty senate motions, helpdesk tickets—and how timely is that feedback?
- What incentives or protections would help faculty adopt a pilot (release time, TA support, grading leniency, stipends)?
- Describe a recent example where a faculty pilot succeeded or failed—what made the difference?
- Who will be the faculty champions or pilot leads, and what authority do they have to make acceptance recommendations?
Which Student Signals Should Trigger Action?
- If you had to pick one early‑warning indicator that would change an advisor’s behavior, what would it be?
- What precise thresholds matter to you for those signals (e.g., 2 missed assignments, 30% drop in activity, grade drop ≥ 10 pts)?
- Who should receive automated alerts—advisors, instructors, success coaches, students themselves, or a combination?
- How often should analytic signals be refreshed and pushed (real‑time, hourly, daily, weekly)?
- How confident are you in your current data quality and event tracking to support high‑stakes interventions?
- If analytics showed a 5% predicted risk of course failure for a cohort, what institutional actions would you expect to follow?
Accessibility Isn't Optional — Where Are You Vulnerable?
- If an accessibility audit found systemic WCAG 2.1 AA failures in published courses, how would that change your timeline or willingness to adopt a new LMS?
- What is your current WCAG 2.1 AA posture—formal certification, periodic audits, spot checks, or ad hoc remediation?
- Which accessibility outcomes are most important to you (select up to three)?
- How quickly must critical accessibility issues be resolved once identified?
- Describe any past accessibility incidents and how they were resolved—what was the stakeholder reaction and cost?
- Would you accept automated accessibility checks alone, or do you require combined manual verification for pilot acceptance?
If This Pilot Succeeds, What's the Next Conversation?
- What specific pilot acceptance criteria would make you ready to move from pilot to institution‑wide rollout?
- Who must sign off on pilot acceptance (roles/titles), and how will disputes be resolved?
- What handoffs and responsibilities must be clearly assigned before migration (data exports, mapping owners, migration windows, rollback plan)?
- What migration models are you open to for scope and timing?
- How much runway do you need between pilot sign‑off and full rollout (weeks/months)?
- What governance cadence would you prefer post‑deployment for performance reviews and enhancements?
- What contractual protections or exit clauses would make your procurement committee comfortable signing a multi‑year agreement?
-
Solution Experience
Walk through how the LMS will deliver those outcomes using the university’s real courses, pilot scenarios, and integration flows with SIS and publisher tools.
Experience Meetings
- Solution Experience Prep & Current State Confirmation
- Course-Centric Pilot Walkthrough — Live Scenarios with University Content
- Integration Flows Workshop — SIS, LTI, and Publisher Tools
- Faculty Pilot Dry-Run & Accessibility Validation
- Outcome Proofing & Acceptance Criteria Review
- Customer Faculty: Run through the provided checklist on the pilot course and submit feedback within 48 hours.
- Identify any integration gaps and assign remediation owners with target dates.
- Ensure performance and retry behaviors meet the institution's SLA needs for peak periods.
- Customer: Deliver a current SIS export sample and a list of problematic edge cases (cross-lists, merged sections, waitlists).
- Customer IT: Provide sandbox API credentials and test accounts for each publisher integration.
- Seller: Document API rate limits, batching recommendations and a retry policy for production handover.
- Roles, Expectations & Success Criteria Recap
- Validate the instructor and student workflows for the pilot courses under realistic conditions.
- Confirm WCAG 2.1 AA automated checks operate on live course content and define the manual audit cadence.
- Identify and assign remediation tasks for accessibility and UX issues before pilot start.
- Collect faculty training needs and finalize quick-reference materials to be delivered prior to pilot.
- Introductions & Meeting Objectives
- Seller Accessibility Team: Produce an itemized remediation plan for flagged WCAG issues with estimated effort.
- Seller: Update faculty-facing quick guides and short training videos addressing the issues surfaced.
- Customer: Designate who will sign off on accessibility remediation per course.
- Reconfirm Future State & Success Signals
- Agree and document measurable pilot acceptance criteria tied to the success signals.
- Confirm who will sign off on each acceptance item and the remediation window for failures.
- Validate dashboards and analytics capture the signals required by advisors and accreditation teams.
- Establish a governance cadence for pilot progress and final acceptance.
- Seller: Deliver a draft pilot acceptance checklist populated with pass/fail criteria and required evidence for each item.
- Customer: Assign sign-off owners for accessibility, integrations, performance and faculty acceptance.
- Seller/Customer: Schedule the formal pilot end review and acceptance meeting date.
- Seller: Configure dashboards to surface agreed analytics signals and share access with customer stakeholders.
- Have a single confirmed current-state sentence that everyone can repeat and validate.
- Surface and quantify the consequences of the status quo in measurable terms.
- Agree a single future-state sentence that frames the Solution Experience proof points.
- Obtain all pre-work deliverables and access required to run course-based walkthroughs.
- Customer: Share peak-load logs, 3 pilot course packages (syllabi, sample content), SIS export, and publisher integration details.
- Seller: Provision a scoped test tenant preloaded with the provided pilot courses and configure initial SIS and LTI endpoints.
- Seller: Produce one-sentence current-state and future-state drafts and circulate for customer confirmation.
- Customer: Assign 2 faculty champions and an IT lead who will attend the hands-on sessions.
- Re-state Current State & Future State
- Demonstrate that core instructor and student experiences for representative courses meet the future-state outcomes.
- Validate that publisher/LTI flows and grade sync work with the institution's real content and mapping rules.
- Collect faculty feedback and list concrete exceptions to be resolved during the pilot.
- Produce a prioritized checklist of functional gaps tied to acceptance criteria.
- Seller: Configure pilot courses in the test tenant to mirror the customer content and run a baseline grade-sync test.
- Customer: Provide any missing LTI credentials, publisher keys, and sample student accounts for realistic testing.
- Seller/Customer: Jointly document each logged exception with owner and target remediation date.
- Seller: Capture video snippets of successful flows to include in the pilot runbook.
- Seller: Create automated integration test scripts and a nightly reconciliation report for pilot rosters and grades.
- Customer Integration Topology Presentation
- Confirm the LMS integration behavior matches the institution's SIS and publisher workflows for all pilot cases.
- Agree a concrete set of integration acceptance tests that will be run during pilot validation.
- One-sentence Current State
- Pilot Acceptance Metrics Walkthrough
- Instructor Content Publish & WCAG Check
- SIS Mapping & Grade Sync Demo
- Large Lecture Course Scenario (Course A) — Enrollment & Assessment
- Consequence Quantification
- Performance & SLA Proofing
- Student Submission & Grading Dry-Run
- LTI & Publisher Flow Execution
- Lab/Discipline-Specific Course (Course B) — LTI Tool & Publisher Content
- Acceptance Tests & Sign-off Process
- Publisher Tool Accessibility & UX Validation
- Edge Cases & Rate/Load Considerations
- One-sentence Future State
- Seminar/Online Course (Course C) — Discussion, Assignment Rubrics, Accessibility Checks
-
Solution Scope
Define modules, hosting option, LTI integrations, accessibility checks, analytics dashboards, pilot breadth, and migration responsibilities.
Scope Configuration
- Course Shell Provisioning
- SIS Roster Sync and Auto-Enrollment
- Unified Gradebook Sync to SIS
- LTI 1.3 Tool Integration and Grade Passback
- Assignment Submission with Plagiarism Integration
- Threaded Discussion Board Deployment
- Video Hosting and Live Streaming
- Browser-Based Proctoring Delivery
- WCAG 2.1 AA Automated Content Checker
- Engagement and Early-Alert Analytics Dashboard
- Mobile App Access with Offline Sync
- API Connector Gateway for SIS/Publishers/Library
- SaaS or Private-Cloud Instance Provisioning with SLA
Scope Questions
Course Shell Provisioning
- Do you require automated course shell provisioning for terms and ad-hoc courses?
- Approximate number of course shells to provision per term (including cross-listed sections)?
- Do you use course templates or shell archetypes that must be applied at provisioning?
- What naming, metadata, and visibility rules must be enforced on provisioned shells (e.g., course code, term, instructor visibility)?
- Should provisioning include placeholder content (syllabus, announcements) and optional tool links?
- Who will own provisioning exceptions and overrides (e.g., Registrar, Department Admin, IT)?
SIS Roster Sync and Auto-Enrollment
- Do you require automated roster sync from your SIS with daily/real-time updates?
- Which SIS vendor and version will we integrate with (provide name and any middleware)?
- How should enrollment changes be handled (add/drop deadlines, late adds, waitlists)?
- Do you need cross-listed section merging, co-teaching support, and section-level permissions?
- Are there special populations (continuing ed, guest students) that require custom enrollment rules?
- Who will own enrollment exception workflows and SIS-to-LMS reconciliation?
Unified Gradebook Sync to SIS
- Do you require grade syncing from the LMS gradebook to the SIS (midterm, final, or continuous) and at what cadence?
- Which grade item types and mappings must be supported (percentage, letter, pass/fail, custom scales)?
- What business rules govern grade posting (e.g., faculty approval required, grade-lock windows)?
- Will rubric scoring, excused work, or grade overrides need special handling during sync?
- Are there FERPA or other data privacy constraints that affect grade visibility or transfer?
- Who is responsible for validating grade sync success and resolving exceptions?
LTI 1.3 Tool Integration and Grade Passback
- Which external LTI tools (publishers, assessment platforms, virtual labs) must be integrated via LTI 1.3?
- Do you require automatic grade passback from LTI tools to the LMS gradebook and onward to the SIS?
- Are there existing LTI tool deployments we must replicate (key/platform configs, deep linking, roles)?
- Do any integrations require special security attestations, vendor certificates, or IP allowlists?
- What load and concurrency expectations should we plan for from integrated tools during peak periods?
- Who will provision and maintain LTI credentials and vendor relationships (IT, department, publisher)?
Assignment Submission with Plagiarism Integration
- Do you require an integrated plagiarism detection tool (e.g., Turnitin) for assignment submission?
- What submission types are required (file upload, text entry, media, ZIP for code/artifacts)?
- Are there file size, storage retention, or archival policies that affect submissions?
- Do you require late submission rules, turn-in windows, and instructor override controls?
- Should submission metadata (timestamps, IP, device) be captured for integrity or audit purposes?
- Who will manage plagiarism policy thresholds and dispute workflows?
Threaded Discussion Board Deployment
- Do you want threaded discussions enabled by default in all course shells or opt-in per course?
- What moderation and permission models are required (TA roles, student anonymity, posting approvals)?
- Are integrations needed between discussion boards and gradebook or analytics (participation scoring)?
- Do you require migration of legacy discussion data or archiving of threads for accreditation?
- What retention, export, or e-discovery policies apply to discussion content?
- Should mobile and offline access be supported for discussion participation?
Video Hosting and Live Streaming
- Do you require managed video hosting with CDN, or will you use an existing campus media service?
- Will live synchronous streaming (lectures, webinars) be required and at what peak concurrency?
- Are captioning, transcript generation, and WCAG-compliant video players required?
- What storage and retention policies apply to recorded sessions and uploaded media?
- Do you need integrations between video analytics (views, engagement) and LMS analytics dashboards?
- Who will manage media rights, access policies, and content takedown requests?
Browser-Based Proctoring Delivery
- Is remote proctoring required for some courses, and if so, what proportion of assessments will use it?
- Which proctoring model do you prefer (automated AI, live proctoring, blended)?
- What privacy, consent, and data retention constraints apply to video/audio capture during proctoring?
- Do you require integrations with assessment engines, identity verification, or LMS gradebook?
- Are there acceptable performance targets and fallback policies for high-concurrency exam windows?
- Who will handle incident review and academic integrity adjudication from proctoring flags?
WCAG 2.1 AA Automated Content Checker
- Do you require automated content scanning for WCAG 2.1 AA issues before publishing course material?
- Should automated checks be paired with manual remediation workflows and remediation owners?
- Do you want reports tailored to roles (faculty, accessibility office, IT) with prioritized fix lists?
- What remediation SLA targets does your institution require for flagged accessibility issues?
- Will faculty training or in-platform guidance be required to reduce accessibility violations?
- Who will own final accessibility sign-off for pilot and production courses?
Engagement and Early-Alert Analytics Dashboard
- Which early-alert signals are highest priority (assignment missing, low activity, low video engagement, grade drop)?
- Who are the primary consumers of dashboards (advisors, faculty, retention teams, provost)?
- What cadence and delivery methods are required for alerts (real-time, daily digest, weekly report)?
- Do you need SIS-linked metrics (degree progress, enrollment status) included in alerts and dashboards?
- Are there export, API, or data-warehouse requirements for analytics and reporting?
- What thresholds or accuracy targets should analytics meet before being used in interventions?
-
Mutual Commit
Finalize commercial terms, SLAs for registration/finals, pilot acceptance criteria, data migration commitments, and governance cadence.
Agreement Modules
- Master Services Agreement (MSA)
- Statement of Work (SOW)
- Commercial Terms & Pricing Schedule
- Service Level Agreement (SLA)
- Pilot Acceptance Criteria & Sign-Off
- Acceptance Test Plan (Performance, Accessibility, Analytics)
- Data Migration Commitment & Plan
- Security, Privacy & Data Processing Agreement (DPA)
- Accessibility Remediation & Compliance Plan
- Integration & Third-Party Responsibilities
- Governance & Steering Cadence
- Change Order & Scope Management
- Termination, Data Return & Exit Plan
- Escrow & Business Continuity Addendum
- Payment Authorization / Billing Portal
-
Deployment
Operationalize rollout with readiness checks, enablement, and outcome validation.
-
Pre-Deployment Readiness
Verify SSO, SIS mappings, LTI credentials, data exports, accessibility remediation plan, and owners are ready for execution.
Readiness Questions
Quick Campus Snapshot
- Tell us the single sentence view of why you’re exploring a new LMS right now (what’s the trigger or deadline)?
- Which best describes your institution?
- Where is your LMS contract now?
- How many students and active courses will the new system need to support in your pilot and in production (give best estimates)?
- Who will be the primary sponsor for this selection (title / role)?
- Which of these timelines best matches your ideal decision window?
Are You Settling for ‘Good Enough’?
- If you had to name one way your current LMS is quietly undermining student or faculty success, what would it be?
- How often do faculty or students complain about LMS issues anecdotally versus opening formal tickets?
- When those problems occur, what is the most common emotional response from faculty or students (frustration, embarrassment, avoidance, resignation, other)?
- Can you share a specific recent story where the LMS failure had visible downstream consequences (e.g., missed grades, accreditation data gaps, enrollment impact)? If so, please describe.
- How long have these pain points been tolerated before someone decided to act?
When the System Breaks Under Pressure
- What patterns have you observed during peak events (registration, midterms, finals) that suggest the current platform won’t scale?
- Which of these failure modes have you experienced in the last 18 months?
- How do these failures translate into real institutional risk (lost tuition, delayed registrations, accreditation findings, staff overtime)?
- What peak-load SLA would you need to feel comfortable running registration or finals on a vendor platform?
- How often do you simulate or test peak load today, and who owns that exercise?
- If you had to quantify the last outage in terms of hours, people-hours or lost revenue, what’s your best estimate?
Who Really Decides (and Who’s Going to Stop It)?
- Who are the vote-writers and the veto-players in this selection (list roles and who influences them)?
- Which groups will demand a pilot with live courses before adoption?
- What governance constraints must the new LMS respect (faculty governance policies, procurement rules, collective bargaining, vendor review committees)?
- Are there known non-starters the vendor must accept (data residency, contract clauses, specific integrations, open-source preferences)?
- How would you describe the politics around this project—is it high-profile and visible, quietly pragmatic, or likely to be delayed by committee debate?
- Who needs to sign off before a pilot can begin, and what will satisfy them?
If Success Was Measured — What Would It Feel Like?
- If we measured the next 12 months as a success, which single metric would make you say “this was worth it”?
- For the metrics you care about, what are your current baselines (e.g., current percentage of accessible course pages, current D2L/Canvas downtime, average grade sync lag)?
- How will you validate pilot acceptance—what does a passing pilot look and feel like to faculty, students, and IT?
- Which SLA elements are critical for your institution (choose top three)?
- What would you be willing to trade (cost, timeline, customization) to guarantee those success metrics?
Your Integration and Data Reality
- If your SIS, authentication, publisher integrations and gradebook stopped talking for a week, what would break first and who would be most impacted?
- Which integrations are non-negotiable for Day 1 of a pilot?
- Describe the current state of your integration tech debt—do you have many custom adapters, brittle scripts, or a clean standards-based landscape?
- Who owns mapping decisions (course IDs, section codes, term keys) today and who would need training to accept new mapping behaviors?
- What export formats, frequency, and retention policies must the vendor support for your reporting and archival needs?
- What are your data quality pain points (missing student IDs, inconsistent course codes, timezone mismatches, duplicate records)?
Pilot, Migration & Risk Appetite
- If a pilot fails, what is the realistic consequence for the project—pause, restart, renegotiate, or abandon?
- How broad should a pilot be to convince stakeholders—single department, multi-department, campus-wide small cohort, or system-wide?
- What migration responsibilities do you expect the vendor to take on (full content migration, tool remapping, training, verification checks)?
- What rollback or contingency plan would make your team comfortable during cutover?
- Who will be the operational owners for pilot execution (names/titles) and how many full-time equivalents (FTEs) can you commit?
- What training cadence and change management support will faculty need to adopt the new workflows?
Accessibility & Compliance — Not Optional
- If an accessibility audit found systemic WCAG 2.1 AA gaps, how would the institution be expected to respond?
- Which accessibility requirements are must-haves for contract sign-off?
- Do you have institutional accessibility standards or a remediation SLA that vendors must follow? If yes, please describe or attach.
- How do you currently detect inaccessible content—automated scans, staff audits, or wait for student reports?
- Who in your organization signs off that course materials meet accessibility requirements (title/role)?
- How much of your course catalog currently meets your WCAG target (best estimate)?
Analytics, Reporting, and the Questions You Need Answered
- What are the top three questions your provost or retention office asks that your current LMS struggles to answer?
- Which analytics outputs are mission-critical (choose up to three)?
- How do you currently validate analytics accuracy—manual spot checks, cross-system reconciliation, or trust the vendor feed?
- Who needs access to which reports (advisors, deans, instructors, registrars, external accreditors)? Please map roles to report types if possible.
- How real-time do analytics need to be for your interventions to be effective?
- Are there specific compliance or audit-ready extracts you must produce on a schedule (e.g., FERPA, state reporting)? If yes, list them.
Next Steps — What Would Make This Feel Like Progress?
- What would count as a meaningful next milestone within 30 days to show momentum on this project?
- What is the single biggest blocker that, if removed, would accelerate your decision timeline?
- Who should be in the room for a technical discovery workshop (roles we should invite)?
- How would you prefer we demonstrate fit—sandbox with your course, live pilot, architecture review, or capacity proofing?
- Finally, what three things would make you feel confident we understand your institution’s reality and can design the right pilot?
-
Deployment Enablement
Coordinate the rollout schedule, assign owners, track integration tasks, and run the pilot execution with clear milestones.
-
Validation Checklist
Execute acceptance tests: performance under peak load, WCAG 2.1 AA verification, analytics accuracy, and pilot faculty/student feedback.
Validation Questions
Tell Us Who You Are (A Quick Start)
- Which role are you representing in this conversation?
- What is your decision timeline for an LMS change (best estimate)?
- What is the incumbent LMS contract renewal or deadline date we should know?
- Which single institutional priority is most driving this evaluation today?
- Are there governance or faculty-senate processes that typically slow or shape decisions here? If so, briefly describe.
Are You Settling for 'Good Enough'?
- What assumptions about your current LMS do you still hear people repeat—even though evidence shows they’re false?
- Which recurring issues have you tolerated rather than escalate—because they seemed too costly or political to fix?
- How frequently do you experience severe-site performance or availability problems (examples: registration window, finals week)?
- Which downstream consequences of those problems have had the biggest real-world impact?
- Tell us about one recent moment that made leadership publicly question the LMS—what happened and who reacted?
When the System Breaks — What Really Happens?
- If the LMS failed during a registration or finals peak today, describe the realistic chain reaction you worry about most.
- Which platform capabilities must stay up under peak load for the semester to be considered intact?
- What are your current peak-load metrics (concurrent users, peak requests/min, data throughput)?
- Have you performed formal load or chaos testing on the incumbent platform in the last 18 months?
- If an outage hit finals week, how would it affect graduation, accreditation evidence, or faculty evaluations in practice?
Faculty: Loved, Tolerated, or Ignored?
- If faculty could redesign the LMS from scratch, what would be the first three things they'd remove or demand change for—and why?
- How do faculty typically adopt or reject new tools here?
- Which faculty pain points do you hear about most often?
- Approximately how many faculty would you expect to actively pilot and provide structured feedback?
- How does Disability Services currently escalate accessibility issues (formal audits, ticketing, faculty training), and what’s the typical remediation timeline?
What Would Winning Look Like on Day One?
- If you had to show the provost three measurable wins after the first semester on the new LMS, what would those be?
- Which of the following outcomes are non-negotiable for you?
- What minimum SLA level would you require for registration and finals windows?
- Describe the pilot acceptance criteria that would give you confidence to expand beyond the pilot.
- Who must provide final sign-off on pilot success (role/title)?
The Tough Trade-Offs You're Avoiding
- Name one difficult trade-off your team has been deferring because the politics or risk feel too high.
- Which trade-offs worry you most when evaluating vendors?
- How do you expect migration responsibilities to be split (vendor vs institution)?
- What procurement, budget cycle, or legal constraints will shape whether this deal can close this year?
- If we proposed a phased rollout by college or department, what political or operational objections would surface?
Pilot Reality Check — Is It Real or a Demo?
- Is your pilot designed to surface real risk (live courses, real students, full integrations) or to highlight best-case functionality?
- Which integrations must be in the pilot to consider it valid?
- Which acceptance tests will you require during pilot?
- Who will coordinate day-to-day pilot operations (roles or teams)?
- How long must a pilot run to be meaningful in your context?
- How do you plan to gather qualitative feedback during the pilot (surveys, interviews, support logs)?
Commitment & Risk — Who's Owning What?
- If the pilot uncovers critical issues, who in your organization can pause rollout, demand remediation, or escalate contractually?
- What SLA remedies matter to you if agreed performance targets are missed?
- Which security, privacy, or compliance certifications must a vendor hold for you to proceed?
- What governance cadence would reassure you post-contract (weekly, biweekly, monthly, quarterly)?
- How will you measure vendor responsiveness and accountability during the pilot?
Final Steps That Make a Decision Real
- If we left this meeting with no clear next step, what is the likeliest barrier that would stop momentum?
- What specific deliverables in the next 30 days would make you feel progress is real (e.g., pilot SOW, acceptance test plan, cost model)?
- Who must approve commercial terms and by what target date (role and date)?
- Are there other vendors you are actively benchmarking and, if so, what is their perceived strength?
- Would you like us to provide a tailored acceptance-test checklist and a draft pilot SOW within two weeks?
- What would make pilot success feel low-risk to the faculty senate, provost, and IT—pick the top two things you believe would move them?
-
-
Success
Confirm outcomes against success signals, capture learnings, and maintain a shared channel for issues and enhancements.
Success Reviews
- Success Validation Review
- Lessons Learned & Root Cause Retrospective
- Operational Handover & Shared Channel Setup
- Enhancement Prioritization & Roadmap Workshop
- Executive Outcomes & Renewal Planning
Issues & Enhancements
- Document any procurement or budget actions required for roadmap delivery.
- Update operational runbooks and deployment checklists based on retro findings.
- Schedule a 30/60/90-day follow-up review to confirm improvements are delivering.
- Establish a permanent shared communication channel with access and usage rules.
- Set and document escalation paths and SLA targets for operational incidents.
- Confirm monitoring, alerting, and runbooks are in place and accessible to owners.
- Obtain signoff on operational readiness and schedule the governance cadence.
- Confirm Operational Owners & Roles
- Create the agreed shared channel, configure integrations (alerting, ticketing), and invite stakeholders.
- Publish the escalation matrix and SLA targets to the channel and runbook repository.
- Implement or tune alerts and ensure runbooks are linked to common incident types.
- Schedule the first governance cadence meeting and circulate the agenda.
- Reconfirm Prioritization Criteria
- Produce a prioritized roadmap mapping fixes/enhancements to success signals and outcomes.
- Commit owners and realistic timelines for near-term releases and pilot extensions.
- Agree on criteria for measuring success of each roadmap item post-release.
- One-sentence Current State
- Publish the agreed roadmap with owners, estimates, and target releases.
- Create feature/engineering tickets and link acceptance criteria that map to success signals.
- Schedule required pilot extensions and faculty testing windows for items that need classroom validation.
- Initiate procurement/budget requests for items requiring additional funding.
- One-sentence Current vs Future State (Executive)
- Secure executive alignment on whether outcomes meet institutional expectations.
- Obtain a decision or clear timeline for renewal/expansion procurement actions.
- Agree on executive-level mitigation commitments and reporting cadence for residual risks.
- Ensure procurement and legal have the necessary evidence package to proceed with contract actions.
- Deliver an executive summary and evidence packet to procurement and governance for contract decision.
- If renewal/expansion approved, draft an agreed timeline and assign commercial owners to finalize terms.
- If conditional renewal, document required remediations and deadlines tied to contractual contingencies.
- Publish the executive decisions and update the shared channel with next-step owners and dates.
- Validate whether each success signal meets the agreed acceptance criteria.
- Document any gaps with quantified impact and risk level.
- Obtain an explicit acceptance decision or a committed remediation plan and owner for each failing item.
- Create a short list of immediate next steps and communication for governance sign-off.
- Produce a packaged evidence bundle (reports, logs, dashboards) and distribute to governance for sign-off.
- Open prioritized remediation tickets for any unmet signals with owners and target dates.
- Schedule follow-up validation checkpoints for remediated items.
- Draft and circulate the official acceptance/exception statement for signatures.
- Set the Stage & Blameless Ground Rules
- Document a clear set of root causes for the highest-impact issues.
- Produce a prioritized list of remedial and systemic improvements mapped to success signals.
- Assign owners and realistic timelines for each prioritized improvement.
- Capture repeatable practices that led to successes to bake into future rollouts.
- Publish the RCA document and link remediation tickets to each root cause.
- Create a prioritized improvement backlog with owners, estimates, and target dates.
- One-sentence Future State for Operations
- Timeline Review of Key Events
- Review Backlog Items from Validation & RCA
- Key Metrics & ROI Summary
- Consequence Recap
- What Went Well
- Shared Channel Design & Access (Slack/Teams/Jira)
- Success Signal Matrix Review
- Residual Risks & Mitigation Commitments
- Map Items to Success Signals & Outcomes
- Escalation Matrix & SLA Targets
- Commercial Implications & Renewal Options
- Estimate Effort & Propose Timeframes
- Evidence Walkthrough — Accessibility (WCAG 2.1 AA)
- What Didn’t Go Well