{"resourceId":"rand-edtech-accountability-alignment-20260930","versions":[{"version":"external-0726fc34265d9c2b44c8b7043eab0283a80a366c4f7fe02b65347382efc22190","resource":{"id":"rand-edtech-accountability-alignment-20260930","title":"RAND (IES-sponsored): Accountability and alignment more than doubled Zearn Math usage goals, with teacher trade-offs","organization":"RAND Corporation","sector":"K-12 education research","geography":"United States (large urban district case)","publishedAt":"September 30, 2026","publicationDate":"2026-09-30","eventDate":"2026-09-30","sourceName":"RAND research report RRA5192-1","sourceLabel":"RAND edtech implementation report","sourceUrl":"https://www.rand.org/pubs/research_reports/RRA5192-1.html","evidenceClass":"independent-research","outcomeClass":"mixed","topics":["operating-model","accessibility-workforce","knowledge-work","governance-procurement"],"finding":"Same-day RAND report (Todd & Huguet; IES-sponsored) examines how one large urban district raised Zearn Math usage over two years inside a 32-school RCT context. In year one, fewer than one in five students met the platform's annual lesson goal; in year two about half did. Six case-study schools (126 interviews over two years) credit a package of accountability strategies (clearer expectations, centralized monitoring, incentives) and alignment strategies (curriculum fit with Eureka, dedicated schedule time, fewer competing tools, expanded professional learning). Authors stress trade-offs: some teachers found clearer structure helpful, while others reported stress, worry about consequences for missing targets, or concern that platform time displaced other valued activities. This report analyzes implementation/usage, not student achievement (achievement covered in a separate Pane et al. paper).","sledRelevance":"Preferred-domain, same-day evidence that edtech (and by transfer, AI tools) scale through accountability-plus-alignment packages, and that usage gains can carry workload and opportunity-cost trade-offs without proving durable learning by themselves.","evidence":"Qualitative case studies nested in a larger RCT (32 schools); 126 interviews; platform usage metrics; not a generative-AI causal study.","architectureImplications":"Schedule-integrated usage windows, curriculum alignment, and reduced tool sprawl matter more than optional add-on access for sustained platform use.","governanceImplications":"Central expectations and monitoring raise usage but need guardrails against punitive target culture; preserve school-level judgment within district guidance.","securityPrivacyImplications":"Centralized usage monitoring creates student/teacher activity data that needs privacy-aware retention and purpose limits, even for non-generative platforms.","caveats":"Single large urban district; six case-study schools not statistically generalizable; self-reported interviews; Zearn Math is adaptive math software, not generative AI; usage gains are not achievement claims in this paper.","streamIds":["k12"],"roles":{"sales":"Sales framing: RAND's 30 Sep report shows a district more than doubling the share of students hitting Zearn usage goals only after expectations, monitoring, incentives, schedule time, and curriculum alignment moved together. Transfer the lesson to AI pilots: do not sell optional chatbot access as implementation. Also surface teacher stress and displacement trade-offs. This paper measures usage, not generative-AI learning gains.","engineering":"Engineering framing: Instrument AI/edtech pilots for scheduled use blocks, curriculum-linked assignments, and monitoring that distinguishes required practice from vanity logins. Avoid stacking competing tools. Keep incentives from becoming high-stakes surveillance. Interpretation of Zearn implementation research applied cautiously to generative tools with different risk profiles.","delivery":"Delivery framing: Year-one optional use failed; year-two packaged accountability and alignment raised usage and created trade-offs. Plan PD, bell-schedule slots, and competing-tool sunsets before scaling an AI or edtech product. Brief boards that higher usage is an intermediate metric, not proof of retained learning. Interpretation for SLED implementation leads."},"roleDetails":{"sales":{"customerProblem":"Districts buy edtech/AI tools that stay optional and underused, then lack honest language about the teacher costs of forcing usage up.","stakeholders":["superintendent","curriculum","principals","teachers","evaluation","board"],"discoveryQuestions":["Is the tool scheduled, or only encouraged?","How does it align to the core curriculum, not as an extra?","What monitoring and incentives are planned, and what are the teacher stress risks?","Which competing tools will be retired?"],"valueHypothesis":"If districts combine clear expectations, schedule time, curriculum alignment, and PD, usage can rise enough to make outcome evaluation possible, provided trade-offs are managed.","potentialEngagement":"Implementation design sprint mapping accountability/alignment package and trade-off metrics before renewal.","unsupportedClaims":["That usage doubling equals achievement gains in this report","That findings automatically transfer to generative AI chatbots","Guaranteed teacher workload reduction"]},"engineering":{"fit":"Useful for districts implementing supplemental platforms or AI tutors that need sustained, curriculum-aligned use.","architectureIntegration":"Embed in LMS/schedule; sync with core curriculum units; centralize usage dashboards with school-level nuance.","prerequisites":["core curriculum mapping","bell-schedule authority","PD capacity","tool consolidation plan"],"constraints":["single-district evidence","incentive funding sources","risk of punitive monitoring"],"security":"Limit monitoring data to educational purposes; control vendor access to classroom usage traces.","proofOfValue":["Usage goals tied to scheduled blocks","Documented curriculum alignment","Teacher feedback loop on displacement/stress"]},"delivery":{"work":"Clarify expectations, schedule dedicated time, align to core curriculum, reduce competing tools, expand PD, monitor usage and trade-offs.","dependencies":["principal schedule control","curriculum specialists","PD providers","possible incentive budget"],"ownership":"Curriculum/instruction owns alignment; principals own schedule fidelity; district analytics owns monitoring ethics.","skillsAdoption":"Coach teachers on integrating platform/AI practice into core lessons, not as spare-moment filler.","governanceCheckpoints":["expectation memo","schedule audit","midyear teacher stress/displacement survey","renewal review"],"acceptanceCriteria":["Usage targets defined with scheduled time","Competing-tool list reduced","Trade-off metrics collected alongside usage"],"risks":["Punitive target culture","Usage theater without learning measures","Displacement of higher-value instruction"]}},"retrievedAt":"2026-09-30T22:05:40-05:00","enrichedAt":"2026-09-30T22:12:00-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Expanded PD and clearer expectations can help uneven teacher capacity, but rigid targets may stress staff and compress time for other supports.","procurementImplications":"Budget for PD, coaching, and possible incentive costs alongside licenses; require implementation plans, not seat counts alone.","operatingModelImplications":"Treat edtech/AI as scheduled instructional infrastructure with accountability and alignment, not optional apps.","sourceVerification":{"openedUrl":"https://www.rand.org/pubs/research_reports/RRA5192-1.html","referenceExcerpt":"In the first year, fewer than one in five students met the platform's annual lesson goal.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}