{"resourceId":"stanford-scale-evidence-base-ai-k12-november-review-52-causal-studies-20261110","versions":[{"version":"external-62cf11f5355e81fd53bd6073fe3926046d49bbd2f5594b722ffedc330a4aba5d","resource":{"id":"stanford-scale-evidence-base-ai-k12-november-review-52-causal-studies-20261110","title":"Stanford SCALE AI Hub for Education: The Evidence Base on AI in K-12, a November 2026 review of 52 causal studies","organization":"Stanford University SCALE Initiative, AI Hub for Education","sector":"K-12 education","geography":"United States and international studies","publishedAt":"2026-11-10","publicationDate":"2026-11-10","eventDate":null,"sourceName":"Stanford SCALE Initiative","sourceLabel":"Stanford SCALE Initiative (university research center)","sourceUrl":"https://scale.stanford.edu/ai/evidence-base-review/evidence-base-ai-k12-november-review","evidenceClass":"academic-research","outcomeClass":"mixed","topics":["knowledge-work","operating-model","accessibility-workforce"],"finding":"An update to the March 2026 review adds 32 strong causal papers published October 2025 to June 2026, for 52 in total. Reviewers conclude AI is more likely to support learning when students use it to understand material than to produce work, but neither use consistently improves learning, and offloading tasks can reduce learning. AI can improve learning experience and confidence without improving outcomes, and teacher-facing AI can cut planning time or raise feedback quality but one new study found it reduced student motivation and confidence.","sledRelevance":"Gives K-12 districts a current, independent synthesis for deciding where to allow student-facing AI and where to prefer educator-facing, structured uses. It supports requiring learning-support design rather than open-ended answer generation, and measuring outcomes instead of satisfaction.","evidence":"Review of randomized controlled trials and quasi-experimental studies drawn mainly from arXiv preprints in the AI Hub Research Repository. Of 868 papers added in the review period, 201 were RCTs or QEDs, 97 advanced to human review and 32 met the strong-causal standard (28 student-facing, 4 educator-facing). Five new student-facing studies were in U.S. K-12 settings. A language model did preliminary screening before Stanford researchers reviewed prioritized papers against a codebook based on What Works Clearinghouse standards.","architectureImplications":"Tool behavior matters more than hosting model: coaching, adaptive sequencing and tool-use guidance show promise, so districts should prefer configurable tools that can restrict answer-giving and expose usage logs, and should not assume education-specific tools beat general chatbots.","governanceImplications":"Supports use-case-level policy that distinguishes learning support from work production, requires outcome evidence in procurement, and sets teacher guidance on when AI feedback or planning help is appropriate.","securityPrivacyImplications":"The review does not evaluate data privacy or security; privacy, student-data and safety controls must be assessed separately from efficacy evidence.","caveats":"The authors say findings should not be treated as broadly generalizable across U.S. K-12 settings; the U.S. K-12 share of studies is limited. Many sources are non-peer-reviewed preprints, the repository is arXiv-weighted so relevant journal studies may be missed, and LLM-assisted screening may have excluded relevant studies. Some included studies involve undergraduates or adults rather than school-age students. This is a secondary synthesis; effect sizes are not pooled.","streamIds":["k12"],"roles":{"sales":"Lead with the review's central message: outcomes depend on how AI is designed and used, not on access. For K-12 prospects this reframes a tool purchase into a learning-support and teacher-practice conversation. Use it to ask districts which student uses they actually want, how they would tell learning from completed work, and what evidence they require from vendors. Avoid promising achievement gains; the review shows inconsistent effects, and few studies are U.S. K-12. Position bounded, measured pilots and governance support as the credible offer.","engineering":"Treat this as a requirements source for configurable pedagogy. Favor tools that can be set to coach rather than answer, sequence practice adaptively, and log usage so districts can see whether students engage with support. Test whether a general-purpose chatbot with controls performs differently from an education-specific tool, since the review says purpose-built tools do not always win. Identity, rostering and logging must be in place to measure use. Efficacy evidence here says nothing about data protection, so security review stays separate.","delivery":"Plan pilots around use-case definitions, teacher guidance and outcome measurement rather than licence rollout. Define which tasks are learning support versus work production, train teachers on feedback and planning uses, and agree outcome measures beyond satisfaction before launch. Include a checkpoint for student motivation and confidence, because one included study found teacher-facing AI lowered them. Treat the review as early evidence: set expectations that results may be null or mixed."},"roleDetails":{"sales":{"customerProblem":"District leaders must decide which AI uses to allow for students and teachers with sparse, mixed, mostly non-U.S. causal evidence.","stakeholders":["Superintendent and cabinet","Chief academic officer","Chief technology officer","Curriculum and instruction leads","Teacher union or professional learning leads"],"discoveryQuestions":["Which student uses are permitted today: explanation and practice support, or producing finished work?","What outcome measures beyond satisfaction would you require before scaling a tool?","Where have teachers used AI for planning or feedback, and has student motivation been checked?"],"valueHypothesis":"A scoped use-case policy and measured pilot can help a district avoid uses the review links to reduced learning while keeping learning-support and teacher-feedback uses.","potentialEngagement":"Bounded AI use-case and evidence review workshop for one district, ending with a pilot measurement plan.","unsupportedClaims":["Guaranteed achievement gains","That education-specific tools outperform general chatbots","That results from non-U.S. or undergraduate samples will hold in a given U.S. district"]},"engineering":{"fit":"Relevant to any district evaluating student-facing or teacher-facing generative AI; most useful for configuration and measurement requirements.","architectureIntegration":"Require controls to constrain answer-giving, adaptive sequencing, and exportable usage logs integrated with the learning platform and rostering.","prerequisites":["Rostering and SSO","Usage logging and export","Baseline assessment data","Defined use cases by grade band"],"constraints":["Evidence is mostly preprints and heavily non-U.S.","Studies vary in tool design so findings are not tool-specific","Includes some postsecondary populations"],"security":"The review does not address privacy or security; run separate data-protection, vendor and safety review before any pilot.","proofOfValue":["Compare a coaching configuration with an answer-giving configuration on a delayed unaided assessment","Track engagement with support features","Collect student motivation and confidence measures"]},"delivery":{"work":"Run a pilot built around defined learning-support uses, teacher guidance and a pre-agreed measurement plan.","dependencies":["Policy decision on permitted uses","Baseline and delayed assessments","Teacher time for training"],"ownership":"District curriculum and instruction lead with technology office support.","skillsAdoption":"Teachers need practical guidance on when AI feedback or planning help fits and how to keep students doing the thinking.","governanceCheckpoints":["Use-case approval before launch","Mid-pilot check of student motivation and confidence","End-pilot review of delayed outcomes before scaling"],"acceptanceCriteria":["Proposed: delayed unaided assessment shows no decline versus comparison group","Proposed: at least an agreed share of teachers complete guidance training","Proposed: usage logs reviewed on an agreed cadence"],"risks":["Positive satisfaction mistaken for learning","Over-generalizing from non-U.S. or adult studies","Teacher-facing tool unintentionally lowering student motivation"]}},"retrievedAt":"2026-11-10T21:59:46-06:00","enrichedAt":"2026-11-10T21:59:46-06:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"The review links effects to how educators use AI and what tasks they use it for; teacher training and judgment are central, and one study found lower-performing teachers' students lost achievement with a broad support chatbot.","procurementImplications":"Ask vendors for independent outcome evidence on delayed or unaided measures, configurability of coaching versus answer modes, and usage reporting, rather than relying on satisfaction data.","operatingModelImplications":"District leaders should assign ownership for use-case policy, measurement and teacher guidance before expanding access.","peerReview":"unknown","sourceVerification":{"openedUrl":"https://scale.stanford.edu/ai/evidence-base-review/evidence-base-ai-k12-november-review","referenceExcerpt":"Using AI to offload academic tasks can reduce student learning.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}