From the K–12 edition of October 4, 2026
OECD PISA 2025 Insights: students who use AI chatbots for schoolwork score lower in science on average, with moderate learning use and AI-evaluation teaching the exceptions
OECD Programme for International Student Assessment (PISA); Insights and Interpretations by Andreas Schleicher · K-12 secondary (15-year-olds) / international large-scale assessment · International (91 countries and economies, OECD average); United States included with OECD caution flag on questionnaire results
- Publisher
- OECD
- Original publication
- 2026-09-08
- Source retrieved
- 2026-10-05
What happened
PISA 2025 (760,000+ 15-year-olds, 91 systems) asked for the first time how often students use AI chatbots to summarise texts, do preliminary research, draft writing and help them learn. Across the OECD, students who do not use AI for summarising, research or drafting outperform users by around 20 science points, which the OECD equates to roughly a year of schooling; gaps reach 29 (Canada) and 36 (New Zealand) points for regular drafting. Weekly use 'to help me learn' performs similarly to non-use. Frequent learning users who are taught at school to assess AI output score slightly higher, but disadvantaged students are less likely to get that teaching. The OECD stresses the data are not causal and advises caution until stronger evidence exists.
Why it matters
This is the first global, representative dataset tying student chatbot use for schoolwork to measured achievement. It gives K-12 boards an evidence anchor for the assisted-output versus retained-learning distinction, and it is newly relevant because the 1 Oct WSJ investigation of Google classroom AI pulled these PISA findings into the U.S. district debate while the K-12 archive had no record of them.
Evidence and measured results
Cross-sectional international assessment with student questionnaire index (AIUSESCH, four chatbot-use items) and science scores; some estimates adjusted for socio-economic status (Table I.B1.4.61). System-level scatter R-squared 0.16. Correlational only; OECD names reverse causation (struggling students relying on AI) as a plausible explanation. U.S. estimates flagged for unmet sampling standards and particular caution on questionnaire results.
Limitations and uncertainty
Correlational, not causal; self-reported AI use; OECD-average figures mask reversals (Thailand and Macao drafting users scored higher). U.S. questionnaire results carry an OECD caution flag. Insights document is interpretive commentary summarising Volume I tables; full chapter pages returned HTTP 403 to the research client and were not inspected.
Put this evidence to work
Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-10-04; this does not change the original publication date. Each role follows the same checklist so takeaways compare across sources.
Sales
Role takeaway
- Customer problem
- Boards face pressure to adopt or ban student chatbots without data on which uses relate to learning; PISA links drafting and summarising use to lower science scores.
- Stakeholders
- superintendent
- chief academic officer
- assessment and accountability
- board
- curriculum leads
- equity office
- Discovery questions
- Which student AI use types are currently allowed, by grade?
- Do students receive explicit instruction in checking AI output?
- Is that instruction equally available in high-poverty schools?
- What local achievement data could separate use types?
- Value hypothesis
- A use-type policy plus AI-evaluation instruction lets a district keep purposeful learning uses PISA associates with neutral or slightly positive scores while limiting the drafting uses associated with lower scores.
- Potential engagement
- Four-week AI-use-type policy and measurement review: inventory allowed modes, draft grade-band rules, design a local outcome comparison with socio-economic controls.
- Unsupported claims
- That chatbot use causes lower science scores
- That any vendor tool improves PISA-type outcomes
- That OECD averages predict a specific U.S. district's results
Pre-sales engineering
Role takeaway
- Fit
- Relevant to configuring student-facing AI: evidence favours learning-support modes over draft or summary generation.
- Architecture and integration
- Mode-level controls and logging in the student AI tool, exported to the district data warehouse alongside assessment results and socio-economic indicators.
- Prerequisites
- tool supports mode or feature restrictions
- use logs exportable by student
- assessment linkage approved by data governance
- Constraints
- PISA is correlational and self-reported
- U.S. questionnaire results carry OECD caution flag
- country averages mask reversals
- Security
- Use logs are student records; limit retention, restrict access to research and instructional staff, and exclude prompts from vendor training.
- Proof of value
- Compare achievement by AI use type with socio-economic controls
- Test whether AI-evaluation lessons change source-checking behaviour
- Check equity of access to AI-evaluation instruction
Delivery
Role takeaway
- Work
- Adopt grade-band AI use-type rules and an AI-output evaluation curriculum, then monitor outcomes by use type.
- Dependencies
- board policy revision
- teacher PD on assessing AI output
- tool configuration by IT
- assessment office analysis capacity
- Ownership
- Chief academic officer owns use-type policy and curriculum; assessment office owns outcome monitoring; IT owns tool configuration.
- Skills and adoption
- Teachers need to teach students to verify AI-generated information and to design tasks where drafting by AI is not the default.
- Governance checkpoints
- use-type policy approval
- mid-year equity check on AI-evaluation instruction
- end-of-year outcome review by use type
- Acceptance criteria
- Proposed: every secondary school delivers documented AI-output evaluation lessons
- Proposed: local analysis reports achievement by use type with controls
- Proposed: no expansion of drafting modes without local evidence
- Risks
- over-reading correlational data as causal
- widening divide if AI-evaluation teaching reaches advantaged schools first
- blanket bans removing neutral learning uses
Implementation considerations
Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.
Architecture and integration
What must connect, and where does the AI sit in the workflow?
General-purpose chatbots used for drafting and summarising are the configurations associated with the largest gaps, while purposeful learning use is not. Districts weighing student-facing tools should favour designs that require student reasoning and output checking over answer or draft generation, and should log use type, not just minutes.
Governance
Who approves, reviews and stays accountable for outcomes?
Supports policy that distinguishes AI use types (drafting versus help-to-learn) and requires explicit instruction in assessing AI-generated information. The OECD calls for guidelines on pedagogical value, age-appropriateness, integrity, privacy, transparency and bias, plus sustained teacher training.
Security and privacy
What data, permissions and controls need testing?
PISA does not measure privacy or data exposure. It names data privacy as one area guidelines must cover; no tool-level privacy evidence is provided.
Accessibility and workforce
Who is affected, and what skills or accommodations follow?
PISA flags a potential AI divide: disadvantaged students are less likely to be taught to assess AI-generated information, so access-only rollouts may widen gaps.
Procurement
What should contracts, pricing and exit terms secure?
RFPs should require mode-level controls and use-type logging so districts can restrict draft generation and measure outcomes, rather than buying undifferentiated chatbot access.
Operating model
Which teams own the service once it runs?
Operate student AI as a governed set of permitted uses tied to instruction in evaluating AI output, reviewed against local outcomes, not as a single on/off switch.
Publication history
- 2026-10-04K–12 · Issue 283 resources
Stable resource ID: oecd-pisa-2025-ai-chatbot-use-science-20260908