{"resourceId":"mdpi-nigeria-teacher-guided-copilot-tutoring-rct-reanalysis-0-31sd-digital-equity-20261023","versions":[{"version":"external-42c0912624077de0d12f6c84400bb4f17d84842d6bb4c8a8c7ef8b3251ad5a06","resource":{"id":"mdpi-nigeria-teacher-guided-copilot-tutoring-rct-reanalysis-0-31sd-digital-equity-20261023","title":"Education Sciences reanalysis of a Nigerian secondary-school RCT: six weeks of teacher-guided Copilot tutoring raised overall assessment scores 0.31 SD, but AI's own contribution cannot be isolated","organization":"Universidad Peruana de Ciencias Aplicadas, Universidad Autónoma del Perú and co-authors; reanalysis of World Bank trial data (De Simone et al.)","sector":"K-12 (upper secondary) generative AI tutoring: English learning, AI knowledge and digital equity","geography":"Benin City, Edo State, Nigeria (nine public secondary schools)","publishedAt":"Published 23 October 2026 (Education Sciences 16(11), 1780; received 15 Sept, accepted 20 Oct 2026)","publicationDate":"2026-10-23","eventDate":null,"sourceName":"Education Sciences (MDPI)","sourceLabel":"Peer-reviewed journal article (secondary analysis of a randomized trial)","sourceUrl":"https://www.mdpi.com/2227-7102/16/11/1780","evidenceClass":"academic-research","outcomeClass":"effective","topics":["knowledge-work","accessibility-workforce","infrastructure","operating-model"],"finding":"Using the World Bank's public replication package, the authors re-estimated a trial in which 1,328 interested first-year upper-secondary students were randomized; 657 were offered twelve 90-minute after-school sessions over six weeks (June-July 2024) combining Microsoft Copilot, curriculum-aligned English activities, pair work and teacher guidance, while 671 received regular instruction. Intention-to-treat effects were 0.310 SD on the overall assessment (95% CI 0.176-0.444; n=654), 0.238 SD in English, 0.309 SD in AI knowledge and 0.206 SD on the regular third-term school English exam; digital skills (0.139 SD) was imprecise. Effects were larger for female students and higher prior achievers. The digital-access interaction was negative but imprecise (-0.182 SD). Assessments were observed for 64.2% of treated versus 50.2% of control students; inverse-probability weighting gave 0.298 SD, and excluding one large school lowered the estimate to 0.173 SD.","sledRelevance":"Why now: published this week and not in the archive, it is an independent reanalysis that complements archived cautionary evidence (homework-outsourcing learning penalty, sparse Khanmigo engagement). It supports a structured, teacher-guided package rather than open access. Transferability to U.S. districts is limited: Nigerian urban schools, volunteer students, after-school setting, older Copilot version and short follow-up.","evidence":"Randomized trial, secondary analysis; OLS with school fixed effects, baseline adjustment and HC3 errors; IPW, 2,000-permutation inference and leave-one-school-out checks. The authors corrected a coding error in the original internet-access variable. Limitations: differential attrition, no AI-free tutoring arm, no persistence data, no cost data, no multiple-comparison adjustment.","architectureImplications":"Delivered in school computer labs with routers and mobile signal; power and internet disruptions occurred but bandwidth was not measured. The authors argue low-connectivity designs (offline content, small payloads) need separate testing.","governanceImplications":"The authors recommend defining curriculum goals and tutor behavior guidelines before choosing a model, logging incidents and model versions, and negotiating data protection and continuity if licenses or models change.","securityPrivacyImplications":"Student accounts on a commercial model raise age, consent, storage and jurisdiction questions; the article notes model behavior can change without notice. No privacy incidents are reported.","caveats":"Effect is for the complete package (extra time, curriculum, pair work, teacher guidance); AI's independent contribution is not identified. Endline observed for only 759 of 1,328 students with differential attrition. Interested volunteers, 79% female sample, six-week horizon, urban schools with labs. Secondary analysis by authors not involved in the original trial; the original World Bank working paper was not opened here.","streamIds":["k12"],"roles":{"sales":"The framing point is that structure, not access, carries the result. A six-week teacher-guided Copilot package in Nigerian secondary schools raised assessment scores by about 0.31 SD, but the AI's own contribution was not isolated. For U.S. districts, a bounded offer is designing a structured AI tutoring pilot with curriculum-aligned prompts, teacher facilitation and independent measurement. The evidence cannot support claims that any AI tool alone raises achievement, that gains persist, or that costs are lower.","engineering":"The fit is a supervised, curriculum-scripted tutoring workflow on managed devices. Students worked in pairs in school labs, with teachers circulating to catch hallucinations and dependency. Interpretation: an equivalent design would pin model versions, preload curriculum prompts and log sessions. Constraints include connectivity and device access, which the study did not measure precisely. Proof of value should include an AI-free tutoring comparison arm, since the study could not separate AI from extra time and pair work.","delivery":"Delivery work is building the full package: curriculum materials, teacher facilitation training, attendance tracking and independent assessment. The curriculum office should own it, with technology staff supporting labs. Interpretation: acceptance criteria could include attendance targets, an independent endline test and attrition balanced across arms. Risks include widening gaps, since higher prior achievers gained more, uneven attendance, and model changes mid-pilot."},"roleDetails":{"sales":{"customerProblem":"Districts want evidence that generative AI tutoring improves learning, while archived studies warn that unstructured use can harm it.","stakeholders":["Curriculum and instruction leaders","Teachers who would facilitate sessions","Research and assessment office","Technology department","Families of participating students"],"discoveryQuestions":["Would a pilot include an AI-free tutoring comparison?","What curriculum-aligned materials and prompts exist?","Who facilitates sessions, and with what training?","How will attendance and attrition be tracked?","Which independent assessment will measure outcomes?"],"valueHypothesis":"A structured, teacher-guided AI tutoring pilot with independent measurement could show whether gains like those in Nigeria transfer locally; this is a hypothesis.","potentialEngagement":"A bounded pilot design engagement: package design, comparison-arm setup and evaluation plan for one subject and grade.","unsupportedClaims":["That AI alone caused the 0.31 SD gain","That gains persist beyond six weeks","Cost-effectiveness","That results transfer directly to U.S. classrooms"]},"engineering":{"fit":"Supervised, curriculum-scripted AI tutoring on school-managed devices with session logging.","architectureIntegration":"Interpretation: deploy an approved model with pinned versions, preloaded prompts and logs linked to attendance records.","prerequisites":["Approved AI tool with student accounts","Lab or device access","Curriculum-aligned prompt library","Logging and attendance capture"],"constraints":["Connectivity and power reliability","Age and consent rules for student accounts","Model version changes"],"security":"Minimize student data in prompts; document data storage and jurisdiction; log incidents.","proofOfValue":["Run an AI-free tutoring comparison arm","Track attrition by arm","Measure outcomes on an independent test, not only program-aligned items"]},"delivery":{"work":"Build and run a structured tutoring package with facilitation, materials, attendance tracking and independent evaluation.","dependencies":["Teacher facilitator capacity","Device and network readiness","Evaluation partner"],"ownership":"Curriculum and instruction office with the research office.","skillsAdoption":"Teachers need training in facilitation, verification of AI output and spotting dependency.","governanceCheckpoints":["Privacy review of the AI tool","Mid-pilot attendance and attrition review","Independent evaluation sign-off"],"acceptanceCriteria":["Attendance target set and tracked","Attrition balanced across arms within a set margin","Independent endline assessment completed"],"risks":["Widening achievement gaps","Differential attrition biasing results","Model behavior changes mid-pilot"]}},"retrievedAt":"2026-10-26T22:02:42-05:00","enrichedAt":"2026-10-26T22:06:56-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Larger effects for higher prior achievers raise gap-widening risk; the digital-access interaction is imprecise. Teacher supervision time is not free, the authors note.","procurementImplications":"The authors caution that pilots may rely on free licenses or sunk costs and that total cost must include electricity, routers, equipment, moderation, data protection and support.","operatingModelImplications":"Teachers acted as facilitators rather than delivering a second lesson; pair work and supervision were core to the package.","sourceVerification":{"openedUrl":"https://www.mdpi.com/2227-7102/16/11/1780","referenceExcerpt":"These findings support short-term learning gains from the complete tutoring package relative to regular instruction.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}