{"resourceId":"apa-edtech-learning-evidence","versions":[{"version":"legacy/2026-09-03/apa-edtech-learning-evidence","resource":{"id":"apa-edtech-learning-evidence","title":"APA expert report warns schools not to confuse engagement or AI-assisted performance with learning","organization":"American Psychological Association","sector":"K-12 education and educational technology","geography":"United States with broadly transferable evidence","publishedAt":"September 3, 2026","sourceName":"Children's and adolescents' learning with educational technology","sourceLabel":"APA expert report","sourceUrl":"https://www.apa.org/pubs/reports/children-adolescent-learning-educational-technology","evidenceClass":"standards-guidance","outcomeClass":"cautionary","topics":["knowledge-work","data-security","governance-procurement","accessibility-workforce","operating-model"],"finding":"APA released ten research-based recommendations for educational technology decisions affecting learners ages 5 to 18. The report distinguishes visible engagement, immediate performance, and durable learning, warning that generative AI may improve the work a student produces while reducing independent knowledge and skill. It recommends testing transfer beyond the application, preserving meaningful adult involvement, and scrutinizing features optimized to hold attention.","sledRelevance":"School systems increasingly receive adoption dashboards, usage counts, completion rates, satisfaction scores, and vendor-reported output quality as proof of success. The report gives districts a clearer evidentiary boundary: those metrics can describe exposure or experience, but they do not establish retained learning, independent capability, equity, or developmental benefit.","evidence":"The report was produced by an APA multidisciplinary expert panel and synthesizes learning-science evidence across apps, games, intelligent tutoring, generative AI, and digital platforms. It is normative expert guidance rather than a new experiment or a product-by-product effectiveness review. APA does not recommend treating all screen time or all educational technology as equivalent.","architectureImplications":"Learning systems should capture more than clicks and time on task. Instrument preconditions, hints, revisions, explanations, independent post-use performance, transfer to novel tasks, accessibility, and what human interaction the tool displaces. AI tutors should be designed to elicit reasoning and provide educators with interpretable evidence, not maximize conversation length or produce finished answers.","governanceImplications":"Require efficacy claims to identify population, learning objective, comparison condition, duration, independent outcome measure, and transfer test. Pilot before scaling; include educators, families, students, accessibility experts, and learning scientists; and contract for evidence access and model-change notification. Do not use engagement, satisfaction, or AI-assisted grades alone as renewal criteria.","securityPrivacyImplications":"Minimize student data, prohibit secondary advertising and unapproved model training, bound retention, and test whether personalization or engagement features create manipulation, profiling, or unequal treatment. Accessibility accommodations should be evaluated for both learning benefit and the privacy cost of collecting disability-related or behavioral data.","caveats":"This is expert guidance, not a quantified meta-analysis in the public summary and not evidence that every AI or EdTech product harms learning. The public materials do not enumerate the number of studies reviewed or estimate effect sizes. Individual tools and pedagogical designs may produce different results, so the recommendations should guide evaluation rather than substitute for it."}},{"version":"enrichment/2026-09-05T02:42:45.193Z/apa-edtech-learning-evidence","resource":{"id":"apa-edtech-learning-evidence","title":"APA expert report warns schools not to confuse engagement or AI-assisted performance with learning","organization":"American Psychological Association","sector":"K-12 education and educational technology","geography":"United States with broadly transferable evidence","publishedAt":"September 3, 2026","publicationDate":"2026-09-03","eventDate":null,"sourceName":"Children's and adolescents' learning with educational technology","sourceLabel":"APA expert report","sourceUrl":"https://www.apa.org/pubs/reports/children-adolescent-learning-educational-technology","evidenceClass":"standards-guidance","outcomeClass":"cautionary","topics":["knowledge-work","data-security","governance-procurement","accessibility-workforce","operating-model"],"finding":"APA released ten research-based recommendations for educational technology decisions affecting learners ages 5 to 18. The report distinguishes visible engagement, immediate performance, and durable learning, warning that generative AI may improve the work a student produces while reducing independent knowledge and skill. It recommends testing transfer beyond the application, preserving meaningful adult involvement, and scrutinizing features optimized to hold attention.","sledRelevance":"School systems increasingly receive adoption dashboards, usage counts, completion rates, satisfaction scores, and vendor-reported output quality as proof of success. The report gives districts a clearer evidentiary boundary: those metrics can describe exposure or experience, but they do not establish retained learning, independent capability, equity, or developmental benefit.","evidence":"The report was produced by an APA multidisciplinary expert panel and synthesizes learning-science evidence across apps, games, intelligent tutoring, generative AI, and digital platforms. It is normative expert guidance rather than a new experiment or a product-by-product effectiveness review. APA does not recommend treating all screen time or all educational technology as equivalent.","architectureImplications":"Learning systems should capture more than clicks and time on task. Instrument preconditions, hints, revisions, explanations, independent post-use performance, transfer to novel tasks, accessibility, and what human interaction the tool displaces. AI tutors should be designed to elicit reasoning and provide educators with interpretable evidence, not maximize conversation length or produce finished answers.","governanceImplications":"Require efficacy claims to identify population, learning objective, comparison condition, duration, independent outcome measure, and transfer test. Pilot before scaling; include educators, families, students, accessibility experts, and learning scientists; and contract for evidence access and model-change notification. Do not use engagement, satisfaction, or AI-assisted grades alone as renewal criteria.","securityPrivacyImplications":"Minimize student data, prohibit secondary advertising and unapproved model training, bound retention, and test whether personalization or engagement features create manipulation, profiling, or unequal treatment. Accessibility accommodations should be evaluated for both learning benefit and the privacy cost of collecting disability-related or behavioral data.","caveats":"This is expert guidance, not a quantified meta-analysis in the public summary and not evidence that every AI or EdTech product harms learning. The public materials do not enumerate the number of studies reviewed or estimate effect sizes. Individual tools and pedagogical designs may produce different results, so the recommendations should guide evaluation rather than substitute for it.","streamIds":["k12"],"roles":{"sales":"Interpretation — Problem and stakeholders: Curriculum leaders, educators, learning scientists, families, students, accessibility, and procurement may receive engagement dashboards as proof of educational benefit. Discovery: What should students retain or transfer independently, and what adult interaction does the tool replace? Value hypothesis: Stronger evaluation could distinguish appealing products from effective learning support. Potential engagement: Review a purchase or renewal and design a bounded pilot with independent learning measures. Evidence boundary: APA's expert guidance offers learning-science considerations rather than a quantified effectiveness result for every product. It does not prove all AI harms learning, all screen time is equivalent, or usage and satisfaction are useless; those measures answer different questions from durable learning.","engineering":"Interpretation — Fit: Evaluate tutors that elicit reasoning and provide educator evidence rather than simply generating answers. Architecture: Reuse proportionate records of hints, revisions, explanations, independent post-use and transfer tasks, accessibility, and human-support interaction. Prerequisites: Defined population, objective, comparison, and educator-scored outcomes. Constraints: Engagement features may optimize attention rather than instruction. Security: Minimize student data, restrict advertising and model-training reuse, and inspect profiling or manipulation through personalization. Proposed validation: Compare independent performance after use and on novel tasks, review accessibility and adult involvement, and separate results from clicks, satisfaction, or assisted grades. Require evidence access and model-change information sufficient to repeat evaluation as the product changes; a high adoption dashboard cannot establish retained skill.","delivery":"Interpretation — Work and dependencies: Define pilot population, objective, duration, comparison, independent assessment, and transfer test before buying or renewing. Ownership: Instructional leaders and learning specialists own validity; teachers implement the design; privacy, accessibility, and procurement secure controls and evidence. Skills and adoption: Explain engagement, supported performance, and independent learning to staff and families and include affected learners. Governance checkpoints: Review evidence before scaling and reassess consequential changes. Proposed acceptance: Locally evaluated retention and transfer, accessible participation, maintained adult support, and privacy and equity findings against the comparison. Risks: Usage numbers can obscure cognitive offloading, while weak tests or displaced human contact can distort the value of a tool; guidance should shape evaluation rather than substitute for it."},"retrievedAt":null,"enrichedAt":"2026-09-05T02:42:45.193Z","enrichmentBasis":"archived evidence"}}]}