{"resourceId":"ct-ccerc-ai-pilot-evaluation-exec-summary-202610","versions":[{"version":"external-4a049f665526136a093d2ac2a37b907795c1bfa0044c4dc31fc0205a0e5a4603","resource":{"id":"ct-ccerc-ai-pilot-evaluation-exec-summary-202610","title":"CCERC October 2026: Connecticut AI pilot evaluation finds preparation/differentiation gains, math-error wariness, and demand for clear AI-use policies","organization":"Center for Connecticut Education Research Collaboration (CCERC)","sector":"State education research collaboration (CSDE-affiliated)","geography":"Connecticut, United States (six participating LEAs)","publishedAt":"October 2026","publicationDate":null,"eventDate":null,"sourceName":"CCERC AI Pilot Program Evaluation Executive Summary","sourceLabel":"State-commissioned mixed-methods evaluation (executive summary)","sourceUrl":"https://portal.ct.gov/ccerc/-/media/ccerc/reports/ai-pilot-project-october-2026-executive-summary.pdf","evidenceClass":"government-evaluation","outcomeClass":"mixed","topics":["knowledge-work","accessibility-workforce","governance-procurement","operating-model"],"finding":"October 2026 CCERC executive summary evaluates Connecticut’s state-funded AI-in-education pilot across six LEAs (East Hartford, Lebanon, Rocky Hill, Seymour, Westport, Odyssey Community School) in grades 5–12 during 2024–25. Mixed methods: student survey n=735, teacher survey n=58, student focus groups n=32 (3 districts), teacher focus groups n=24 (4 districts). Pilot generally helped students and teachers develop AI skills. Teachers found tools most useful outside class for material preparation and differentiation; in class, teacher-created content-specific resources (e.g., rubric chatbots) were most useful. Both groups raised ethics, accuracy, and reliability concerns; math-related AI mistakes were frequent; most students were ambivalent about expanded use. Recommendations emphasize PD/peer collaboration, AI literacy, content-specific teacher-leveraged use, and clear district AI-use policies.","sledRelevance":"High for K–12: a current state-commissioned evaluation of multi-district AI pilots with actionable recommendations on PD, content-specific use, and policy clarity.","evidence":"Executive-summary mixed-methods evaluation funded via CCERC at CSDE request; surveys and focus groups; not an achievement RCT.","architectureImplications":"Classroom value skewed to teacher-designed, content-bound AI supports rather than generic student chatbots; tool choice left to districts among CSDE-approved options.","governanceImplications":"Recommendations call for clear, consistent district AI-use policies and CSDE model-policy examples; ethical parameters required for engagement.","securityPrivacyImplications":"Ethics and appropriate-use concerns raised by participants; summary does not report FERPA/DPA compliance metrics.","caveats":"Executive summary only; self-report methods; six pilot districts; no learning-outcome effect sizes.","streamIds":["k12"],"roles":{"sales":"Sales framing: Connecticut’s October 2026 CCERC summary shows a state-backed multi-district AI pilot that worked best for teacher preparation, differentiation, and teacher-designed rubric chatbots—not free-form student chat. Account teams should treat skill-building success as bounded and note frequent math errors plus student ambivalence. Interpretation: discovery should map approved-tool catalogs, PD capacity, and written AI-use parameters before pitching classroom expansion.","engineering":"Engineering framing: the evaluation elevates content-specific, teacher-controlled AI supports over generic copilots. Pre-sales engineers should ask which CSDE- or district-approved tools are in scope, how rubric/study chatbots are grounded, and how math-error rates will be monitored. Interpretation: architectures that cannot constrain outputs to assignment rubrics fit poorly with the reported classroom successes.","delivery":"Delivery framing: CCERC’s recommendations center ongoing professional development, peer collaboration, AI literacy, and clear district AI-use policies after a six-LEA pilot. Delivery teams can help districts define assignment-level parameters, stand up teacher-created rubric chatbots, and monitor math/accuracy failures before any student-facing expansion. Interpretation: treat the evaluation as implementation guidance, not an achievement RCT. Acceptance criteria here are proposals, not observed results from Connecticut’s pilot."},"roleDetails":{"sales":{"customerProblem":"States and districts piloting AI need credible evidence of what worked (and failed) for teachers and students, not vendor claims alone.","stakeholders":["CSDE / state education agencies","District curriculum and instructional technology leaders","Teachers in pilot grades/subjects","Students and families","State legislators funding pilots"],"discoveryQuestions":["Which AI uses were teacher-prep vs student-facing?","What written AI-use parameters exist, and are they consistent across schools?","How will math/accuracy failures be monitored before scale?"],"valueHypothesis":"Interpretation: bounded engagements that strengthen PD, teacher-designed supports, and policy clarity align with this evaluation; they cannot promise learning gains.","potentialEngagement":"Policy-and-PD readiness assessment tied to a small set of approved tools and teacher-created classroom supports.","unsupportedClaims":["Guaranteed student achievement gains","That generic chatbots matched teacher-designed supports","Statewide generalizability beyond six pilot LEAs","Math tutoring accuracy without human review"]},"engineering":{"fit":"Stronger for teacher workflow and rubric-grounded classroom aids; weaker for unconstrained student generative use given reported math errors and ambivalence.","architectureIntegration":"Integrate only within district-approved toolset; prefer teacher-authored bots/study tools bound to course rubrics and materials.","prerequisites":["Approved-tool list and accounts","Teacher PD time","Clear student-use parameters","Content/rubric grounding for classroom bots"],"constraints":["Pilot was discrete grade/content groups","Self-report evaluation methods","Frequent AI mistakes in math tasks"],"security":"Summary emphasizes ethics/appropriate use; does not document DPA or training-data controls.","proofOfValue":["Compare teacher prep/differentiation time before vs after with human review of outputs","Sample student accuracy critiques of AI math responses","Confirm classroom bots stay rubric-bound"]},"delivery":{"work":"Stand up PD/peer-collaboration cycles, draft actionable AI-use policies, and pilot teacher-designed classroom supports with monitoring for accuracy and ethics.","dependencies":["CSDE/district approved tools","Teacher schedule time","Policy adoption by district leadership"],"ownership":"District instructional leadership with CSDE guidance; CCERC evaluated, did not operate, the pilot.","skillsAdoption":"Teachers need sustained practice building content-specific AI supports; students need guided accuracy/ethics skills.","governanceCheckpoints":["Written AI-use parameters before classroom expansion","Ethics guidance published to staff/students","Periodic review of math/accuracy incidents"],"acceptanceCriteria":["Proposed: majority of pilot teachers complete PD sequence","Proposed: each participating course publishes allowed AI uses","Proposed: sampled AI math outputs reviewed by teachers weekly"],"risks":["Ambivalence and ethics concerns stall adoption","Accuracy failures in STEM undermine trust","Policy inconsistency across schools"]}},"retrievedAt":"2026-10-13T03:01:15Z","enrichedAt":"2026-10-13T03:04:17Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"PD and peer collaboration framed as vital; teachers request more time/support; AI literacy alongside technology skills for all experience levels.","procurementImplications":"Districts used CSDE-approved AI tools purchased with pilot funds; summary does not score vendors.","operatingModelImplications":"Success tied to teacher-created resources and classroom structures that incorporate AI ethically; expanded student use met with majority ambivalence.","sourceVerification":{"openedUrl":"https://portal.ct.gov/ccerc/-/media/ccerc/reports/ai-pilot-project-october-2026-executive-summary.pdf","referenceExcerpt":"Teachers found AI tools most useful outside the classroom for material preparation and differentiation.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}