{"resourceId":"csm-chatgpt-for-teens-unacceptable-risk-20261005","versions":[{"version":"external-c88b0627d96a0b321275a034ed4ad416425e55a5cbad836b99dec2c578cebb64","resource":{"id":"csm-chatgpt-for-teens-unacceptable-risk-20261005","title":"Common Sense Media: ChatGPT for Teens rated Unacceptable Risk after >4,000 prompts—parental alerts and crisis referrals fail often","organization":"Common Sense Media Youth AI Safety Institute","sector":"Independent nonprofit youth media / AI product risk assessment","geography":"United States (consumer ChatGPT Teen mode; national K-12 implications for off-network student use)","publishedAt":"Last updated October 5, 2026 (embargoed to October 7, 2026 5 AM ET)","publicationDate":"2026-10-05","eventDate":"2026-08-18","sourceName":"Common Sense Media Youth AI Safety Institute","sourceLabel":"Independent product risk assessment PDF (philanthropy and industry funded; institute claims editorial independence)","sourceUrl":"https://institute.commonsensemedia.org/sites/default/files/risk-assessments/csm-ai-risk-assessment-chatgpt-for-teens-10052026.pdf","evidenceClass":"independent-research","outcomeClass":"cautionary","topics":["data-security","accessibility-workforce","knowledge-work","operating-model","governance-procurement"],"finding":"The Youth AI Safety Institute’s ChatGPT for Teens risk assessment (last updated 2026-10-05; public after 2026-10-07 embargo) rates the product Unacceptable Risk for all children under 18 after testing more than 4,000 prompts before and after OpenAI’s August 18, 2026 Teen-mode launch. Advertised parental notifications for suicide, self-harm, and disordered eating did not fire on more than a dozen new parent-linked accounts even during explicit crisis conversations lasting up to an hour; alerts appeared to depend on accumulated sensitive-topic history rather than severity. After launch, ChatGPT missed more than one in four warranted crisis referrals across tested mental-health conditions and fell below the institute’s 95% threshold on three of five Red Line severe harms. Study mode is bypassable via a “Show me the answer” option and by deleting the @study prefix during Study Hours. Friend-like behavior persists despite Under-18 model-spec language. Adult-registered accounts did not switch to Teen mode despite claiming age 13. Why now: not archived; published this week and newly relevant alongside NY districts lacking AI policies and Fairplay’s demand for independent safety/efficacy evidence before student tools.","sledRelevance":"Even when schools restrict on-network GenAI, students use consumer ChatGPT off-network. Districts need AI-literacy and parent-communication plans that do not assume Teen-mode parental alerts or Study mode actually work as marketed.","evidence":"Structured pre/post prompt batteries (mental health, developmental appropriateness, academic integrity, parental notifications, age prediction) with clinical advisors scoring crisis-resource warrants. Limitations: sequential windows confound model updates with Teen settings; U.S./Bay Area accounts; no voice/image/group-chat tests; Institute discloses industry funding alongside philanthropy while asserting editorial independence; OpenAI factual review without editorial control.","architectureImplications":"School-managed alternatives cannot rely on consumer parental-link notifications. Prefer tools with auditable crisis-escalation logs, non-bypassable academic modes, and verified age gates—not self-reported age alone.","governanceImplications":"Interpretation: treat vendor “teen safety” marketing as unverified until independent red-team evidence exists; align student GenAI approvals with Fairplay-style independent tests rather than feature checklists.","securityPrivacyImplications":"Failed parental alerts and age-prediction gaps mean guardians and schools may lack situational awareness of crisis or adult-mode exposure; document that off-network consumer AI is outside district DLP.","caveats":"Assessment of consumer ChatGPT Teen mode, not a specific ed-tech LMS integration. Funding disclosure includes industry. Not a randomized learning-outcome study. Geographic testing limited.","streamIds":["k12"],"roles":{"sales":"Sales framing: Common Sense Media’s Unacceptable Risk rating for ChatGPT for Teens is a board-and-parent conversation starter about the consumer chatbot students already use after school. Sell independent evaluation, updated AI literacy, and district-managed alternatives with auditable crisis and academic-integrity controls—not reassurances that Teen-mode parental alerts or Study mode make ChatGPT school-safe. Acknowledge the assessment covers consumer accounts, not every LMS tutor, and that industry funding is disclosed. Do not claim blocking ChatGPT on campus stops home use.","engineering":"Engineering framing: do not architect school safety programs around consumer parental-notification emails or soft Study-mode toggles that teens can bypass with “Show me the answer” or by stripping @study. For any student-facing conversational AI, require verified age assurance beyond self-report, non-bypassable scaffold modes, crisis-escalation telemetry visible to adults, and a red-team harness tracking referral hit rates on severe harms. Assume off-network consumer apps sit outside MDM and DLP, so district controls must be explicit about what is and is not covered.","delivery":"Delivery framing: brief leadership and counselors on parental-alert and crisis-referral failure modes, revise digital-citizenship units so students learn chatbots are not friends or crisis clinicians, and keep consumer ChatGPT off student Approved Lists until independent retesting clears Red Line thresholds. Update parent communications to avoid false confidence in Teen-mode marketing. Acceptance includes an issued brief, AUP/literacy updates, and a documented escalation path for AI-related student disclosures—not a one-time firewall rule change."},"roleDetails":{"sales":{"customerProblem":"Parents and boards may believe ChatGPT for Teens parental alerts and Study mode make consumer AI school-appropriate; independent testing finds major failures.","stakeholders":["Superintendent","Student services / counseling","CIO","Board","Parents","Teachers"],"discoveryQuestions":["Is consumer ChatGPT blocked or merely unmentioned?","What parent messaging exists about Teen-mode alerts?","Do approved tutors have non-bypassable scaffolding modes?","How are crisis referrals handled for off-network AI disclosures?"],"valueHypothesis":"An evidence-briefing plus literacy update can prevent false confidence in Teen-mode marketing while positioning governed instructional tools.","potentialEngagement":"3–6 week safety brief and literacy refresh: summarize CSM findings for board/parents, update AUP language, evaluate district chatbot controls against Red Line criteria.","unsupportedClaims":["That blocking ChatGPT at school stops home use","That any single ed-tech tutor inherits CSM’s methods","Guaranteed elimination of crisis-risk from AI"]},"engineering":{"fit":"Safety and academic-integrity control requirements for any student-facing conversational AI.","architectureIntegration":"Age assurance beyond self-report; immutable study/scaffold modes; crisis-classifier evaluation harness; admin-visible escalation logs.","prerequisites":["Clear approved-tool boundary vs consumer AI","Counseling escalation playbooks","Parent communication channel","Red-team prompt suite"],"constraints":["Consumer apps outside MDM/DLP","Model updates can regress safeguards","Self-reported age remains weak"],"security":"Assume parental notifications may fail; minimize retention of sensitive student chats; route crisis signals to humans.","proofOfValue":["Red-team crisis-referral hit rate ≥95% on severe harms","Study-mode bypass attempts blocked","Age-gate false-adult rate measured"]},"delivery":{"work":"Brief leadership, revise digital-citizenship units, train counselors, and reassess any chatbot pilots against CSM Red Line criteria.","dependencies":["Student services","Legal/AUP owners","Communications","Independent evaluation capacity"],"ownership":"Student services owns crisis protocols; CIO owns technical blocks/approvals; academics own literacy curriculum.","skillsAdoption":"Teach students that Study mode can be bypassed and that chatbots are not friends or crisis counselors.","governanceCheckpoints":["Board information item on CSM rating","AUP/literacy update published","Quarterly retest of any approved student chatbot"],"acceptanceCriteria":["Parent/staff brief issued","Consumer ChatGPT not on student Approved List","Documented counselor escalation path for AI-related disclosures"],"risks":["False reassurance from Teen-mode branding","Over-focus on one vendor while others untested","Equity issues if only some families hear the warning"]}},"retrievedAt":"2026-10-13T22:06:40-05:00","enrichedAt":"2026-10-13T22:10:11-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Crisis-referral misses and friend-like behavior raise developmental and mental-health risks for teens, including students with existing mental-health needs; literacy and counselor readiness become workforce requirements.","procurementImplications":"Demand independent red-team evidence for parental alerts, crisis referral rates, age assurance, and non-bypassable academic modes before any student chatbot purchase.","operatingModelImplications":"Treat off-network consumer AI risk as part of the operating model (literacy + counseling), not only as a firewall rule.","sourceVerification":{"openedUrl":"https://institute.commonsensemedia.org/sites/default/files/risk-assessments/csm-ai-risk-assessment-chatgpt-for-teens-10052026.pdf","referenceExcerpt":"We tested more than 4,000 prompts before and after the Teen mode launch and rated ChatGPT an Unacceptable Risk for all children under 18.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}