{"resourceId":"ncaa-signify-threat-matrix-2024-25","versions":[{"version":"external-908bcf40c786065b7981d71a229bfc989184eb115c0b969cc93d8df4d18ec43b","resource":{"id":"ncaa-signify-threat-matrix-2024-25","title":"NCAA abuse monitoring shows the workload between AI flags and verified cases","organization":"Signify Group for NCAA","sector":"Collegiate athlete support","geography":"United States; selected NCAA championships","publishedAt":"2024/25 season report; exact publication date not established","publicationDate":null,"eventDate":null,"sourceName":"NCAA Analysis Report 2024/25: Online Abuse in NCAA Championships","sourceLabel":"Service-provider operational report hosted by NCAA","sourceUrl":"https://ncaaorg.s3.amazonaws.com/ncaa/wagering/2024-25NCAA_ThreatMatrixPublicReport.pdf","evidenceClass":"vendor-claim","outcomeClass":"mixed","topics":["knowledge-work","data-security","accessibility-workforce","governance-procurement","operating-model"],"finding":"The report separates 65,812 AI-flagged messages reviewed by analysts from 3,916 verified abusive messages reported to platforms.","sledRelevance":"Direct collegiate athlete-support implementation; not a general policing deployment.","evidence":"Across seven sports, the report counts 1,332,307 messages mentioning monitored accounts. It describes AI screening, expert investigation and escalation tiers. Prior-season counts are a comparison, not a controlled baseline; monitored participants and events changed.","architectureImplications":"Interpretation: separate ingestion, screening, analyst adjudication and restricted case export; preserve decision provenance.","governanceImplications":"Interpretation: welfare staff should approve escalation rules and review errors; flags must not become automatic accusations.","securityPrivacyImplications":"Interpretation: restrict private-message access and retention; obtain explicit onboarding consent and protect case evidence.","caveats":"Provider report without audited recall, adjudicator reliability or controlled welfare outcomes. Some basketball-change descriptions conflict internally; those comparisons are excluded.","streamIds":["college-athletics"],"roles":{"sales":"Interpretation: The customer problem is handling threatening or abusive messages without leaving athletes to manage the burden alone. Engage athlete welfare, athletics leadership, event security, IT and athlete representatives. Ask who receives alerts after hours, which platforms are covered, and what happens when a student asks for help through a private channel. A bounded engagement could map the current response process and test a small authorized monitoring pilot. The value hypothesis is more consistent triage and support. Do not promise reduced harassment or infer detection accuracy from the report's funnel. Establish whether sufficient trained review capacity exists before expanding automated collection.","engineering":"Interpretation: Fit is assisted triage feeding a controlled case-management workflow. Prerequisites include authorized platform access, approved categories, trusted reviewers and a documented retention schedule. Keep raw content distinct from model flags and human decisions. Validate on representative, lawfully obtained examples, including sarcasm, multilingual content and benign references; use independent adjudication where practical. Measure missed concerning content as well as reviewer burden. Test feed loss, duplicate alerts and access revocation. Private-message onboarding needs a separate permission boundary. Hosting choices must preserve evidence security and continuity; autonomous identity attribution or referral should remain outside this proposed pilot.","delivery":"Interpretation: An athlete safeguarding lead should own implementation, supported by trained analysts, IT and event operations. Map intake channels, agree escalation thresholds, configure access and rehearse urgent and ambiguous cases before launch. Dependencies include platform access and staffed coverage during events. Train athletes on available support without implying surveillance catches every message. Governance checkpoints should review consent, incident handling and complaints. Proposed acceptance criteria include correct routing of every critical test case, measured response times against institutionally approved targets, successful permission-removal tests and documented analyst workload. Risks include missed content, erroneous identification, unnecessary retention and reviewer distress."},"retrievedAt":"2026-09-09T03:01:52Z","enrichedAt":"2026-09-09T03:04:23Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Interpretation: provide accessible reporting routes and support staff exposed to abusive material.","procurementImplications":"Interpretation: evaluate human-review capacity, platform dependencies, coverage exclusions and data deletion alongside software.","operatingModelImplications":"Interpretation: appoint a safeguarding owner and maintain an exercised handoff to appropriate institutional responders.","updateExplanation":"Absent from all 119 scanned archive records. Adds historical operational evidence on athlete-support triage; the season label is not treated as a publication date.","sourceVerification":{"openedUrl":"https://ncaaorg.s3.amazonaws.com/ncaa/wagering/2024-25NCAA_ThreatMatrixPublicReport.pdf","referenceExcerpt":"TOTAL FLAGGED BY AI","promptVersion":"sled-research-v3.1","model":null,"basis":"agent-reported inspection"}}}]}