From the K–12 edition of September 24, 2026
Large paired-edit study: AI detector false positives span 0 to 100% and track editing style
Chung-Ang University and Wordvice (Park, Jeong, Kim) · Academic AI/NLP research · International academic writing corpus (implications for multilingual learners)
- Publisher
- arXiv
- Original publication
- 27 August 2026 (arXiv 2608.26710v1)
- Source retrieved
- 2026-09-25
What happened
Park, Jeong, and Kim analyze 135,389 original vs professionally edited non-native academic manuscript pairs across 13 AI text detectors. False-positive rates on human-written texts ranged from 0.0% to 100.0%. The same edits increased AI scores in some detectors and decreased them in others, with score changes correlating with editing intensity; practical significance thresholds were met in only 7 of 13 detectors. Authors identify professional editing style as a key confound rather than cleanly separating origin from linguistic form, raising fairness and reliability concerns in academic settings. Why now: as districts tighten integrity rules alongside AI pauses/pilots, detector-only misconduct findings are especially risky for multilingual K-12 writers.
Why it matters
Supports K-12 academic-integrity policy that forbids sole reliance on AI detectors—aligned with developmental fairness for multilingual students and with process/evidence-based misconduct review.
Evidence and measured results
Large-scale paired natural experiment holding content/authorship fixed while varying professional editing; detector outputs compared pre/post; academic manuscripts 2018 to 2025, not K-12 classroom essays.
Limitations and uncertainty
Corpus is professional academic editing, not K-12 essays; one coauthor affiliated with editing vendor Wordvice; detector landscape changes quickly; transfer to schools requires caution.
Put this evidence to work
Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-09-25; this does not change the original publication date. Each role follows the same checklist so takeaways compare across sources.
Sales
Role takeaway
- Customer problem
- Schools want AI-cheating controls but risk false accusations, especially for multilingual writers.
- Stakeholders
- Principals
- Teachers
- ELL/equity leads
- Students/families
- Counsel
- Discovery questions
- Are detector scores used as sole evidence today?
- How are multilingual students represented in flagged cases?
- What process evidence is required before sanctions?
- Which detector vendors receive student text?
- Value hypothesis
- An integrity-process engagement can reduce false positives by demoting detectors to advisory signals.
- Potential engagement
- 2 to 3 week academic-integrity AI review: SOP rewrite, teacher briefing, and disparity monitoring plan.
- Unsupported claims
- Any detector is accurate enough for automatic sanctions
- Results transfer unchanged to K-12 essays
- Zero false positives after process changes
Pre-sales engineering
Role takeaway
- Fit
- Advisory detection with human review; poor fit for automated grade invalidation.
- Architecture and integration
- Optional detector API behind teacher review UI; version pinning; retain human decision records; minimize data sent offsite.
- Prerequisites
- Integrity SOP update
- Privacy/DPA for detector vendor
- Teacher training module
- Constraints
- Academic corpus is not K-12
- Detector drift
- Vendor conflict disclosures
- Security
- Minimize student-text egress; prefer on-prem/process alternatives; purge detector vendor copies per DPA.
- Proof of value
- Human overturn rate of flags
- Flag rates by language status
- Elimination of auto-sanctions
Delivery
Role takeaway
- Work
- Rewrite misconduct procedures, train staff, stand up disparity dashboards, and communicate limits to families.
- Dependencies
- Counsel
- ELL office
- LMS admins
- Communications
- Ownership
- Academic integrity lead owns SOP; equity office monitors disparate impact.
- Skills and adoption
- Train teachers to gather process evidence and to interpret detector scores as hypotheses only.
- Governance checkpoints
- SOP adoption
- Training completion
- Quarterly disparity review
- Vendor DPA check
- Acceptance criteria
- No detector-only sanctions
- Documented human review on all flags
- Public FAQ on limitations
- Risks
- Discriminatory false positives
- Silent auto-grading integrations
- Parent trust loss
Implementation considerations
Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.
Architecture and integration
What must connect, and where does the AI sit in the workflow?
If detectors are used at all, treat scores as triage signals requiring human review and process evidence; avoid automated grade penalties from detector APIs.
Governance
Who approves, reviews and stays accountable for outcomes?
Update integrity codes: detectors are not proof; disclose limitations to teachers/families; prefer assignment redesign and oral/process defenses over surveillance scoring.
Security and privacy
What data, permissions and controls need testing?
Sending student writing to third-party detectors creates additional data-sharing risk; prefer local process review where possible.
Accessibility and workforce
Who is affected, and what skills or accommodations follow?
False positives tied to polished/non-native style threaten multilingual and edited student writing; equity monitoring is essential.
Procurement
What should contracts, pricing and exit terms secure?
If purchasing detectors, require transparency on FPR testing, human-review workflows, and data deletion—not marketing accuracy claims.
Operating model
Which teams own the service once it runs?
Shift integrity ops from surveillance scores to assignment design and process evidence.
Publication history
- 2026-09-24K–12 · Issue 195 resources
Stable resource ID: arxiv-ai-detector-editing-style-confound-20260827