{"resourceId":"arxiv-2611-08431-auckland-scaffolded-genai-ethics-essays-20261105","versions":[{"version":"external-d7dceac8da99a68c3841db7b63297fb37c611f6bbb4ecf73a1ee8d01907d0396","resource":{"id":"arxiv-2611-08431-auckland-scaffolded-genai-ethics-essays-20261105","title":"arXiv (5 Nov): three-year Auckland report finds draft-first scaffolding lifts student AI use above 90% while AI use alone does not predict essay quality","organization":"University of Auckland (with co-author Claus Brabrand)","sector":"Higher education first-year computing, academic writing and assessment design","geography":"New Zealand","publishedAt":"arXiv cs.CY, submitted 5 November 2026","publicationDate":"2026-11-05","eventDate":null,"sourceName":"arXiv","sourceLabel":"Preprint (experience report; related ACM DOI listed)","sourceUrl":"https://arxiv.org/abs/2611.08431","evidenceClass":"academic-research","outcomeClass":"mixed","topics":["knowledge-work","governance-procurement","operating-model"],"finding":"Shakil, Denny and colleagues report three years (2024–2026) of ethical essay assignments in a large first-year computer systems course, analysing 1,894 post-essay survey responses and linking 2025–2026 responses to essay grades. Under voluntary use, AI adoption stayed roughly steady (59%→64% Essay 1; 69%→68% Essay 2, 2024→2025); with a 2026 scaffolded workflow (independent draft first, AI to refine not rewrite, reflection and mandatory disclosure) it reached 93%. ChatGPT’s share of primary tool use fell from about 90% to about 60% as Claude, Gemini and Grammarly rose; brainstorming use fell from 47% to 15%. ANCOVA found AI use did not independently predict essay quality once prior performance was held constant, while markers coded high critical engagement under scaffolding.","sledRelevance":"Higher-education evidence that assessment design, not permission alone, shapes how students use AI—relevant to student-success leaders choosing between bans, open use and structured workflows.","evidence":"Repeated cross-sectional surveys plus grade-linked ANCOVA (Essay 2 score with Essay 1 baseline) and marker engagement codes; authors call findings formative, not causal.","architectureImplications":"Low-tech: students choose their own AI tool; workflow relies on LMS submission of draft, final, reflection and disclosure form for side-by-side marking.","governanceImplications":"Mandatory disclosure and pre-AI draft (missing draft or form scored zero) make AI use auditable without detectors.","securityPrivacyImplications":"Tool-agnostic policy means students may use consumer AI accounts; institutions should consider data-handling guidance for drafts pasted into third-party tools.","caveats":"One course and institution; self-report bias; 2026 lacks unscaffolded control and mixes cohort effects; different score scales across phases; ceiling effects; preprint.","streamIds":["student-success"],"roles":{"sales":"Sales framing: institutions anxious about AI in writing want approaches that keep learning visible without relying on detectors. This three-year Auckland report offers a bounded story: a draft-first, disclose-and-reflect workflow drove near-universal, critically engaged AI use, but AI use did not raise or lower essay quality. A credible engagement is an assessment-redesign pilot in a gateway course, not a promise of better grades.","engineering":"Engineering framing: fit is a tool-agnostic workflow implemented in the learning management system—separate submission slots for pre-AI draft, final essay, reflection and disclosure form so markers can compare side by side. Integration is light, but data guidance matters because students used varied consumer tools. Proof of value should add an unscaffolded comparison and reliability testing for engagement codes the authors flagged as missing.","delivery":"Delivery framing: course coordinators own the workflow, rubric and marker calibration; teaching centers can package the publicly available scaffold. Delivery must budget marker time for comparing drafts and reflections and must enforce the disclosure rule consistently. Acceptance should use proposed measures—disclosure completion, coded critical engagement with reliability checks and baseline-controlled grade analysis—rather than adoption rates alone."},"roleDetails":{"sales":{"customerProblem":"Writing assessments cannot tell whether AI support helps or replaces student reasoning.","stakeholders":["Course coordinators","Teaching and learning center","Academic integrity office","Department chairs"],"discoveryQuestions":["Which gateway courses use take-home essays?","Is there marker capacity to review drafts and reflections?","Do current policies require AI disclosure?"],"valueHypothesis":"Interpretation: draft-first scaffolds may make AI use transparent and critically engaged without harming essay quality; no causal grade gain shown.","potentialEngagement":"One-semester assessment redesign pilot in a gateway course with an unscaffolded comparison section.","unsupportedClaims":["Improved essay grades from AI","Generalization beyond one course","Reduced misconduct rates"]},"engineering":{"fit":"LMS-based multi-part submission workflow, tool-agnostic.","architectureIntegration":"Separate LMS assignment slots for draft, final, reflection and disclosure; marker rubric with engagement codes.","prerequisites":["LMS assignment configuration","Disclosure form","Marker rubric"],"constraints":["Students may use consumer AI accounts","Single-institution evidence","No control condition in scaffolded year"],"security":"Provide guidance on not pasting personal or sensitive data into third-party AI; prefer institution-licensed tools where available.","proofOfValue":["Add unscaffolded comparison section","Inter-rater reliability for engagement codes","Baseline-controlled grade comparison"]},"delivery":{"work":"Configure workflow, train markers, collect disclosures and surveys, analyse grades with baseline covariates.","dependencies":["Course coordinator","Markers/tutors","Teaching center","Institutional research"],"ownership":"Course coordinator with teaching center support","skillsAdoption":"Students follow checklist-driven draft-first steps; markers learn engagement coding.","governanceCheckpoints":["Disclosure rule communicated in syllabus","Marker calibration session","Ethics review for survey-grade linkage"],"acceptanceCriteria":["Proposed: ≥95% disclosure-form completion","Proposed: inter-rater agreement reported for engagement codes","Proposed: grade analysis controlling for baseline"],"risks":["Marker workload growth","Ceiling effects in codes","Over-reading adoption as learning"]}},"retrievedAt":"2026-11-08T04:19:20Z","enrichedAt":"2026-11-08T04:22:57Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Draft-first design may protect foundational writing practice for first-year school leavers; equity effects by subgroup are not reported.","procurementImplications":"Suggests investing in assessment redesign and marker time rather than detection tools; no specific product implied.","operatingModelImplications":"Requires markers to review drafts, reflections and disclosures together—additional marking workload not quantified.","peerReview":"preprint","sourceVerification":{"openedUrl":"https://arxiv.org/abs/2611.08431","referenceExcerpt":"Under voluntary-use policies, AI adoption remained steady at around two-thirds of students, rising above 90% when use was scaffolded.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}