From the Student Success edition of November 7, 2026
arXiv (5 Nov): three-year Auckland report finds draft-first scaffolding lifts student AI use above 90% while AI use alone does not predict essay quality
University of Auckland (with co-author Claus Brabrand) · Higher education first-year computing, academic writing and assessment design · New Zealand
- Publisher
- arXiv
- Original publication
- arXiv cs.CY, submitted 5 November 2026
- Source retrieved
- 2026-11-08
What happened
Shakil, Denny and colleagues report three years (2024–2026) of ethical essay assignments in a large first-year computer systems course, analysing 1,894 post-essay survey responses and linking 2025–2026 responses to essay grades. Under voluntary use, AI adoption stayed roughly steady (59%→64% Essay 1; 69%→68% Essay 2, 2024→2025); with a 2026 scaffolded workflow (independent draft first, AI to refine not rewrite, reflection and mandatory disclosure) it reached 93%. ChatGPT’s share of primary tool use fell from about 90% to about 60% as Claude, Gemini and Grammarly rose; brainstorming use fell from 47% to 15%. ANCOVA found AI use did not independently predict essay quality once prior performance was held constant, while markers coded high critical engagement under scaffolding.
Why it matters
Higher-education evidence that assessment design, not permission alone, shapes how students use AI—relevant to student-success leaders choosing between bans, open use and structured workflows.
Evidence and measured results
Repeated cross-sectional surveys plus grade-linked ANCOVA (Essay 2 score with Essay 1 baseline) and marker engagement codes; authors call findings formative, not causal.
Limitations and uncertainty
One course and institution; self-report bias; 2026 lacks unscaffolded control and mixes cohort effects; different score scales across phases; ceiling effects; preprint.
Put this evidence to work
Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-11-08; this does not change the original publication date. Each role follows the same checklist so takeaways compare across sources.
Sales
Role takeaway
- Customer problem
- Writing assessments cannot tell whether AI support helps or replaces student reasoning.
- Stakeholders
- Course coordinators
- Teaching and learning center
- Academic integrity office
- Department chairs
- Discovery questions
- Which gateway courses use take-home essays?
- Is there marker capacity to review drafts and reflections?
- Do current policies require AI disclosure?
- Value hypothesis
- Interpretation: draft-first scaffolds may make AI use transparent and critically engaged without harming essay quality; no causal grade gain shown.
- Potential engagement
- One-semester assessment redesign pilot in a gateway course with an unscaffolded comparison section.
- Unsupported claims
- Improved essay grades from AI
- Generalization beyond one course
- Reduced misconduct rates
Pre-sales engineering
Role takeaway
- Fit
- LMS-based multi-part submission workflow, tool-agnostic.
- Architecture and integration
- Separate LMS assignment slots for draft, final, reflection and disclosure; marker rubric with engagement codes.
- Prerequisites
- LMS assignment configuration
- Disclosure form
- Marker rubric
- Constraints
- Students may use consumer AI accounts
- Single-institution evidence
- No control condition in scaffolded year
- Security
- Provide guidance on not pasting personal or sensitive data into third-party AI; prefer institution-licensed tools where available.
- Proof of value
- Add unscaffolded comparison section
- Inter-rater reliability for engagement codes
- Baseline-controlled grade comparison
Delivery
Role takeaway
- Work
- Configure workflow, train markers, collect disclosures and surveys, analyse grades with baseline covariates.
- Dependencies
- Course coordinator
- Markers/tutors
- Teaching center
- Institutional research
- Ownership
- Course coordinator with teaching center support
- Skills and adoption
- Students follow checklist-driven draft-first steps; markers learn engagement coding.
- Governance checkpoints
- Disclosure rule communicated in syllabus
- Marker calibration session
- Ethics review for survey-grade linkage
- Acceptance criteria
- Proposed: ≥95% disclosure-form completion
- Proposed: inter-rater agreement reported for engagement codes
- Proposed: grade analysis controlling for baseline
- Risks
- Marker workload growth
- Ceiling effects in codes
- Over-reading adoption as learning
Implementation considerations
Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.
Architecture and integration
What must connect, and where does the AI sit in the workflow?
Low-tech: students choose their own AI tool; workflow relies on LMS submission of draft, final, reflection and disclosure form for side-by-side marking.
Governance
Who approves, reviews and stays accountable for outcomes?
Mandatory disclosure and pre-AI draft (missing draft or form scored zero) make AI use auditable without detectors.
Security and privacy
What data, permissions and controls need testing?
Tool-agnostic policy means students may use consumer AI accounts; institutions should consider data-handling guidance for drafts pasted into third-party tools.
Accessibility and workforce
Who is affected, and what skills or accommodations follow?
Draft-first design may protect foundational writing practice for first-year school leavers; equity effects by subgroup are not reported.
Procurement
What should contracts, pricing and exit terms secure?
Suggests investing in assessment redesign and marker time rather than detection tools; no specific product implied.
Operating model
Which teams own the service once it runs?
Requires markers to review drafts, reflections and disclosures together—additional marking workload not quantified.
Publication history
- 2026-11-07Student Success · Issue 615 resources
Stable resource ID: arxiv-2611-08431-auckland-scaffolded-genai-ethics-essays-20261105