Education · Issue 02 ·
Student Success
Three new archive resources examine tutor access timing, independent writing performance and consent-based advising notes. Short-term learning evidence is mixed and design-specific; Utah's operational benefits remain unmeasured. One pattern distinguishes when AI becomes available from what reasoning it may perform. Sources are recent or older evidence backfill, not claimed as new September 7 events. Durable retention, disability-specific benefit, measured advising savings and deployment cost remain gaps.
- Evidence records
- 3
- Cross-source patterns
- 1
- Evidence classes
- 2 academic research1 standards or public-body guidance
- Outcomes
- 2 mixed1 emerging
- Source freshness
- 1 undated1 new this fortnight1 older, newly relevant
- Research completed
- 2026-09-08
Choose a role to see its takeaway beside every record in the ledger.
Synthesis · Lighthouse Advisory interpretation
Patterns across the evidence
Access timing and delegation depth require different tests
The Berlin trial tests waiting before access; the Chinese writing study combines restrictions on generated reasoning with reflection. Their differing findings do not establish a universal rule for restricting AI. Specify the intervention and evaluate it against the particular independent skill, with uncertainty appropriate to each design.
Operating questionAre we changing when students can ask for help, what work AI may perform, or the reflection required—and which comparison isolates that choice?
Supporting evidenceMira Fischer, Holger A. Rau and Rainer Michael Rilke; IZAXinran Chen; Jinggangshan University
Full record · every source keeps its link and limitations
Evidence ledger
Tutor trial supports short-term learning, but delayed-access comparison is uncertain
An individually randomized experiment reports a 0.227 SD gain with AI access versus textbook-only study (SE 0.106). Immediate access exceeded delayed access by about 0.21 SD, but p=.066 qualifies the abstract's stronger significance language.
Why it matters, evidence and limitations
- Why it matters
- Relevant to U.S. college study-support pilots; German laboratory findings cannot establish semester-long retention or equitable effects locally.
- Evidence and measured results
- February 2025 experiment: 336 entrants, two excluded for prohibited test access, analytic n=334. After baseline testing, students studied for 25 minutes; delayed access began after 10 minutes. The unaided main test had 25 multiple-choice items. Table 1 adjusts for baseline score and other covariates; unrestricted versus control estimate .337 SD, SE .116; restricted .132, SE .122.
- Limitations and uncertainty
- Working paper, platform collaboration, short incentivized laboratory task; no delayed retention. Subgroup analyses are low-powered and unadjusted for multiplicity. Time to first prompt is an incomplete reading-effort measure.
Writing study favors bounded support on independent tasks, with fragile class-level inference
Open collaboration produced the highest supported-writing mean; bounded support plus reflection led on independent Week 8 outcomes. The six-class design supports associations, not a definitive causal claim.
Why it matters, evidence and limitations
- Why it matters
- A useful assessment-design example for U.S. college writing programs, with limited transfer across languages, institutions and genres.
- Evidence and measured results
- Eight-week quasi-experiment: 180 entrants, 168 completers, six intact classes and three conditions including no AI. Table 11's adjusted bounded-open writing difference is .27 on the 1–5 scale; wild-cluster p=.050. Other outcome p values reach .063. Baseline writing and independent reasoning were assessed; Week 8 was supervised without AI.
- Limitations and uncertainty
- Nonrandom intact classes; bundled reflection and delegation limits; same-course immediate near transfer only. Possible rater unblinding and demand effects. Raw data were not independently audited.
Utah describes consent and advisor review for AI appointment notes; benefits remain unmeasured
Utah describes explicit verbal student consent, the ability to stop AI Companion, and advisor correction before saving summaries in Navigate. Efficiency and record-quality benefits are objectives, not measured results.
Why it matters, evidence and limitations
- Why it matters
- Directly relevant to U.S. public-university advising documentation. Local adoption still requires institution-specific review and student participation.
- Evidence and measured results
- First-party description of a newly introduced workflow and planned advisor training. No comparison group, sample, error rate, time-saving estimate or retention outcome is supplied.
- Limitations and uncertainty
- Operator account, not evaluation or full standards text. The November 21 approval mention omits the year, so eventDate is null. Training plans do not establish completed rollout.
How to read this edition
Source findings, measured results and limitations come from the cited publications. Patterns, operating questions, role takeaways and implementation considerations are Lighthouse Advisory interpretation, stated as questions to validate locally rather than guaranteed outcomes. Vendor and operator claims are labeled as claims. Full research method.
- Academic research
- Research produced through an academic institution or peer-reviewed venue.
- Standards or public-body guidance
- Normative or advisory guidance from a standards body or public institution.