Education · Issue 04 ·
Student Success
Three newly archived sources cover mentored AI capstones, delayed independent learning and student access. UCF's September 9 implementation account is promotional and has no measured educational outcomes; a 2025 retention study reports task-specific mixed results with reporting limitations; a UK survey supplies access and support constraints, not AI effectiveness. The two older sources are explicit evidence backfill. No cross-source patterns are asserted. Current advising impact, AI-specific disability benefits, broad durable-learning gains and total cost remain gaps.
- Evidence records
- 3
- Cross-source patterns
- 0
- Evidence classes
- 1 vendor claim1 academic research1 public-sector association guidance
- Outcomes
- 1 emerging1 mixed1 cautionary
- Source freshness
- 1 new this fortnight1 older, newly relevant1 undated
- Research completed
- 2026-09-10
Choose a role to see its takeaway beside every record in the ledger.
Synthesis · Lighthouse Advisory interpretation
Patterns across the evidence
The evidence in this edition did not support a cross-source pattern. Each record below stands on its own.
Full record · every source keeps its link and limitations
Evidence ledger
UCF describes selective AI capstones with industry mentors; learning gains remain unmeasured
UCF describes an industry-mentored alternative to the fintech capstone. Educational and career benefits are operator claims without comparative outcomes.
Why it matters, evidence and limitations
- Why it matters
- Direct U.S. public-university example of applied AI workforce learning. Relevant to graduate experiential education, not evidence for universal undergraduate tutoring.
- Evidence and measured results
- Two to four students are selected each semester; participation lasts more than a year with weekly faculty meetings. One project combines Gemini, Google Places API and a rule-based risk engine. The account provides no learning baseline, assessment sample, placement rate or validated fraud-detection performance.
- Limitations and uncertainty
- Selective promotional case, not causal evaluation. Productization is a possibility, not demonstrated deployment. Event date unknown.
Task-specific AI learning gains weaken at follow-up; reporting limits qualify the retention claim
ChatGPT improved immediate lower-order task assessment relative to control, but the study does not establish a general durable-learning advantage.
Why it matters, evidence and limitations
- Why it matters
- Useful backfill for college pilots needing delayed independent assessment. The institution is unnamed, so author affiliations cannot establish geographic transferability.
- Evidence and measured results
- Final n=123 from 152 volunteers; randomized four-tool comparison with unaided quizzes and follow-up three weeks after the final task. Tables 4–5 show Task 1 ChatGPT means 82.6 then 65.5, versus control 60.2 then 59.3; time-by-group p<.01. Higher-order immediate group differences were nonsignificant (p=.514).
- Limitations and uncertainty
- Single site, post-assignment exclusions, fixed task order and restricted tools limit generalization. Cluster counts total 153 despite 152 volunteers; Task 2 prose conflicts with its table. Do not infer higher-order harm from nonsignificance. Model version and event dates are unspecified.
UK student survey identifies access and AI-support gaps, with important sampling limits
Student-reported AI use sits alongside gaps in training and basic digital access; the survey does not measure AI learning effectiveness.
Why it matters, evidence and limitations
- Why it matters
- A transferable checklist for U.S. college support planning, not a U.S. prevalence estimate or evidence that AI caused digital exclusion.
- Evidence and measured results
- 15,398 respondents across 30 providers, October 2024–April 2025. Reported AI learning use: 34%; AI training/support: 24%; unsuitable-device difficulties: 37%; wifi difficulties: 60%. Methods note optional questions, unweighted data and changing participating institutions.
- Limitations and uncertainty
- Self-report, not learning or causal evaluation. One institution supplied 5,550 responses. The support-tools accessibility category combines AI with other tools, so it cannot establish AI-specific disability benefit.
How to read this edition
Source findings, measured results and limitations come from the cited publications. Patterns, operating questions, role takeaways and implementation considerations are Lighthouse Advisory interpretation, stated as questions to validate locally rather than guaranteed outcomes. Vendor and operator claims are labeled as claims. Full research method.
- Vendor claim
- A supplier-provided assertion that has not been upgraded to independent evidence.
- Academic research
- Research produced through an academic institution or peer-reviewed venue.
- Public-sector association guidance
- Practitioner guidance or an association-supplied case; not independent outcome evidence.