Lighthouse AdvisorySLED AI Adoption Intelligence

Education · Issue 03 ·

Student Success

Three newly archived sources distinguish useful course assistance, self-reported academic functioning and evidence mapping from demonstrated learning. A U.S. engineering deployment and Chinese panel offer bounded implementation insights; a September review has material appraisal and reporting limits. One cross-source pattern supports separating service utility from learning outcomes. These are recent evidence and explicit backfill, not new September 8 events. Durable learning, equity, advising impact and total cost remain gaps.

Evidence records
3
Cross-source patterns
1
Evidence classes
3 academic research
Outcomes
2 cautionary1 mixed
Source freshness
1 older, newly relevant1 recent1 new this fortnight
Research completed
2026-09-09

Choose a role to see its takeaway beside every record in the ledger.

Synthesis · Lighthouse Advisory interpretation

Patterns across the evidence

1 pattern, each supported by at least two sources

  1. Measure service usefulness separately from independent learning

    The engineering deployment measures practical use and perceptions; the Chinese panel estimates pathways among behavioural self-reports. Together they motivate separate service and learning measures, not a pooled benefit claim. Local pilots should assess unaided work alongside convenience and participation.

    Operating questionWhat independent task and delayed checkpoint would justify our learning claim even if students report that the assistant is useful?

    Supporting evidenceRamteja Sajja, Yusuf Sermet, Brian Fodale and Ibrahim DemirYang Zhao, Jian Chen, Wei Dai and Yuan Gu

Full record · every source keeps its link and limitations

Evidence ledger

3 records
  1. Academic researchMixedNewly relevant · Feb 2026

    Engineering assistant study separates convenient help from demonstrated learning

    Students valued convenient task support but expressed policy uncertainty; measured engagement does not establish learning gains.

    Ramteja Sajja, Yusuf Sermet, Brian Fodale and Ibrahim DemirMidwestern United States; one R1 universityFebruary 6, 2026; version of record dated February 24

    Why it matters, evidence and limitations
    Why it matters
    Direct public-university relevance for course support pilots, with limited transfer beyond engineering.
    Evidence and measured results
    Methods report 77 enrolled, 65 participants, 44 paired surveys and 48 active users. Usage results report 555 chatbot interactions and 75 structured-feature interactions. No randomized comparison or independent learning baseline is supplied.
    Limitations and uncertainty
    Abstract reports 71 participants, conflicting with methods' 65. Voluntary participation, one institution, self-report and novelty limit inference; external AI use is unobserved.
    Original mixed-methods deployment study Role takeaways & implementation
  2. Academic researchCautionaryRecent

    Panel study links learning-centred AI use to academic functioning, not causal achievement gains

    Learning-centred AI use predicted self-regulation and self-efficacy, with indirect associations to later engagement and procrastination. This is not evidence of improved grades or institutional retention.

    Yang Zhao, Jian Chen, Wei Dai and Yuan GuSichuan, China; multiple higher education institutionsJuly 1, 2026

    Why it matters, evidence and limitations
    Why it matters
    Useful for designing college study-support evaluation; Chinese language, institutions and tool mix limit U.S. transfer.
    Evidence and measured results
    Baseline n=1,200; 788 complete cases. Table 2 estimates LCU-to-SRL beta=.345, SE=.034, with baseline and covariate adjustment. Direct LCU-to-outcome paths were not significant. 'Retention' here means survey follow-up.
    Limitations and uncertainty
    Observational, selective attrition, brief context-adapted scales and short intervals; weighting cannot remove unobserved selection. No repeated objective achievement measure.
    Original observational three-wave panel Role takeaways & implementation
  3. Academic researchCautionaryNew this fortnight

    September review offers an integration map with substantial evidence-quality limits

    The review maps AI use cases and integration depth; it does not estimate a pooled learning effect or establish that deeper technology integration is better.

    Mona Hmoud AlSheikh, Rania Zaini, Manahel A. ALmulhem and Shakil AhmadInternational review; authors based in Saudi Arabia and United Arab EmiratesSeptember 1, 2026

    Why it matters, evidence and limitations
    Why it matters
    A starting inventory for U.S. college teaching pilots, not a local effectiveness forecast.
    Evidence and measured results
    Reports 959 records and 22 included studies, searched across eight databases for January 2015–July 2025. No formal risk-of-bias appraisal or meta-analysis. Table 1 includes a nursing editorial despite eligibility excluding non-empirical commentaries.
    Limitations and uncertainty
    English-only, excludes grey literature, heterogeneous designs and an older search cutoff. Abstract's single Redefinition claim conflicts with multiple Table 1 labels; exact category counts are not reused.
    Original systematic mapping review Role takeaways & implementation

How to read this edition

Source findings, measured results and limitations come from the cited publications. Patterns, operating questions, role takeaways and implementation considerations are Lighthouse Advisory interpretation, stated as questions to validate locally rather than guaranteed outcomes. Vendor and operator claims are labeled as claims. Full research method.

Academic research
Research produced through an academic institution or peer-reviewed venue.