Education · Issue 05 ·
Research
Three newly archived sources cover CU Boulder's deadline-relevant AI research mentoring pilot, an academic documentation-cost study and NSF grant-review controls. Program intentions, proxy measurements and policy requirements remain distinct. Older and unknown source dates are explicit; no institution-wide productivity or autonomous-discovery claim. Role guidance addresses bounded pilots, reproducible artifacts and authorized data paths. Independent production measurements and research-administration benefit outcomes remain gaps.
- Evidence records
- 3
- Cross-source patterns
- 0
- Evidence classes
- 2 standards or public-body guidance1 academic research
- Outcomes
- 2 cautionary1 emerging
- Source freshness
- 2 undated1 older, newly relevant
- Research completed
- 2026-09-11
Choose a role to see its takeaway beside every record in the ledger.
Synthesis · Lighthouse Advisory interpretation
Patterns across the evidence
The evidence in this edition did not support a cross-source pattern. Each record below stands on its own.
Full record · every source keeps its link and limitations
Evidence ledger
CU Boulder pairs AI research exploration with mentoring; outcomes remain prospective
The university describes a mentored research pilot, without measured scientific or grant outcomes.
Why it matters, evidence and limitations
- Why it matters
- Direct public-university research-development relevance; other institutions need their own eligibility and support design.
- Evidence and measured results
- The nine-month pods offer a $1,500 stipend to eligible principal investigators. Applications close September 10 at 11:59 p.m. Mountain Time. No comparison group, completion sample or benefit measurement is reported.
- Limitations and uncertainty
- Program description, not an evaluation. Event date denotes the application deadline, not launch or completion. Classification reflects guidance rather than evidence of effectiveness.
Reproducibility study separates documentation quality from actual reproduction cost
Documentation scoring reveals barriers to reuse but cannot establish actual reproduction time or scientific validity.
Why it matters, evidence and limitations
- Why it matters
- Useful for university artifact-review services; the international publication sample is not a U.S. institutional deployment evaluation.
- Evidence and measured results
- The study analyzes 918 empirical papers from 1,061 sampled across seven venues in 2022–2024. A second review covers 46 papers. Expertise scoring was dropped for weak reliability; venue comparisons use documentation rubrics, not timed reproductions.
- Limitations and uncertainty
- Older anonymous manuscript, not the inaccessible journal version. One primary reviewer and limited second review constrain inference. No causal estimate of checklist effectiveness or measured labor savings. Screenshot failed; PDF text, tables and limitations were readable.
NSF guidance distinguishes proposal assistance from confidential merit review
NSF prohibits reviewers from uploading proposal and review content to non-approved generative AI tools.
Why it matters, evidence and limitations
- Why it matters
- Directly relevant to university researchers serving as NSF reviewers; this is not a universal rule for every sponsor.
- Evidence and measured results
- The notice encourages disclosure of proposal-development AI use and retains proposer responsibility for accuracy and authenticity. It supplies policy requirements, not measured workload or compliance outcomes.
- Limitations and uncertainty
- Foundational 2023 notice re-inspected today, not a new 2026 prohibition. No efficacy sample or baseline. This edition does not resolve every sponsor's current requirements.
How to read this edition
Source findings, measured results and limitations come from the cited publications. Patterns, operating questions, role takeaways and implementation considerations are Lighthouse Advisory interpretation, stated as questions to validate locally rather than guaranteed outcomes. Vendor and operator claims are labeled as claims. Full research method.
- Standards or public-body guidance
- Normative or advisory guidance from a standards body or public institution.
- Academic research
- Research produced through an academic institution or peer-reviewed venue.