From the Student Success edition of October 24, 2026
Preprint: university students report uneven generative AI skill growth, with academic gains reported more for assignments than exams (313 survey responses, 18 interviews)
Lei Fan and Fangxue Liu (preprint authors) · Higher education student generative AI skills and learning outcomes · Not stated on the abstract page
- Publisher
- arXiv
- Original publication
- arXiv preprint 2610.30599, submitted 22 October 2026
- Source retrieved
- 2026-10-25
What happened
A preprint submitted 22 October examined how university students perceive their generative AI skill development, using a retrospective questionnaire (313 analysed responses) and interviews with 18 students across subject areas. Trajectories varied: 34.2 percent reported rapid early improvement then a plateau, 28.4 percent steady improvement and 21.1 percent delayed acceleration. Evaluating AI outputs was perceived as the hardest skill to improve, and assignments were the most frequently selected driver of growth. Interviews described more specific prompting, tailored verification and selective delegation, but some students reported stable routines, dependence, skipped reasoning or gains partly due to better tools. Academic gains were reported more often for assignments than examinations. Structural equation modelling showed a positive indirect association between perceived skill growth and academic gains through adapted assignment processes; gains did not clearly differ across trajectory groups after multiplicity correction.
Why it matters
Points AI literacy programmes at output evaluation, the skill students find hardest, and warns that assignment gains may not carry over to exams.
Evidence and measured results
Mixed-methods preprint with retrospective self-report and exploratory SEM; not peer reviewed.
Limitations and uncertainty
Preprint; self-reported, retrospective data; setting not stated on the abstract page; associations only.
Put this evidence to work
Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-10-25; this does not change the original publication date. Each role follows the same checklist so takeaways compare across sources.
Sales
Role takeaway
- Customer problem
- AI literacy efforts may not teach students to evaluate AI outputs, and assignment gains may mask weak exam learning.
- Stakeholders
- Provost office AI literacy lead
- Center for teaching and learning
- Library instruction
- Assessment office
- Discovery questions
- Does AI literacy content teach output verification?
- Are assignment and exam outcomes compared for AI-heavy courses?
- Where is AI literacy embedded in coursework?
- Value hypothesis
- Interpretation: assignment-embedded verification practice may build the AI skill students find hardest.
- Potential engagement
- A bounded mapping of AI literacy outcomes onto assignments in two or three programmes, with a verification focus.
- Unsupported claims
- That findings are peer reviewed
- That AI skill growth causes academic gains
- That results apply to a specific country or institution type
Pre-sales engineering
Role takeaway
- Fit
- Institutions running AI literacy modules or campus AI tools for coursework.
- Architecture and integration
- Literacy activities in the LMS that capture evidence of checking and source comparison.
- Prerequisites
- Defined verification learning outcomes
- Assignment and exam data for comparison
- Constraints
- Preprint status
- Self-reported data
- Unstated setting
- Security
- Collect reflections and activity data with consent; avoid storing student AI conversations unnecessarily.
- Proof of value
- Compare assignment and exam performance for the same students
- Measure verification behaviour in activities
- Track students who plateau early
Delivery
Role takeaway
- Work
- Embed AI output-verification tasks in assignments and evaluate effects on assignment and exam outcomes.
- Dependencies
- Instructor buy-in
- Teaching-centre support
- Assessment data
- Ownership
- Center for teaching and learning with programme leads.
- Skills and adoption
- Students practise verification and selective delegation; instructors learn to assess verification evidence.
- Governance checkpoints
- Outcome definitions approved by programmes
- Mid-term review
- End-of-term comparison before scaling
- Acceptance criteria
- Proposed: verification tasks embedded in at least one assignment per pilot course
- Proposed: assignment and exam results compared
- Proposed: student reflections collected on dependence
- Risks
- Relying on preprint findings
- Self-report bias in evaluation
- Adding workload without clear payoff
Implementation considerations
Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.
Architecture and integration
What must connect, and where does the AI sit in the workflow?
Not applicable; no specific tool studied.
Governance
Who approves, reviews and stays accountable for outcomes?
Assessment design that relies on assignments may overstate learning when AI is used; exam and assignment outcomes should be compared.
Security and privacy
What data, permissions and controls need testing?
Not discussed on the abstract page.
Accessibility and workforce
Who is affected, and what skills or accommodations follow?
Uneven skill trajectories suggest some students need more structured support to learn verification, relevant to equitable AI literacy.
Procurement
What should contracts, pricing and exit terms secure?
None directly.
Operating model
Which teams own the service once it runs?
AI literacy could be built into assignments, which students named as the main driver of skill growth.
Publication history
- 2026-10-24Student Success · Issue 455 resources
Stable resource ID: arxiv-genai-skill-development-trajectories-academic-adaptation-university-students-20261022