{"resourceId":"discover-education-cmu-medical-students-genai-use-perceived-benefit-vs-self-reported-performance-20261024","versions":[{"version":"external-8cba347fef78224875f090718374e7c29e1374043f0c5722d5a0677da7bc5866","resource":{"id":"discover-education-cmu-medical-students-genai-use-perceived-benefit-vs-self-reported-performance-20261024","title":"Survey of 103 US medical students: more frequent generative AI use tracked higher perceived academic benefit but not self-reported exam performance or standing","organization":"Central Michigan University College of Medicine and co-authors (study authors)","sector":"Higher education (graduate medical education) student AI use and academic outcomes","geography":"Mount Pleasant, Michigan, United States","publishedAt":"Discover Education (Springer Nature), volume 5, article 1218, published 24 October 2026","publicationDate":"2026-10-24","eventDate":null,"sourceName":"Discover Education (Springer Nature)","sourceLabel":"Peer-reviewed open-access journal article","sourceUrl":"https://link.springer.com/article/10.1007/s44217-026-02350-8","evidenceClass":"academic-research","outcomeClass":"mixed","topics":["knowledge-work"],"finding":"A cross-sectional survey of medical students at a single US allopathic medical school (103 respondents; authors mainly at the Central Michigan University College of Medicine) asked whether generative AI usage frequency relates to perceived academic benefit and self-reported performance. More frequent users reported significantly greater perceived benefit (Spearman rho 0.69, 95% CI 0.57 to 0.78, P<0.001), but usage frequency was not correlated with self-reported exam performance (rho -0.02) or self-rated academic standing (rho -0.01). Over half (53.4 percent) used AI often or always for studying. The authors say the discrepancy is at least as likely to reflect measurement artifacts, such as a single global performance item and recall bias, as a real gap between perception and attainment. The study received no funding.","sledRelevance":"A caution for student-success teams that rely on student satisfaction or perceived benefit to judge AI study tools: perceived value may not show up in performance.","evidence":"Exploratory cross-sectional survey with correlations and Kruskal-Wallis tests; adjusted models in supplementary material.","architectureImplications":"Not applicable; no specific tool studied.","governanceImplications":"Interpretation: AI tool evaluations should pair perception surveys with objective, granular outcome data.","securityPrivacyImplications":"Not discussed beyond standard survey practice.","caveats":"Single school, self-selected respondents, cross-sectional, unmeasured confounders such as study hours and prior achievement, coarse self-reported performance measure.","streamIds":["student-success"],"roles":{"sales":"Sales framing: this survey warns against selling AI study tools on perceived benefit alone. More frequent users felt AI helped more, yet their self-reported exam results did not differ. Use it to ask institutions how they evaluate AI study tools and whether they link use to objective outcomes. A bounded engagement could design an evaluation that pairs usage data with course or exam scores. Do not claim AI fails to help medical students; the measures were coarse.","engineering":"Engineering framing: the study shows the limits of perception surveys. Any evaluation of campus AI study tools should capture usage telemetry and link it, with approval, to objective course or exam outcomes rather than a single self-reported item. Proof of value should control for prior achievement and study time, which this study could not measure, and compare before and after adoption where possible. Treat the result as a measurement lesson, not a tool verdict.","delivery":"Delivery framing: delivery teams evaluating AI study support should avoid relying on satisfaction scores. Define objective outcomes in advance, collect usage data with consent, and include covariates such as prior grades and study hours. Learning-support staff can use findings like these to talk with heavy AI users about whether their study habits are working. Report perceived benefit and measured outcomes side by side so leaders do not mistake one for the other."},"roleDetails":{"sales":{"customerProblem":"Institutions judge AI study tools by perceived benefit, which may not reflect performance.","stakeholders":["Associate dean for student affairs","Learning specialists","Assessment and evaluation office","Institutional research"],"discoveryQuestions":["How are AI study tools currently evaluated?","Can usage data be linked to objective course or exam scores?","Which covariates such as prior grades are available?"],"valueHypothesis":"Interpretation: pairing perception surveys with objective outcomes gives a truer picture of AI study tool value.","potentialEngagement":"A bounded evaluation-design engagement linking AI study tool use to objective outcomes in one programme.","unsupportedClaims":["That AI use does not improve performance","That findings apply beyond one medical school","Any causal effect"]},"engineering":{"fit":"Institutions evaluating campus-provided or student-chosen AI study tools.","architectureIntegration":"Survey data combined with usage telemetry and assessment records under data-use approval.","prerequisites":["Objective outcome measures defined","Usage telemetry or validated self-report","Data-use approval"],"constraints":["Cross-sectional design","Self-reported performance","Unmeasured confounders"],"security":"Link survey, usage and grade data only with approval, de-identify and restrict access.","proofOfValue":["Compare perceived benefit with objective scores","Control for prior achievement and study hours","Measure before and after adoption where possible"]},"delivery":{"work":"Build an evaluation plan for AI study support that reports perception and objective outcomes together.","dependencies":["Assessment data access","Survey instrument","Institutional research capacity"],"ownership":"Office of assessment and evaluation with learning-support staff.","skillsAdoption":"Learning specialists coach students to reflect on whether AI-assisted study habits improve results.","governanceCheckpoints":["Data-use approval","Instrument review before fielding","Results review before decisions on tools"],"acceptanceCriteria":["Proposed: objective outcomes defined before data collection","Proposed: perceived and measured results reported side by side","Proposed: covariates for prior achievement included"],"risks":["Mistaking perception for impact","Nonresponse bias","Overreacting to a null result from coarse measures"]}},"retrievedAt":"2026-10-25T03:21:22Z","enrichedAt":"2026-10-25T03:25:36Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Medical students are future clinicians; the authors stress helping them critically evaluate AI-assisted study practices.","procurementImplications":"Interpretation: vendor or campus claims based on perceived benefit surveys should be treated cautiously.","operatingModelImplications":"Suggests advising and learning-support staff discuss study strategies with heavy AI users rather than assume benefit.","sourceVerification":{"openedUrl":"https://link.springer.com/article/10.1007/s44217-026-02350-8","referenceExcerpt":"students who used AI more frequently perceived greater academic benefit, but this perception was not reflected in coarse, self-reported performance measures.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}