{"resourceId":"umd-vsa-study-guidance-forty-courses-provost-response-20261016","versions":[{"version":"external-ae22b8c58ae4f98d680bb320ebe2351cc93c5638eccf3064fb04aa8da5a3fe10","resource":{"id":"umd-vsa-study-guidance-forty-courses-provost-response-20261016","title":"UMD tells instructors in 40 VSA courses about its negative AI-tutor trial findings and issues guidance; provost says unguided access was not effective","organization":"University of Maryland College of Education, Division of Information Technology and Office of the Provost","sector":"Higher education teaching and learning / course-integrated AI tutoring","geography":"College Park, Maryland, United States","publishedAt":"UMD College of Education News (from Maryland Today), 16 October 2026","publicationDate":"2026-10-16","eventDate":null,"sourceName":"University of Maryland College of Education News","sourceLabel":"University release interpreting its own randomized study","sourceUrl":"https://education.umd.edu/news/10-16-26-study-suggests-more-guidance-needed-use-ai-course-assistants","evidenceClass":"academic-research","outcomeClass":"cautionary","topics":["operating-model","governance-procurement","knowledge-work"],"finding":"On 16 October UMD described what it is doing after its randomized trial of course-integrated virtual study assistants (VSAs), which involved 30 instructors and about 2,500 undergraduates from 11 of 12 schools in fall 2025. Forty courses currently have VSA access; instructors in all of them were informed of the findings and given best-practice guidance. The release restates that access was associated with lower final grades and substantially lower ELMS-Canvas engagement, with larger estimated effects for first-generation students, that only about 15% of students with access used the tool, and that access may have reduced office-hour attendance and time with instructors and peers. Lead author Jing Liu says students mostly asked for answers rather than using tutoring features. Provost Jennifer King Rice says making tools available without clear guidance was not effective, and proposes giving instructors usage feedback and steering students toward deeper engagement.","sledRelevance":"New since the archived RCT coverage: the institution's operational response (guidance to 40 courses, no campuswide rollout) and the provost's explicit diagnosis that unguided access failed. This is a current governance model for any campus enabling course AI tutors.","evidence":"Randomized trial summary (working paper already archived) plus institutional statements. Effects are associations from the trial; office-hour and peer-time effects are described as suggested by the findings. No new data beyond the paper are reported.","architectureImplications":"Interpretation: course AI tutors need instructor-facing usage telemetry and design that pushes tutoring modes (quizzes, feedback) over answer retrieval; the release proposes regular feedback to instructors on how students use the tool.","governanceImplications":"UMD held a campuswide rollout for evidence, informed all 40 instructors with access, and issued guidance; the provost frames evaluation-before-scale as institutional responsibility.","securityPrivacyImplications":"The release does not address data handling; archived reporting noted instructors could view chat logs, which may have shaped student use. Telemetry proposals need privacy review.","caveats":"Self-reported institutional interpretation of its own study; most students with access did not use the VSA yet effects were observed, so mechanisms are unclear; single university.","streamIds":["student-success"],"roles":{"sales":"For sales, the framing point is evaluation-led adoption rather than tool access. UMD informed instructors in all 40 VSA courses about negative trial findings, issued guidance, and its provost says unguided access was not effective. That supports discovery with provosts about guided deployment, telemetry and evaluation design before scale. Stay bounded: the evidence shows associations with lower grades and engagement at one university and cannot support claims that any AI tutor improves outcomes.","engineering":"Engineering's framing point is designing for use mode, not just availability. UMD found students mostly asked the VSA for answers and proposes regular instructor feedback on student usage. Pre-sales teams should check whether a tutor platform exposes per-course usage analytics, supports quiz and feedback modes, and can restrict answer-giving. Validation should compare engagement with existing course materials before and after enablement, given the archived trial's large LMS participation drop.","delivery":"Delivery's framing point is running AI tutor enablement as a governed pilot with measurement. UMD's response pairs instructor notification and guidance with a paused campuswide rollout. A delivery engagement would set course-level guidance, instructor dashboards, office-hour and LMS engagement tracking, and equity checks for first-generation students. Acceptance criteria below are proposals. Applicability is limited to course-integrated tutors comparable to UMD's VSA and institutions able to run controlled comparisons."},"roleDetails":{"sales":{"customerProblem":"Campuses are enabling course AI tutors without evidence that unguided access helps, and UMD's trial suggests it can hurt grades and engagement.","stakeholders":["Provost and vice provost for teaching","CIO / instructional technology","Centre for teaching and learning","First-generation student success leads","Faculty senate"],"discoveryQuestions":["How many courses already have AI tutor access, and what guidance came with it?","Can instructors see how students use the tool?","Which engagement and grade measures would show harm early?","Who decides on campuswide scale?"],"valueHypothesis":"Interpretation: a guided, measured deployment can reduce the risk of the negative effects UMD observed; benefits remain unproven.","potentialEngagement":"A bounded evaluation design and guidance package for existing AI tutor courses, with engagement and equity monitoring.","unsupportedClaims":["Guaranteed grade gains from AI tutors","That UMD's negative effects are inevitable everywhere","That guidance alone fixes the effects (untested)"]},"engineering":{"fit":"Fits institutions running course-integrated tutors on LMS-connected platforms that need instructor-facing usage visibility.","architectureIntegration":"Course-scoped VSA integrated with ELMS-Canvas; proposed regular instructor feedback on student usage; deployment designed to steer toward tutoring features.","prerequisites":["Per-course usage analytics","Configurable tutoring vs answer modes","LMS engagement baselines","IRB or evaluation approvals for comparisons"],"constraints":["Effects observed even among non-users, so mechanisms are unclear","Single-university evidence","Chat-log visibility may change student behaviour"],"security":"Define who can see student chats and usage telemetry, retention periods and FERPA basis before giving instructors dashboards.","proofOfValue":["Pre/post LMS engagement comparison in enabled courses","First-generation subgroup monitoring","Share of sessions using tutoring modes vs answer requests"]},"delivery":{"work":"Package instructor guidance, usage feedback and engagement/equity monitoring for courses with AI tutor access, with a gate before scale.","dependencies":["Provost's office","DIT / instructional technology","Teaching and learning centre","Institutional research"],"ownership":"Provost's office with instructional technology; instructors own course-level deployment.","skillsAdoption":"Instructors need training on framing the tutor for practice and feedback rather than answers; students need clear expectations.","governanceCheckpoints":["Evidence review before campuswide enablement","Mid-term engagement and equity check","Privacy review of telemetry dashboards"],"acceptanceCriteria":["Proposed: no decline in LMS engagement versus prior term baseline","Proposed: no widening first-generation grade gap","Proposed: majority of tutor sessions use practice or feedback modes"],"risks":["Students substitute AI answers for course activities","Reduced office-hour contact","Telemetry deters honest student use"]}},"retrievedAt":"2026-10-17T03:18:30Z","enrichedAt":"2026-10-17T03:23:56Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Larger estimated losses for first-generation students raise equity risk; reduced office-hour contact may hit students who most need human support.","procurementImplications":"Interpretation: buyers of AI tutors should require usage analytics for instructors, configurable tutoring modes and an evaluation plan before broad licensing.","operatingModelImplications":"Provost-led evaluation with DIT and education faculty; instructors are the control point for guidance and deployment.","sourceVerification":{"openedUrl":"https://education.umd.edu/news/10-16-26-study-suggests-more-guidance-needed-use-ai-course-assistants","referenceExcerpt":"Forty courses currently have access to these tools; instructors in all of them have been informed of the study findings","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}