{"resourceId":"ijemst-msu-khanmigo-socratic-ai-tutor-undergraduate-algebra-quasi-experiment-20261022","versions":[{"version":"external-8cba347fef78224875f090718374e7c29e1374043f0c5722d5a0677da7bc5866","resource":{"id":"ijemst-msu-khanmigo-socratic-ai-tutor-undergraduate-algebra-quasi-experiment-20261022","title":"Michigan State study: assigning Khanmigo activities raised AI-tutor use in undergraduate algebra, and use predicted grades after controlling for prior GPA (n=58)","organization":"Michigan State University (study authors); Khan Academy (Khanmigo tool)","sector":"Higher education AI tutoring in gateway mathematics","geography":"East Lansing, Michigan, United States","publishedAt":"International Journal of Education in Mathematics, Science and Technology, Early View, published 22 October 2026","publicationDate":"2026-10-22","eventDate":null,"sourceName":"International Journal of Education in Mathematics, Science and Technology","sourceLabel":"Peer-reviewed journal article (abstract and metadata)","sourceUrl":"https://doi.org/10.46328/ijemst.8772","evidenceClass":"academic-research","outcomeClass":"emerging","topics":["knowledge-work","operating-model"],"finding":"Michigan State University researchers evaluated undergraduate algebra students' use of Khanmigo, a Socratic generative AI tutor, in a quasi-experimental mixed-methods study (n=58) using survey, registrar, grade and software-usage data. One section was assigned four Khanmigo activities across the semester; the comparison section had access and only an introductory activity. Students in the assigned section held significantly more chats (Wilcoxon rank-sum, p<0.05). Instrumental help seeking correlated positively with use, while intentions to seek help from technology sources correlated negatively. Khanmigo use significantly predicted mathematics grades after controlling for prior GPA and course section. Most students used it for homework help and exam preparation; lack of visuals and the Socratic design limited perceived usefulness for some. The authors conclude that integrating the tutor into class activities and setting expectations may improve effective use.","sledRelevance":"Directly relevant to gateway-math student success: it suggests that uptake of an institution-provided AI tutor depends on assigning it within the course, not just licensing it.","evidence":"Small two-section quasi-experiment at one US public university, combining usage logs, registrar data, grades and surveys. Association with grades, not a randomized effect.","architectureImplications":"Uses a commercial tutor alongside the course; usage logs were linked with registrar and grade data for analysis. Interpretation: evaluating similar pilots needs log export and record linkage agreed with the vendor in advance.","governanceImplications":"Not described in the abstract: consent, data sharing with the vendor or policy on use in assessed work.","securityPrivacyImplications":"Linking tutor logs to registrar and grade data requires research approval and data-handling controls; specifics are not in the abstract.","caveats":"n=58 across two sections; non-random assignment; the grade association could reflect motivation. Only the abstract was inspected.","streamIds":["student-success"],"roles":{"sales":"Sales framing: this study supports a narrow claim that embedding an AI tutor in course activities increases use, and that use was associated with better algebra grades after controlling for prior GPA. Use it to ask institutions how gateway-course faculty integrate licensed tutors and whether they track usage. A bounded engagement could design and evaluate assigned tutor activities in one gateway course. Do not claim it proves the tutor caused higher grades; it is a 58-student quasi-experiment.","engineering":"Engineering framing: the evaluation depended on linking tutor usage logs with registrar records and grades. Check whether the tutor platform exports per-student usage, how identities are matched to the student information system, and what data the vendor retains. Proof of value should compare assigned and access-only sections on usage and grades while controlling for prior GPA, and should test whether the text-only Socratic design meets the needs of students who rely on visuals.","delivery":"Delivery framing: the practical lesson is that faculty need to assign tutor activities, not just announce access. Delivery work would help instructors embed a few required activities, set expectations on use for homework and exam preparation, and collect usage and grade data each term. Track uptake by section and by student group, gather feedback on usefulness, and review results with the mathematics department before expanding to other gateway courses."},"roleDetails":{"sales":{"customerProblem":"Licensed AI tutors in gateway math courses go unused unless faculty build them into coursework.","stakeholders":["Mathematics department chair","Gateway-course instructors","Center for teaching and learning","Institutional research"],"discoveryQuestions":["Which gateway courses have AI tutor access, and how many students use it?","Do instructors assign tutor activities or only announce access?","Can usage be linked to grades for evaluation?"],"valueHypothesis":"Interpretation: assigning a few tutor activities can raise use, and use may be associated with better grades in gateway math.","potentialEngagement":"A one-term design-and-evaluation pilot of assigned AI tutor activities in a single gateway math course.","unsupportedClaims":["That Khanmigo causes higher grades","That results generalize beyond one university and 58 students","Any retention or completion effect"]},"engineering":{"fit":"Institutions with or considering licensed AI tutors in mathematics.","architectureIntegration":"Vendor tutor used alongside the LMS, with usage logs linked to registrar and grade data for analysis.","prerequisites":["Per-student usage export from the tutor","Identity matching to the student information system","Research or data-use approval"],"constraints":["Small single-institution sample","Text-only Socratic design","Vendor data terms not described"],"security":"Minimize linked fields, restrict access to the analysis dataset and confirm vendor retention and deletion terms.","proofOfValue":["Compare usage between assigned and access-only sections","Model grades controlling for prior GPA","Survey usefulness, including need for visuals"]},"delivery":{"work":"Embed a small set of required AI tutor activities in a gateway math course and evaluate use and outcomes.","dependencies":["Instructor design time","Tutor licence and log access","Institutional research support"],"ownership":"Mathematics department with the center for teaching and learning.","skillsAdoption":"Instructors learn to write tutor activities and set expectations; students are shown how to use the tutor for practice rather than answers.","governanceCheckpoints":["Data-use approval before linking records","Mid-term usage review","End-of-term outcome review before expansion"],"acceptanceCriteria":["Proposed: assigned sections show higher tutor use than access-only sections","Proposed: grade comparison controls for prior GPA","Proposed: usefulness feedback collected from at least half of students"],"risks":["Low uptake if activities are optional","Misreading association as causation","Design not suited to students who need visuals"]}},"retrievedAt":"2026-10-25T03:21:20Z","enrichedAt":"2026-10-25T03:25:36Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Some students found the Socratic, text-only design less useful (lack of visuals), which matters for learners who need worked examples or visual explanation.","procurementImplications":"Interpretation: a tutor licence alone may not drive use; contracts should include usage-data access for evaluation.","operatingModelImplications":"Instructors embedding a small number of required activities was associated with greater use, implying faculty design time is part of the cost.","sourceVerification":{"openedUrl":"https://doi.org/10.46328/ijemst.8772","referenceExcerpt":"Khanmigo use did significantly predict mathematics grades after controlling for prior GPA and course section.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}