{"resourceId":"ozden-weekly-ai-reflection-asee-2026","versions":[{"version":"external-4e1dd32b95511caa6de258d7b5650dd4a8ecc30780c39f7ae16e80075f77b431","resource":{"id":"ozden-weekly-ai-reflection-asee-2026","title":"ASEE 2026: weekly AI-use reflections foster evaluative literacy in first-year engineering design","organization":"Pennsylvania State University Abington","sector":"Higher education / academic research","geography":"United States (first-year engineering design; transferable with limits)","publishedAt":"2026","publicationDate":null,"eventDate":null,"sourceName":"ASEE PEER","sourceLabel":"ASEE 2026 Annual Conference paper (Paper ID #51764)","sourceUrl":"https://peer.asee.org/reflecting-with-ai-integrating-weekly-ai-use-reflections-to-foster-critical-and-ethical-ai-literacy-in-first-year-engineering-design.pdf","evidenceClass":"academic-research","outcomeClass":"emerging","topics":["accessibility-workforce","operating-model","knowledge-work","governance-procurement"],"finding":"Optional Weekly AI Use Reflection in EDSGN 100 (Fall 2025; two sections, N=42) with peer replies produced preliminary thematic evidence that participating students moved from passive information-seeking toward more evaluative, metacognitive GenAI use (verification, troubleshooting, prompting comparison). Early explicit ethics talk was limited; analysis is exploratory and non-causal.","sledRelevance":"Offers a low-stakes, scalable AI-literacy practice U.S. engineering and first-year programs can pair with technical help-seeking scaffolds when ambient GenAI is already permitted.","evidence":"Qualitative thematic analysis of weekly posts/peer replies by instructor-researcher; planned second-cycle coding; no randomized learning endpoints.","architectureImplications":"Lightweight discussion board or LMS reflection prompt alongside permitted GenAI; no need for embedded CAD AI—process is pedagogic, not a new model stack.","governanceImplications":"Keep AI use permitted with citation/verification norms; treat findings as design inspiration pending stronger coding reliability and learning measures.","securityPrivacyImplications":"Reflections may describe proprietary project details—de-identify before research use; warn students not to upload copyrighted course materials to consumer AI.","caveats":"Optional bonus credit self-selection; preliminary single-coder analysis; single campus course; no retention/grade measures.","streamIds":["student-success"],"roles":{"sales":"For first-year experience and engineering education buyers, this ASEE 2026 paper shows that a low-stakes weekly AI-use reflection with peer replies can move students from passive information-seeking toward more evaluative GenAI habits in design coursework. Sell discovery around literacy routines that complement tutor technology rather than replace teaching. Bounded engagement is a one-semester reflection pilot with midterm thematic review—not a guaranteed AI-literacy or grade transformation.","engineering":"Engineering takeaway: implement a weekly structured reflection schema (document use, evaluate accuracy/usefulness, peer reply) in the LMS; optional theme tags for analytics—no new inference stack required. Prerequisites include a clear course AI policy and discussion tooling. Constraints: qualitative, preliminary external evidence only. Security: block uploads of licensed CAD or course files to consumer models. Proof of value: coded shift toward verification language plus optional knowledge checks.","delivery":"Delivery work: add optional weekly AI reflection prompts, train instructors on light facilitation, sample themes mid-semester, and decide whether to make the activity required. Dependencies include LMS admins and FYE/engineering faculty. Ownership sits with the course coordinator partnered with teaching-and-learning. Skills: qualitative memoing. Governance: academic-integrity alignment of the AI policy. Acceptance: sustained participation and documented evaluative language growth; risks include self-selection and thin early ethics talk."},"roleDetails":{"sales":{"customerProblem":"Students use GenAI in design courses without structured practice evaluating outputs or ethics.","stakeholders":["FYE/engineering education","teaching & learning","integrity office"],"discoveryQuestions":["Is GenAI already permitted in first-year design?","Do you require reflection on AI use, or only ban/allow rules?","How will you sample themes without grading reflections harshly?"],"valueHypothesis":"Bounded value: add weekly AI-use reflection to build evaluative habits before scaling tutoring bots.","potentialEngagement":"One-semester optional-to-required reflection pilot with midterm theme review—not a learning-outcome guarantee.","unsupportedClaims":["Causal proof of deeper learning","Guaranteed ethics competence","Transfer to all majors without redesign"]},"engineering":{"fit":"Fits as LMS discussion/assignment pattern alongside existing GenAI permissions.","architectureIntegration":"Weekly prompt template + peer-reply requirement + optional theme tags/export.","prerequisites":["LMS discussion or journal tool","Course AI policy","Instructor facilitation time"],"constraints":["Qualitative preliminary evidence","Self-selection if optional","Single-course context"],"security":"Remind students not to paste proprietary/copyrighted assets into consumer AI; de-identify research exports.","proofOfValue":["Participation continuity across weeks","Coded increase in verification language","Peer-reply quality samples"]},"delivery":{"work":"Author prompts, launch optional bonus then evaluate requiring it, sample themes, refine ethics prompts.","dependencies":["Faculty","LMS support","Integrity guidance"],"ownership":"Course coordinator with teaching-and-learning partner.","skillsAdoption":"Short faculty workshop on facilitating AI-use dialogue without policing.","governanceCheckpoints":["AI policy alignment","Grading weight decision","Research ethics if publishing student text"],"acceptanceCriteria":["Documented theme memo mid and end of term","Decision memo on scaling beyond engineering design"],"risks":["Self-selection bias","Thin ethics discussion","Instructor dual-role coding bias"]}},"retrievedAt":"2026-09-29T03:19:08Z","enrichedAt":"2026-09-29T03:21:30Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Low-stakes written reflection can support reflective practice for diverse learners but needs alternative formats for students who cannot sustain weekly text posts.","procurementImplications":"No new GenAI procurement required; invest facilitation time before buying literacy platforms that duplicate LMS journals.","operatingModelImplications":"Pair literacy reflections with technical help-seeking scaffolds so culture and tooling reinforce evaluative GenAI use.","sourceVerification":{"responseId":"curl-asee-peer-51764","openedUrl":"https://peer.asee.org/reflecting-with-ai-integrating-weekly-ai-use-reflections-to-foster-critical-and-ethical-ai-literacy-in-first-year-engineering-design.pdf","referenceExcerpt":"reflective and discussion-based AI activities can support students in moving beyond surface-level tool use toward more deliberate, context-aware engagement with AI.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}