{"resourceId":"ncsu-ai-rubric-teacher-workshop-2026","versions":[{"version":"external-37d88648be4784f7c9eefb88624ff0824fcddc3bfd84e2b2e8456101072f856a","resource":{"id":"ncsu-ai-rubric-teacher-workshop-2026","title":"Teacher rubric study identifies editing friction behind promising drafts","organization":"North Carolina State University researchers","sector":"K–12 education","geography":"United States; middle- and high-school teacher workshop","publishedAt":"March 11, 2026; workshops June–July 2025","publicationDate":"2026-03-11","eventDate":null,"sourceName":"AI-Generated Rubric Interfaces: K–12 Teachers’ Perceptions and Practices","sourceLabel":"Original academic preprint","sourceUrl":"https://arxiv.org/html/2603.10773v1","evidenceClass":"academic-research","outcomeClass":"mixed","topics":["knowledge-work","governance-procurement","accessibility-workforce","operating-model"],"finding":"Teachers valued rubric drafts but reported alignment and editing problems; favorable perceptions do not establish assessment validity.","sledRelevance":"Interpretation: Older original evidence newly relevant to fall teacher-copilot evaluation, extending earlier review coverage with a specific authoring workflow.","evidence":"A 25-teacher workshop used manual rubric creation, MagicSchool.ai and chatbot feedback on programming tasks, with surveys and thematic analysis. Editing criteria received a reported mean 2.75 on a five-point scale.","architectureImplications":"Interpretation: Make criteria, weights and version history editable before export. This concerns teaching programming, not developer productivity or autonomous agent effectiveness; no cloud/on-premises/hybrid comparison is provided.","governanceImplications":"Interpretation: Keep a teacher approval step and test scoring agreement independently of satisfaction.","securityPrivacyImplications":"Interpretation: Use synthetic work until transcript handling, retention and supplier reuse are approved.","caveats":"Small workshop preprint, not a randomized classroom impact trial. Post-survey item denominators are not explicit; Table 1 block-programming counts and percentages are inconsistent. No measured net time savings, retained learning or verified fairness. NSF support is disclosed.","streamIds":["k12"],"roles":{"sales":"Interpretation: Assessment directors and teacher-development leads need to know whether a rubric assistant reduces total work while preserving instructional intent. Ask how long drafting, revising and moderating currently take, which criteria are hardest to express, and whether exports survive the existing learning platform. Offer a bounded authoring pilot in one subject. The value hypothesis is a more usable draft-to-approval process. The workshop's perceived usefulness cannot substantiate guaranteed savings, unbiased grading or student learning gains.","engineering":"Interpretation: Use a representative task set with approved reference rubrics and deliberately flawed student examples. Compare human-only preparation with assisted drafting plus review, measuring final rubric quality and total elapsed effort separately. Prerequisites include editable outputs and fixed model/configuration records. Check unauthorized student-data flows, accessible exports and whether point totals change unexpectedly after revisions. Proposed validation requires all seeded critical rubric errors to be found before classroom release. This extends the study's limited workshop evidence through local testing.","delivery":"Interpretation: The assessment coordinator should recruit teachers and a moderation partner, secure preparation time and train reviewers to challenge plausible criteria. Privacy and accessibility approval precede live student data. Proposed acceptance requires each pilot rubric to retain a final teacher sign-off, completed independent moderation, revision-time records and a documented continuation decision. Include less experienced teachers in support planning. Risks include polishing language while missing curricular errors, shifting work into unpaid hours and confusing willingness to adopt with sustained use."},"retrievedAt":"2026-09-14T03:01:24Z","enrichedAt":"2026-09-14T03:04:02Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Interpretation: Include accessible rubric formats, grade-language checks and paid revision time.","procurementImplications":"Interpretation: Test editability and export in the actual licensed version; no evidence supports an automated-grading guarantee.","operatingModelImplications":"Interpretation: Assessment owners approve criteria while teachers remain accountable for feedback.","updateExplanation":"New canonical URL, absent from all 274 archive records retrieved at offsets 0, 100 and 200; related K12 coverage reviewed. Older background, not September 13 breaking news.","sourceVerification":{"openedUrl":"https://arxiv.org/html/2603.10773v1","referenceExcerpt":"the lowest mean in this category was for the tool’s support for adding, removing, or revising rubric criteria without difficulty","promptVersion":"sled-research-v3.2","model":null,"basis":"agent-reported inspection"}}}]}