{"resourceId":"vermont-ads-jitoc-anthropic-sltt-response-20261007","versions":[{"version":"external-ca08556179cfef88aeed4fda9db423f9fe499cf1f35fd2484ebb062d983fac87","resource":{"id":"vermont-ads-jitoc-anthropic-sltt-response-20261007","title":"Vermont ADS tells JITOC it will apply Bulletin 3.5 waivers to future AI trials, is not using Claude Security or Mythos, and has used about 10% of a $100,000 Anthropic credit","organization":"Vermont Agency of Digital Services (Secretary/CIO Denise Reilly-Hughes; Chief Data and AI Officer Josiah Raiche)","sector":"State IT cybersecurity code review and AI evaluation oversight","geography":"Vermont statewide (executive-branch ADS)","publishedAt":"2026-10-07","publicationDate":"2026-10-07","eventDate":"2026-10-07","sourceName":"Vermont General Assembly / Agency of Digital Services","sourceLabel":"ADS Response to SLTT (Denise Reilly-Hughes letter and Attachment A Q&A posted to JITOC, dated Oct 7, 2026; Attachment A dated Oct 6, 2026)","sourceUrl":"https://legislature.vermont.gov/Documents/2026/Workgroups/JITOC/Agency%20of%20Digital%20Services/W~Denise%20Reilly-Hughes~ADS%20Response%20to%20SLTT~10-7-2026.pdf","evidenceClass":"government-evaluation","outcomeClass":"mixed","topics":["developers-agents","data-security","governance-procurement","operating-model"],"finding":"On Oct 7, 2026, ADS posted formal answers to the Joint Information Technology Oversight Committee on its June 2026 Anthropic SLTT evaluation. Secretary/CIO Denise Reilly-Hughes says ADS entered a six-month evaluation to examine state system code for security and operational weaknesses; the evaluation is limited to system code and no personal information or Vermonters’ data has been reviewed. ADS did not bid, request a Bulletin 3.5 waiver, or treat the agreement as a procurement at signing, but after consulting the Secretary of Administration it will use the Bulletin 3.5 waiver process for trials and evaluations going forward. CDAO Josiah Raiche writes Vermont is not using Claude Security and does not use or have access to Claude Mythos; developers use the Claude Code plugin in VS Code with Sonnet, Opus, or Fable by application size, after a two-day in-person training. Sonnet/Opus prompts are not retained; Fable retains prompts and attached code up to 30 days for misuse review. All generated code goes through standard release review before production. ADS is using the Azure-hosted LLM, has used about 10% of the $100,000 credit allocation, and will add the use case to the state’s AI Inventory at the evaluation’s conclusion. Authorization was signed by the then-serving CISO and reviewed by ADS General Counsel and the CDAO.","sledRelevance":"Primary-source answers to legislative oversight on a free frontier-AI cybersecurity trial: procurement classification, model choice, data retention, human release review, and a prospective process change (Bulletin 3.5 waivers for future trials). Transferable as a template for how other states document SLTT-style evaluations under legislative scrutiny, with Vermont-specific Bulletin 3.5 and inventory rules as jurisdictional limits.","evidence":"Opened the Oct 7 ADS Response PDF from the JITOC documents page (Denise Reilly-Hughes cover letter, Raiche memorandum, Attachment A Q&A dated Oct 6) via curl and pdftotext. Confirmed listing on https://legislature.vermont.gov/committee/document/2026/345/Date/10-7-2026. Cross-checked Compass Vermont reporting (already archived) and the signed evaluation agreement posted the same day.","architectureImplications":"Claude Code runs as a VS Code plugin against folders on the developer’s machine; samples of code and file structure are shared with Anthropic APIs for orientation, threat modeling, and vulnerability suggestions. ADS uses Azure-hosted LLM access. Model tier scales with codebase size (Sonnet/Opus/Fable). Claude Security is not used because it requires whole-codebase access outside the existing stack.","governanceImplications":"ADS reframes future AI trials as Bulletin 3.5 waiver matters after legislative challenge, while defending the original non-procurement characterization. Ongoing oversight is framed as use-case guardrails and AI Inventory/use-case review (NIST-informed) rather than only tool listing. Authorization was CISO signature plus counsel and CDAO review—not Secretary of Administration or AG Bulletin 3.5 approvals.","securityPrivacyImplications":"ADS asserts no Vermonter personal data in the evaluation and that Mythos/Claude Security are not in use. Fable retention (up to 30 days of prompts and attached code) is accepted for large codebases; Sonnet/Opus have no retention. Threat-model outputs are treated as highly sensitive and shared with ADS Security when significant issues appear.","caveats":"Agency self-report under oversight pressure, not an independent audit. No count or severity of vulnerabilities found, no measured remediation outcomes, and no confirmation whether Fable was used on state code. Attachment A is dated Oct 6 while the cover letter is Oct 7. The agreement title/services include Claude Security even though ADS says it is not used—see companion contract resource.","streamIds":["state-government"],"roles":{"sales":"Vermont’s formal JITOC answers show oversight closing in on free AI security trials: the CIO now says future trials will go through Bulletin 3.5 waivers, developers stay in the loop, and Mythos/Claude Security are off the table. Pitch evaluation packages that already include waiver paperwork, model-tier and retention disclosures, Azure hosting clarity, and release-review evidence—not just credits. Do not claim vulnerability-reduction results; ADS reports process and ~10% credit use, not outcomes.","engineering":"Architecture is Claude Code in VS Code on local folders, Azure-hosted models, human-applied patches through SDLC. Design for least-capable model by app size, explicit non-use of whole-repo scanners if they don’t fit the stack, and retention differences (Sonnet/Opus vs Fable). Log which model touched which repo segment and keep threat-model artifacts under security control.","delivery":"Treat SLTT-style trials as oversight events: assemble Bulletin/waiver path, counsel review, CISO/CDAO sign-off, training completion lists, and a plan to enter the AI Inventory when the trial ends. Update release-review capacity before volume rises. Acceptance should include documented human review of AI-generated patches and a clear statement of which models and retention settings were authorized."},"roleDetails":{"sales":{"customerProblem":"Legislators are questioning free frontier-AI cybersecurity trials that skipped formal procurement paperwork.","stakeholders":["State CIO / ADS leadership","JITOC or equivalent IT oversight committee","Secretary of Administration / procurement","CISO and CDAO","Agency general counsel"],"discoveryQuestions":["Was the AI trial processed under procurement bulletins or treated as a non-procurement evaluation?","Which models and retention settings are authorized, and is Mythos or whole-repo scanning in scope?","What human release-review steps sit between AI-suggested patches and production?","When will the use case appear on the public AI inventory?"],"valueHypothesis":"Documented, waiver-ready evaluation packages with model and retention controls can satisfy oversight while still testing AI code review.","potentialEngagement":"A time-boxed evaluation readiness review that maps a proposed SLTT trial to Bulletin-style waiver and inventory steps.","unsupportedClaims":["Measured reduction in vulnerabilities or mean-time-to-remediate from the Vermont trial","That Claude Security or Mythos were used in Vermont","That Bulletin 3.5 was followed for the original June agreement"]},"engineering":{"fit":"Fits agencies evaluating AI-assisted code review in test/dev with human SDLC gates.","architectureIntegration":"VS Code plugin + Azure-hosted LLM; share limited folders; scale Sonnet/Opus/Fable by app size; keep Claude Security optional if stack-incompatible.","prerequisites":["Developer training","Counsel review of vendor privacy/security terms","Security channel for sensitive threat-model outputs"],"constraints":["No personal data in scope","Local folder access model","Fable 30-day retention on large apps","Vermont Bulletin 3.5 and inventory rules are jurisdiction-specific"],"security":"Prefer zero-retention models where workable; treat threat-model docs as sensitive; confirm no Vermonter PII leaves the evaluation boundary.","proofOfValue":["Sample of AI-suggested findings with human disposition recorded","Confirmation of model tier and retention setting per repo","Release ticket showing human review before production"]},"delivery":{"work":"Run a governed AI code-review evaluation with training, waiver/procurement path, and inventory close-out.","dependencies":["Procurement/admin waiver process","Security Division review capacity","Updated SDLC for higher patch volume"],"ownership":"ADS (CIO/CDAO/CISO), with legislative oversight visibility.","skillsAdoption":"Two-day developer orientation plus Pathfinder ethics training for non-technical sponsors.","governanceCheckpoints":["Pre-trial counsel and leadership sign-off","Model and retention authorization recorded","AI Inventory entry at trial end"],"acceptanceCriteria":["Proposed: every production patch from the trial has a named human reviewer","Proposed: waiver or equivalent procurement documentation filed for new trials","Proposed: inventory entry lists vendor, free credit, and data-sharing status"],"risks":["Oversight finds paperwork gaps mid-trial","Contract scope includes tools the agency says it is not using","Retention on higher-tier models expands code exposure"]}},"retrievedAt":"2026-10-08T22:30:22-05:00","enrichedAt":"2026-10-08T22:30:22-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Two-day in-person developer training and Pathfinder training for non-technical staff frame AI as human-operated power tools; ADS says it does not deploy autonomous agents. Staffing levels are not discussed.","procurementImplications":"Free $100,000 token credit via Anthropic’s SLTT program was treated as a non-procurement evaluation; ADS now commits to Bulletin 3.5 waivers for similar trials. Attachment C and AA-14 were not used. Vendors and agencies should expect legislative demand for competitive-process documentation even on zero-dollar AI evaluations.","operatingModelImplications":"Code-review workflow: orientation → threat model → vulnerability scan → developer-chosen Claude Code patches → SDLC release review (being updated for higher volume). Security Division is looped in for significant findings. Inventory entry deferred until evaluation ends.","sourceVerification":{"responseId":"curl-vt-ads-response-20261008","openedUrl":"https://legislature.vermont.gov/Documents/2026/Workgroups/JITOC/Agency%20of%20Digital%20Services/W~Denise%20Reilly-Hughes~ADS%20Response%20to%20SLTT~10-7-2026.pdf","referenceExcerpt":"ADS will use the Bulletin 3.5 waiver process for trials and evaluations going forward.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}