{"resourceId":"colorado-genai-strategy-measured-outcomes-2026","versions":[{"version":"external-400a5008597f5a1851b257745b0a44646640bddb999214baae116409d7d849ba","resource":{"id":"colorado-genai-strategy-measured-outcomes-2026","title":"Colorado GenAI strategy reports measured UI wait-time cuts, training savings, and Gemini scale-up","organization":"Colorado Governor's Office of Information Technology (OIT)","sector":"State government — GenAI strategy, workforce productivity, benefits/contact-center operations","geography":"Colorado (transferable as measured state GenAI operating evidence; not a multi-state RCT)","publishedAt":"OIT Statewide GenAI Strategy lessons-learned page (metrics as of Feb–May 2026; retrieved 2026-09-19)","publicationDate":null,"eventDate":null,"sourceName":"Colorado OIT — Explore Colorado's Statewide GenAI Strategy 1.0","sourceLabel":"State CIO / OIT strategy publication","sourceUrl":"https://oit.colorado.gov/standards-policies-guides/guide-to-artificial-intelligence/explore-colorados-statewide-genai","evidenceClass":"government-evaluation","outcomeClass":"mixed","topics":["knowledge-work","accessibility-workforce","operating-model","governance-procurement"],"finding":"Colorado OIT's GenAI strategy lessons-learned page reports statewide scale and selected service metrics: 6,447 executive-branch employees using Google Gemini after training as of May 2026; 281 GenAI use cases as of February 2026 (220 approved; 125 in production); and self-reported success that 80% of production cases met or exceeded team expectations through October 2025. Highlighted operating results include a CDLE Unemployment Insurance virtual agent that cut average wait times 50% over six months (36 to 11 minutes) and reduced live-agent request share from 80% to 55%, plus an HCPF Medicaid contact-center GenAI training platform (Bright) that cut new-hire classroom time 40% (five to three weeks), with QA scores 97.8–99.2% and an estimated $350,000 annual savings. Mixed: metrics are agency-reported, not an independent audit, and the page still labels overall success as mixed while steering clear of unsupervised agentic decisions affecting residents.","sledRelevance":"Provides scarce measured state-government GenAI operating outcomes (wait times, training duration, workforce tool adoption) under an explicit risk-assessment and human-in-the-loop posture—useful benchmarks for CIO/GovOps peers still stuck at pilot announcements.","evidence":"OIT page: 6,447 Gemini users (May 2026) after prerequisite training; Feb 2026 portfolio 281 use cases / 220 approved / 125 production / 61 not approved; 80% of production cases met/exceeded expectations through Oct 2025; CDLE UI agent wait 36→11 minutes (−50%) over six months and live-agent requests 80%→55%; HCPF Bright training 5→3 weeks (−40%), QA 97.8–99.2%, ~$350k annual savings estimate; risk process with executive review for high-risk cases; avoids unsupervised agentic AI for resident-impacting decisions.","architectureImplications":"Pairs enterprise Gemini for staff work with selective GenAI virtual agents and training simulators behind authentication/self-service boundaries; keeps human-in-the-loop for consequential resident decisions and avoids unsupervised agentic paths—architecture that separates productivity copilots from high-risk automation.","governanceImplications":"Statewide GenAI policy plus risk assessment with executive review for high-risk uses creates an approval funnel (78% approved; some prohibited). Strategy 1.0 framing is compliance/risk-first while noting a shift toward measurable productivity in Strategy 2.0 materials.","securityPrivacyImplications":"Emphasizes preserving trust and data security for the UI virtual agent and training-before-access for Gemini; does not publish detailed threat models or independent security attestation on this page.","caveats":"Agency self-reporting; no independent auditor validation of wait-time, QA, or savings figures on this page. Publication date not stamped; metrics dated Feb–May 2026 / through Oct 2025. Colorado UI randomized fact-finding sandbox already in archive is a different study—do not conflate. Curl to oit.colorado.gov returned 403 from the research host; page opened via HTTPS WebFetch.","streamIds":["state-government"],"roles":{"sales":"Sales framing: Colorado is one of the few states publishing concrete GenAI operating metrics—UI wait times halved, Medicaid agent training shortened 40%, and 6,400+ trained Gemini users—under a formal risk gate. Engage state CIO/OIT, labor/benefits ops, and contact-center leaders who need outcome evidence beyond pilot surveys. Offer a bounded measurement-and-risk-review against Colorado's published indicators—not a promise to replicate 36-to-11-minute waits. Unsupported: that every state's contact center will hit the same percentages or that metrics were independently audited.","engineering":"Engineering framing: Fit is governed staff GenAI (Gemini-class) plus selective authenticated virtual agents and training simulators, with human oversight for resident-impacting decisions. Integrate use-case intake, risk tiers, training-before-access, and telemetry for wait time / containment / QA. Prerequisites: identity for self-service agents, approved-tool tenancy, and evaluation hooks for production cases. Constraints: Colorado-specific stack (Google Workspace/Gemini); metrics are self-reported; unsupervised agentic paths explicitly disfavored for high-stakes decisions.","delivery":"Delivery framing: Work is portfolio governance (intake → risk review → production monitoring) plus targeted service bots/training tools with named outcome KPIs. Ownership sits with OIT for enterprise Gemini/policy and agencies (CDLE/HCPF) for service metrics. Acceptance should include verified wait-time/training baselines, training-completion gates, and documented human-in-the-loop rules—not slideware alone. Risks: metric cherry-picking; shadow GenAI outside the 281-case inventory; over-extending virtual agents into eligibility decisions."},"roleDetails":{"sales":{"customerProblem":"State executives need published GenAI service and workforce metrics—not only pilots—to justify scale-up under risk governance.","stakeholders":["State CIO / OIT","Labor/UI and Medicaid operations leaders","Contact-center directors","Budget/performance offices"],"discoveryQuestions":["Which contact-center or workforce KPIs will you remeasure after GenAI go-live?","What share of GenAI use cases clear your risk gate into production?","Is training mandatory before enterprise Gemini/Copilot access?","Where is unsupervised agentic automation explicitly prohibited?"],"valueHypothesis":"A 4–6 week outcome-baseline and risk-gate review patterned on Colorado's published indicators can separate scalable staff/self-service uses from high-risk automation.","potentialEngagement":"Measurement sprint: map current wait-time/training/adoption baselines, align risk tiers, and design a production scorecard comparable to Colorado's public metrics.","unsupportedClaims":["Guaranteed replication of 50% UI wait-time reduction","Independent audit confirmation of Colorado's figures","That Gemini is optimal for every state's productivity stack"]},"engineering":{"fit":"Governed enterprise GenAI for staff productivity plus selective authenticated virtual agents and agent-training simulators—not open-ended agentic decision systems.","architectureIntegration":"Wire identity-backed self-service agents to claim-status data; keep eligibility determinations with humans; instrument wait time, containment, and QA; enforce training-before-access for Gemini-class tools.","prerequisites":["Use-case inventory and risk-tier taxonomy","Enterprise IdP and data-minimization for status bots","Survey/telemetry pipeline for production outcome claims"],"constraints":["Self-reported metrics without external audit on this page","Google Workspace/Gemini-centric rollout path","High-risk resident decisions remain human-supervised"],"security":"Status-bot and training-simulator deployments need strict data scopes, logging, and prohibition of uploading sensitive case content to consumer GenAI tools.","proofOfValue":["Before/after wait-time and live-agent request rates","Training-duration and QA score deltas","Share of use cases approved vs prohibited with rationale"]},"delivery":{"work":"Stand up GenAI intake/risk review, scale trained staff access, and deliver targeted UI/training bots with KPI owners.","dependencies":["OIT enterprise tooling and policy","CDLE/HCPF operations owners","Training vendor (e.g., InnovateUS literacy; Bright for HCPF)","Identity and telephony/IVR integration partners"],"ownership":"OIT for statewide Gemini/policy; agency program owners for service KPIs; executives for high-risk approvals.","skillsAdoption":"Need GenAI literacy plus contact-center analytics and risk-assessment skills—not only prompting workshops.","governanceCheckpoints":["Risk review before production","Periodic portfolio recount (approved/in-production/prohibited)","KPI refresh for live service bots"],"acceptanceCriteria":["Documented human-in-the-loop rules for resident-impacting uses","Published or internal KPI pack with baselines","Training attestation before enterprise tool access"],"risks":["Over-claiming unaudited metrics","Shadow GenAI outside inventory","Mission creep from status bots into adjudicative decisions"]}},"retrievedAt":"2026-09-19T22:04:30-05:00","enrichedAt":"2026-09-20T03:09:32+00:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Gemini scale-up after mandatory-style prerequisite training expands workforce GenAI literacy; UI self-service may improve access for callers needing status updates but does not itself prove accessibility compliance for residents with disabilities.","procurementImplications":"Highlights procured training platforms (Bright) and enterprise Gemini under existing Workspace terms; peers should bake outcome KPIs and risk-assessment cooperation into GenAI vendor agreements.","operatingModelImplications":"Shows a dual model: broad staff copilots behind training gates, plus selective resident-facing self-service bots, all inside a statewide use-case risk funnel that still rejects some proposals.","sourceVerification":{"openedUrl":"https://oit.colorado.gov/standards-policies-guides/guide-to-artificial-intelligence/explore-colorados-statewide-genai","referenceExcerpt":"The agent reduced UI wait times by 50% over a six-month period","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}