Lighthouse AdvisorySLED AI Adoption Intelligence
← Back to results

From the State Government edition of September 11, 2026

Government evaluationMixedNewly relevant · Jul 2024

Missouri pilots show why technical accuracy can miss the operational target

Missouri Department of Transportation; High Street Consulting Group · State transportation · Missouri, United States

Publisher
MoDOT research report cmr 24-009
Original publication
July 2024; repository indexes July 1
Source retrieved
2026-09-12
Read original source

What happened

The median-inventory pilot missed operational precision and scope needs despite strong image metrics. Traffic factor grouping offered a more promising, partly prospective economic case.

Why it matters

Historical state-agency evidence newly inspected to qualify current AI scaling decisions; findings concern conventional ML, not generative copilots or autonomous agents.

Evidence and measured results

SparseInst used 1,100 annotated images and processed 10,000 tiles; reported mean pixel accuracy was 99.4% and correct-area prediction 93%. The $80,000 median pilot compared with an estimated $61,110 manual year, plus estimated six-to-nine-month correction work. AADT clustering/classification used 170 continuous stations and 19,828 short-term sites. Its $45,000 toolbox still needed estimated $10,000–$30,000 integration; projected savings compared with a richer performance-based manual process, not the minimal existing approach.

Limitations and uncertainty

June 2022–June 2024 project. Contractor findings, not a standard. Imagery covered southern Missouri; engineering precision was inadequate. Costs and counterfactual labor are estimates, not causal savings. Held-out performance details remain unclear.

Put this evidence to work

Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-09-12; this does not change the original publication date. Labels below come from the analysis itself.

Sales

Role takeaway

For transport operations, GIS, finance and IT leaders, qualify whether the desired result is approximate planning information or a maintained engineering asset. Ask how often the decision repeats, what omissions cost, and who funds correction work. A bounded engagement could compare one inventory segment with a manual reference and a commercial service option. The value hypothesis is lower total cost per accepted asset, including labeling, review and integration. The mixed pilot supports careful qualification; it does not establish universal ML economics or current pricing. Keep recurrent traffic analysis separate from a one-time inventory when discussing potential value.

Pre-sales engineering

Role takeaway

Fit depends on the downstream tolerance, not an aggregate image score. Build a geographically separated test set, include narrow medians and complex interchanges, and assess missing features alongside false detections. Prerequisites are licensed imagery, trusted labels, versioned GIS schemas and a named subject expert. Select hosting only after profiling transfer, compute and storage needs. Validate dependency security and service-account scopes before warehouse integration. A proposed proof of value should measure accepted geometry, correction effort and complete task cost against manual work. Reproduce the factor-grouping baseline separately; traffic-planning judgments need their own validation and cannot inherit computer-vision results.

Delivery

Role takeaway

The asset owner should define acceptance and approve scope changes; GIS staff own labels and quality checks, while IT owns deployment and support. Start with a small mapped area and preserve manual fallback. Dependencies include imagery availability, annotation skills and capacity to investigate omissions. Train reviewers on difficult examples and record correction effort before expansion. Proposed acceptance criteria are an agreed spatial tolerance, a documented completeness threshold and a lower full cost per accepted asset than the local baseline. Review at pilot exit and after source-data changes. Risks include accepting attractive aggregate scores while losing the operational question or underfunding maintenance.

Implementation considerations

Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.

Architecture and integration

What must connect, and where does the AI sit in the workflow?

Set spatial tolerances and downstream system contracts before choosing models; evaluate batch processing and GIS integration locally. Cloud, on-premises and hybrid cost comparisons remain unestablished.

Governance

Who approves, reviews and stays accountable for outcomes?

Require service-owner approval when scope narrows; retain the original business question in the acceptance test.

Security and privacy

What data, permissions and controls need testing?

Authorize imagery and warehouse access, scan dependencies, control exports and document retention. No security certification follows from this evaluation.

Accessibility and workforce

Who is affected, and what skills or accommodations follow?

Test review tools with keyboard and assistive technology; budget specialist annotation and inspection time. No accessibility outcome was measured.

Procurement

What should contracts, pricing and exit terms secure?

Contract for accepted operational outputs, correction duties, source/code portability and support costs; avoid pricing solely per inference.

Operating model

Which teams own the service once it runs?

Give the business owner authority to stop a technically successful pilot that fails the agreed use.

What changed

No matching source or Missouri finding in 217 archive records retrieved at offsets 0, 100 and 200, or targeted Missouri search. Historical counterevidence extends the archive beyond recent generative-AI rollout claims; no new September result asserted.

Publication history

  1. 2026-09-11State Government · Issue 062 resources
Read preserved resource versions (JSON)

Stable resource ID: modot-ai-ml-pilot-operational-fit-2024