From the Emergency Services edition of October 1, 2026
CHIWORK’26/arXiv: From 911 to Hospital—25 U.S. EMS clinicians on AI opportunities and coordination risks
Wellesley College / University of New Hampshire / University of Haifa (Hou et al.) · EMS clinical operations / human-centered AI · United States (multi-agency EMS clinicians; US-system situated)
- Publisher
- arXiv HTML (CHIWORK ’26 proceedings)
- Original publication
- 2026-06-15
- Source retrieved
- 2026-10-02
- Event date
- 2026-06-22
What happened
Hou et al. (CHIWORK ’26; arXiv:2606.16984, submitted 15 June 2026) report semi-structured interviews with 25 U.S. EMS clinicians (EMTs, AEMTs, paramedics/chiefs; municipal/private/volunteer) on technology use and AI readiness. Clinicians describe information degradation from 911→field→hospital, cognitive overload with “fall to the level of training,” and coordination via shared mental models. Regarding AI, major concern themes include legal/privacy/HIPAA and liability (e.g., 13/25 HIPAA uncertainty; 9/25 liability), technical integrity/hallucinations (19/25), human-centric limits, threats to autonomy/skill erosion, and workflow friction (15/25 cognitive load). Preferred AI uses skew to transcription, protocol support, documentation, dose checks, and report generation rather than authoritative diagnosis. Authors propose five design principles centered on distributed cognition, SA across Endsley levels, autonomy preservation, acuity-adaptive interaction, and offline-first failure modes. Limitations: interviews not observation; U.S.-only; hypothetical AI not deployed systems.
Why it matters
Strong EMS-stream evidence on where AI may help versus where it threatens life-safety coordination—directly informs SLTT EMS AI procurement and design constraints.
Evidence and measured results
IRB-approved qualitative interview study (n=25) with reflexive thematic analysis (Cohen’s κ=0.89 on coding sample); counts are participant-theme frequencies, not clinical outcome trials.
Limitations and uncertainty
Perceptions of hypothetical AI; not a performance benchmark; U.S. EMS staffing model; self-reported theme counts; first author has EMS field experience (positionality disclosed).
Put this evidence to work
Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-10-01; this does not change the original publication date. Each role follows the same checklist so takeaways compare across sources.
Sales
Role takeaway
- Customer problem
- EMS leaders want AI help with documentation and cognitive load without losing clinical autonomy or creating liability traps.
- Stakeholders
- EMS chiefs/medical directors
- Paramedics/EMTs
- Billing/QA
- Privacy/compliance
- Discovery questions
- Which stages are in-scope for AI?
- What happens when connectivity drops?
- Who is liable for AI-suggested protocols?
- Is patient-facing voice AI acceptable?
- Value hypothesis
- Transcription/protocol/documentation AI can reduce after-call burden if HITL and offline modes are real—not if AI asserts diagnoses.
- Potential engagement
- 6–8 week discovery+prototype for offline-capable draft ePCR from speech with mandatory clinician edit.
- Unsupported claims
- Improved survival from AI
- Autonomous field diagnosis
- HIPAA-safe by default vendor AI
Pre-sales engineering
Role takeaway
- Fit
- Assistive AI for transcription, protocols, documentation, dose checks; not authoritative diagnosis.
- Architecture and integration
- Radio/MDT/ePCR/vitals → optional AI assist with auditory-first UX and offline cache.
- Prerequisites
- Integration rights
- Noisy-audio ASR tests
- Acuity mode switch
- Audit trail of AI suggestions
- Constraints
- On-scene visual load
- Rural connectivity
- Clinician liability remains
- Security
- Minimize cloud training on PHI; explicit retention; local fallback when link drops.
- Proof of value
- Edit-distance on draft reports
- Override rate
- Offline success rate
Delivery
Role takeaway
- Work
- Pilot after-call documentation AI first; expand only with medical-direction approval and offline drills.
- Dependencies
- Medical direction
- ePCR vendor
- Training academy
- Privacy officer
- Ownership
- Medical director owns clinical AI policy; shift supervisors own field use rules.
- Skills and adoption
- Teach AI-as-consultant; practice working without AI on high-acuity scenarios.
- Governance checkpoints
- PHI DPA review
- Acuity-mode acceptance
- Monthly override audit
- Acceptance criteria
- Mandatory human edit before submit
- Documented offline mode
- No diagnostic auto-orders
- Risks
- Skill erosion
- Liability confusion
- Trust loss after outage
Implementation considerations
Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.
Architecture and integration
What must connect, and where does the AI sit in the workflow?
Favor auditory/zero-touch capture, multi-channel redundancy (radio/MDT/phone), acuity-responsive prompting, and offline-first core functions; avoid centralized diagnostic AI that collapses team SA.
Governance
Who approves, reviews and stays accountable for outcomes?
Liability remains with clinicians if AI protocol advice is wrong; HIPAA/training-data concerns require clear DPAs and non-surveillance uses of performance analytics.
Security and privacy
What data, permissions and controls need testing?
Participants doubt AI data security (“never secure”); rural connectivity failure destroys trust; design must include graceful degradation and local data control.
Accessibility and workforce
Who is affected, and what skills or accommodations follow?
Highlights training dependence under stress and risks of skill erosion/over-reliance especially for less experienced clinicians; favors AI that supports learning in low-acuity modes.
Procurement
What should contracts, pricing and exit terms secure?
Buy against clinician-stated must-nots (no ambient surveillance, no diagnostic assertion, offline-first) and require audit trails plus liability clarity in contracts.
Operating model
Which teams own the service once it runs?
Keep recognition-primed, protocol-driven team coordination central; AI should augment shared SA, not insert opaque analytical deliberation at the recognition-to-action point.
Publication history
- 2026-10-01Emergency Services · Issue 265 resources
Stable resource ID: arxiv-hou-ems-ai-integration-chiwork-20260615