{"resourceId":"arxiv-hou-ems-ai-integration-chiwork-20260615","versions":[{"version":"external-553260e728591e9af68dfb464ac74aace13dfa72e36399ae86591d8b43b005d1","resource":{"id":"arxiv-hou-ems-ai-integration-chiwork-20260615","title":"CHIWORK’26/arXiv: From 911 to Hospital—25 U.S. EMS clinicians on AI opportunities and coordination risks","organization":"Wellesley College / University of New Hampshire / University of Haifa (Hou et al.)","sector":"EMS clinical operations / human-centered AI","geography":"United States (multi-agency EMS clinicians; US-system situated)","publishedAt":"2026-06-15","publicationDate":"2026-06-15","eventDate":"2026-06-22","sourceName":"arXiv HTML (CHIWORK ’26 proceedings)","sourceLabel":"Peer-conference paper (CHIWORK ’26) via arXiv HTML: EMS clinician interview study on AI integration","sourceUrl":"https://arxiv.org/html/2606.16984","evidenceClass":"academic-research","outcomeClass":"cautionary","topics":["knowledge-work","accessibility-workforce","operating-model","data-security","developers-agents"],"finding":"Hou et al. (CHIWORK ’26; arXiv:2606.16984, submitted 15 June 2026) report semi-structured interviews with 25 U.S. EMS clinicians (EMTs, AEMTs, paramedics/chiefs; municipal/private/volunteer) on technology use and AI readiness. Clinicians describe information degradation from 911→field→hospital, cognitive overload with “fall to the level of training,” and coordination via shared mental models. Regarding AI, major concern themes include legal/privacy/HIPAA and liability (e.g., 13/25 HIPAA uncertainty; 9/25 liability), technical integrity/hallucinations (19/25), human-centric limits, threats to autonomy/skill erosion, and workflow friction (15/25 cognitive load). Preferred AI uses skew to transcription, protocol support, documentation, dose checks, and report generation rather than authoritative diagnosis. Authors propose five design principles centered on distributed cognition, SA across Endsley levels, autonomy preservation, acuity-adaptive interaction, and offline-first failure modes. Limitations: interviews not observation; U.S.-only; hypothetical AI not deployed systems.","sledRelevance":"Strong EMS-stream evidence on where AI may help versus where it threatens life-safety coordination—directly informs SLTT EMS AI procurement and design constraints.","evidence":"IRB-approved qualitative interview study (n=25) with reflexive thematic analysis (Cohen’s κ=0.89 on coding sample); counts are participant-theme frequencies, not clinical outcome trials.","architectureImplications":"Favor auditory/zero-touch capture, multi-channel redundancy (radio/MDT/phone), acuity-responsive prompting, and offline-first core functions; avoid centralized diagnostic AI that collapses team SA.","governanceImplications":"Liability remains with clinicians if AI protocol advice is wrong; HIPAA/training-data concerns require clear DPAs and non-surveillance uses of performance analytics.","securityPrivacyImplications":"Participants doubt AI data security (“never secure”); rural connectivity failure destroys trust; design must include graceful degradation and local data control.","caveats":"Perceptions of hypothetical AI; not a performance benchmark; U.S. EMS staffing model; self-reported theme counts; first author has EMS field experience (positionality disclosed).","streamIds":["emergency-services"],"roles":{"sales":"Use Hou et al.’s 25-clinician CHIWORK study to reframe EMS AI deals around documentation, protocol scaffolding, and dose/double-check assists—not diagnostic authority. Discovery should surface liability fears, HIPAA/training-data worries, rural offline needs, and which workflow stages crews refuse to automate. Bounded engagement: co-design a low-acuity documentation/transcription pilot with override UX and offline mode. Unsupported claims include outcome improvements, autonomous triage, or replacing paramedic judgment.","engineering":"Architect EMS AI as distributed-cognition support: speech transcription, protocol step tracking, vitals trend display with uncertainty, and offline-first medication/protocol tools. Prerequisites include ePCR/CAD integration rights, noisy-audio ASR robustness, and acuity modes that go silent on high-acuity calls. Constraints include on-scene visual/manual resource competition; clinicians in this study reject front-of-patient voice AI and ambient error-monitoring concepts as unsafe operational fits in the field.","delivery":"Deliver stage-gated pilots starting after hospital handoff for reports and training before any on-scene advisory features; train partners that AI is consultant not authority; instrument override rates and connectivity failures carefully. Ownership: EMS medical direction for clinical AI policy; operations chiefs for device workflow. Risks: skill erosion in novices, liability ambiguity, and trust collapse after the first offline failure in the field."},"roleDetails":{"sales":{"customerProblem":"EMS leaders want AI help with documentation and cognitive load without losing clinical autonomy or creating liability traps.","stakeholders":["EMS chiefs/medical directors","Paramedics/EMTs","Billing/QA","Privacy/compliance"],"discoveryQuestions":["Which stages are in-scope for AI?","What happens when connectivity drops?","Who is liable for AI-suggested protocols?","Is patient-facing voice AI acceptable?"],"valueHypothesis":"Transcription/protocol/documentation AI can reduce after-call burden if HITL and offline modes are real—not if AI asserts diagnoses.","potentialEngagement":"6–8 week discovery+prototype for offline-capable draft ePCR from speech with mandatory clinician edit.","unsupportedClaims":["Improved survival from AI","Autonomous field diagnosis","HIPAA-safe by default vendor AI"]},"engineering":{"fit":"Assistive AI for transcription, protocols, documentation, dose checks; not authoritative diagnosis.","architectureIntegration":"Radio/MDT/ePCR/vitals → optional AI assist with auditory-first UX and offline cache.","prerequisites":["Integration rights","Noisy-audio ASR tests","Acuity mode switch","Audit trail of AI suggestions"],"constraints":["On-scene visual load","Rural connectivity","Clinician liability remains"],"security":"Minimize cloud training on PHI; explicit retention; local fallback when link drops.","proofOfValue":["Edit-distance on draft reports","Override rate","Offline success rate"]},"delivery":{"work":"Pilot after-call documentation AI first; expand only with medical-direction approval and offline drills.","dependencies":["Medical direction","ePCR vendor","Training academy","Privacy officer"],"ownership":"Medical director owns clinical AI policy; shift supervisors own field use rules.","skillsAdoption":"Teach AI-as-consultant; practice working without AI on high-acuity scenarios.","governanceCheckpoints":["PHI DPA review","Acuity-mode acceptance","Monthly override audit"],"acceptanceCriteria":["Mandatory human edit before submit","Documented offline mode","No diagnostic auto-orders"],"risks":["Skill erosion","Liability confusion","Trust loss after outage"]}},"retrievedAt":"2026-10-01T22:07:40-05:00","enrichedAt":"2026-10-01T22:07:40-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Highlights training dependence under stress and risks of skill erosion/over-reliance especially for less experienced clinicians; favors AI that supports learning in low-acuity modes.","procurementImplications":"Buy against clinician-stated must-nots (no ambient surveillance, no diagnostic assertion, offline-first) and require audit trails plus liability clarity in contracts.","operatingModelImplications":"Keep recognition-primed, protocol-driven team coordination central; AI should augment shared SA, not insert opaque analytical deliberation at the recognition-to-action point.","sourceVerification":{"responseId":"curl-arxiv-hou-ems-20261001T220740","openedUrl":"https://arxiv.org/html/2606.16984","referenceExcerpt":"We conducted semi-structured interviews with 25 EMS clinicians across the United States","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}