{"resourceId":"atlanta-311-resident-experience-study-2025","versions":[{"version":"external-053748c761ca039e89a29db2b329349493ba1c4740bd5959d84040dc2339742f","resource":{"id":"atlanta-311-resident-experience-study-2025","title":"Atlanta 311 study identifies gaps in request interpretation and case visibility","organization":"Georgia Institute of Technology researchers","sector":"Municipal resident services","geography":"Atlanta, Georgia, United States","publishedAt":"June 13, 2025, arXiv version 1","publicationDate":"2025-06-13","eventDate":null,"sourceName":"arXiv / DIS 2025 paper","sourceLabel":"Academic qualitative study of a deployed 311 chatbot","sourceUrl":"https://arxiv.org/html/2506.12259v1","evidenceClass":"academic-research","outcomeClass":"cautionary","topics":["knowledge-work","developers-agents","data-security","accessibility-workforce","operating-model"],"finding":"Residents encountered interpretation problems and insufficient visibility into request handling.","sledRelevance":"Historical U.S. municipal evidence newly added to test resident access beyond answer accuracy; it does not describe current Atlanta performance.","evidence":"Researchers analyzed 144 survey comments from January 2023–April 2024 and 16 interviews using task walkthroughs and thematic analysis. Tables describe participants and design concerns. The case concerns a keyword-based chatbot; proposed LLM improvements were not tested.","architectureImplications":"Interpretation: Validate the connection between conversational intake, jurisdiction lookup, CRM records and work-order status before adding agent actions.","governanceImplications":"Interpretation: Give residents a way to contest closure and identify the accountable service team.","securityPrivacyImplications":"Interpretation: Test authorization for case-status access; avoid exposing individual reports when aggregating neighborhood issues.","caveats":"Small, single-city qualitative sample skewed toward civic engagement. No causal benefit estimate or evaluation of a replacement LLM.","streamIds":["local-government"],"roles":{"sales":"Interpretation: A 311 director, public works manager, CIO and resident-access lead can investigate repeat contacts and opaque case status. Ask whether a resident can correct an address, identify the responsible agency and challenge an unresolved closure. A bounded engagement could trace one common request category across channels. The value hypothesis is fewer avoidable repeat contacts and clearer accountability. Do not promise call deflection or infer current failure rates from this historical qualitative case. For a smaller municipality, first check whether it has enough staff and records-system access to operate an additional channel.","engineering":"Interpretation: Fit is strongest for an assistant backed by reliable service records. Map address validation, category selection, identity checks, CRM creation and work-order updates. Use approved synthetic cases to test jurisdiction boundaries, incomplete descriptions, duplicate reports and stale status. If adding an LLM, compare it with the existing interface rather than assuming it resolves the observed problems. Limit write permissions during the trial and exercise human handoff. Proposed validation should measure successful task completion and recovery across channels, including screen-reader use. The study supplies no cloud, on-premises or hybrid performance comparison.","delivery":"Interpretation: The 311 operations owner should jointly pilot the workflow with a receiving department, records staff and accessibility specialists. Establish baseline completion and repeat-contact measures, train agents to recover failed submissions, and review resident feedback before expansion. Dependencies include authoritative status data and staff empowered to reopen cases. Proposed acceptance: every test request reaches its intended owner, status matches the work-order record, and failed intake can be recovered without lost information. Set a local task-completion target before testing. These are future criteria. Risks include improving conversational polish while unresolved service work remains invisible."},"retrievedAt":"2026-09-13T03:00:44Z","enrichedAt":"2026-09-13T03:03:31Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Interpretation: Recruit less engaged residents and people needing language or assistive support; retain staffed alternatives.","procurementImplications":"Interpretation: Require demonstrations of completed resident tasks and usable case handoff in acceptance testing.","operatingModelImplications":"Interpretation: Assign ownership of unresolved requests separately from ownership of the chatbot platform.","updateExplanation":"Absent from all 247 archive resources checked at offsets 0, 100 and 200, plus targeted related-finding search. Historical source newly added; no substantive update or post-last-run development is claimed.","sourceVerification":{"openedUrl":"https://arxiv.org/html/2506.12259v1","referenceExcerpt":"Citizens with lower interest or involvement in civic issues may hold different expectations","promptVersion":"sled-research-v3.1","model":null,"basis":"agent-reported inspection"}}}]}