Historical prosecution experiment finds adverse recommendations despite exculpatory facts

Prosecutors, public defenders, legal supervisors and justice IT leaders need reliable assistance under heavy caseloads. Ask whether staff use open-ended memo prompts, which decisions the drafts influence, and how contradictory facts are reviewed. A bounded engagement could inventory one drafting workflow and develop an expert-adjudicated test set before any integration. The value hypothesis is discovering unsuitable uses and measuring review burden, not proving that automation improves charging decisions. Explain that repeated responses are not thousands of independent criminal cases. Do not claim current products have the same behavior or promise fewer wrongful prosecutions from a training package. Applicability depends on the actual model, task and local legal context.

Fit is an isolated evaluation of the proposed assistant, not automated charging. Preserve source documents, relevant approved legal references, model identifiers and prompt versions in an access-controlled environment. Prerequisites include attorney-created reference assessments and representative examples of missing elements and conflicting evidence. Repeat identical inputs to measure variability, then vary prompts and model versions deliberately. Compare assisted and unassisted reviewers because this study lacks a prosecutor baseline. Test whether a fluent draft draws attention away from exculpatory material. Cloud or local deployment does not itself solve this failure mode. Any agent integration needs separate permission boundaries around case updates, correspondence and filings.

A designated legal practice lead should coordinate prosecutors, defense-informed reviewers, paralegals, IT and privacy counsel. Map where drafts influence action, agree on permissible use, establish an unassisted baseline and conduct a reversible shadow evaluation. Train users on omission detection and escalation, with accessible review instructions.

Proposed acceptance

all test cases with decisive contradictory facts reach attorney review, every accepted recommendation records an independent rationale, and unresolved critical errors stop progression. These criteria are proposals rather than research results. Dependencies include protected review time and lawful access to case records. Risks include selective testing, automation bias, unstable outputs and treating better formatting as sound judgment.