{"resourceId":"arxiv-navier-stokes-lost-in-translation-lean-autoformalisation-20261006","versions":[{"version":"external-4f03683b3f1b25d5ecf5a37176de9c9e2801ea44a27d4dc2edb55c505e2a2a48","resource":{"id":"arxiv-navier-stokes-lost-in-translation-lean-autoformalisation-20261006","title":"\"Navier-Stokes lost in translation\": mathematicians show the Lean formalisation of OpenAI's announced Navier-Stokes blow-up proof does not correspond to the natural-language proof, so compiling Lean code is not verification of the paper","organization":"Alexander Bastounis, Fabian Circelli and Anders C. Hansen (arXiv preprint; reported by TechCrunch as Cambridge and King's College London mathematicians)","sector":"Academic research (mathematics, formal verification)","geography":"United Kingdom authors; international relevance","publishedAt":"Submitted to arXiv 6 October 2026 (v1)","publicationDate":"2026-10-06","eventDate":"2026-10-06","sourceName":"arXiv","sourceLabel":"arXiv:2610.08144 [math.AP], Bastounis, Circelli and Hansen, \"Navier-Stokes lost in translation: Why Lean verification of AI autoformalisation does not guarantee correct natural language proofs\", v1 6 October 2026","sourceUrl":"https://arxiv.org/abs/2610.08144","evidenceClass":"academic-research","outcomeClass":"cautionary","topics":["knowledge-work","developers-agents","governance-procurement"],"finding":"The preprint argues that AI autoformalisation (translating a natural-language proof into Lean so it can be machine-checked) may give no confidence in the original argument, because semantically faithful translation requires resolving ambiguities in mathematical text, a problem the authors place arbitrarily high in the Solvability Complexity Index hierarchy (informally, harder than the Halting problem). It gives worked examples of AI mistranslations, including a chatbot that turned a wrong natural-language proof into a different, correct Lean proof that compiles. Applied to OpenAI's announced Navier-Stokes blow-up result, the authors show the Lean formalisation does not correspond to the natural-language proof, including cases where the paper declares stronger statements than Lean proves; they also discuss OpenAI's Euler result. They explicitly make no claim about whether OpenAI's natural-language proof is correct, only that the Lean \"verification\" does not establish it.","sledRelevance":"Universities and journals are starting to accept \"it compiles in Lean\" as evidence for AI-generated results. This paper shows why institutions, reviewers and research-integrity offices should treat formal verification of AI output as necessary but not sufficient, which matters for any research unit adopting AI theorem provers or autoformalisation agents. It is newly relevant because Tao's 22 October Nature piece frames verification and understanding as the central problem.","evidence":"Opened the arXiv /abs/ page (v1, submitted 6 Oct 2026; 25 pages, 4 figures) and the HTML full text, reading the introduction, the mistranslation examples (section 2), the Navier-Stokes and Euler analyses (section 3) and the discussion of why Lean offers no safety net for mistranslation, including the disclaimer that the authors make no claim on the correctness of OpenAI's natural-language proof.","architectureImplications":"Verification pipelines for AI-generated mathematics need a semantic-fidelity step (human or tool-assisted alignment of formal statements to the claimed theorem) and machine-readable links between informal and formal artefacts.","governanceImplications":"Journals, departments and funders should not treat compiling formal proofs of AI output as peer review; the authors conclude such proofs need the same scrutiny as others.","securityPrivacyImplications":"None directly; the integrity risk is misplaced trust in automated verification.","caveats":"Preprint, not peer reviewed; written by critics of the autoformalisation approach in a contested area. It does not show the underlying result is false. The theoretical impossibility claim is about the general case; practical tools may still catch many mistranslations. Published 6 October, before the last research edition, and included because of its direct bearing on the 22 October debate.","streamIds":["research"],"roles":{"sales":"Lead with the limits of automated verification. This preprint shows the Lean formalisation of OpenAI's announced Navier-Stokes proof does not match the natural-language proof, so a compiling formal proof did not verify the paper. Research-integrity officers, journal editors at university presses and mathematics chairs need review practices that account for this. A bounded engagement designs a review checklist for AI-generated or AI-formalised results. Interpretation: it is an unreviewed preprint that does not show the result false, so it cannot support claims that AI mathematics is unreliable.","engineering":"Frame the fit as a verification pipeline with a semantic check. The paper shows AI autoformalisers can produce Lean code that compiles but proves something different from the stated theorem. Pre-sales should explore tooling that links informal statements to formal ones, flags weaker formal statements, and routes them to expert review. Interpretation: the source demonstrates the failure mode, not a fix, and its impossibility result concerns the general case, so any proof-of-value must test real departmental workflows.","delivery":"Treat delivery as adding a statement-fidelity checkpoint to AI-assisted research review. Work includes defining when formal proofs are required, assigning expert reviewers to compare formal statements with claimed theorems, and recording links between artefacts. A research-integrity lead or department review committee owns it. Interpretation: acceptance should be based on review coverage and documented fidelity checks, because the paper establishes risk, not the effectiveness of any mitigation."},"roleDetails":{"sales":{"customerProblem":"Institutions and editors may over-trust AI-generated results that \"compile\" in a proof assistant even when the formal statement differs from the claim.","stakeholders":["Research integrity officer","Mathematics or computer science department chair","University press or journal editor","Formal-methods research group lead"],"discoveryQuestions":["Do your review processes accept formal verification as sufficient evidence?","Who checks that formal statements match the claimed theorem?","Are AI-formalised results labelled as such?"],"valueHypothesis":"A statement-fidelity checkpoint could prevent retractions or disputes over AI-generated results that were formally \"verified\" against the wrong statement.","potentialEngagement":"A focused review-process design producing a checklist and workflow for AI-generated or AI-formalised results in one department or journal.","unsupportedClaims":["OpenAI's result is false","All autoformalisation is unreliable","Formal verification has no value"]},"engineering":{"fit":"Fits groups using Lean or other proof assistants with AI autoformalisation.","architectureIntegration":"Insert a statement-alignment and review step between autoformalisation output and acceptance, with stored links between natural-language and formal artefacts.","prerequisites":["Proof-assistant expertise","Access to formal artefacts for AI-generated results","Reviewer time"],"constraints":["Preprint not peer reviewed","General-case impossibility does not quantify practical error rates","Tooling for semantic alignment is immature"],"security":"Integrity rather than security: log provenance of AI-produced formal code and who reviewed statement fidelity.","proofOfValue":["Re-review a sample of AI-formalised results for statement fidelity","Measure how often formal statements are weaker than claimed","Test reviewer time per result"]},"delivery":{"work":"Define formal-proof requirements, add expert fidelity review and record artefact links for AI-assisted results.","dependencies":["Expert reviewers in mathematics and formal methods","Repository support for linked artefacts"],"ownership":"Research integrity lead or departmental review committee.","skillsAdoption":"Reviewers need training to compare formal statements with natural-language theorems.","governanceCheckpoints":["Policy approval that formal verification alone is insufficient","Reviewer assignment for each AI-assisted result","Periodic audit of fidelity checks"],"acceptanceCriteria":["Proposed: every AI-formalised result has a documented fidelity review","Proposed: mismatches logged and resolved before publication","Proposed: reviewer turnaround within an agreed time"],"risks":["Reviewer capacity shortfall","False confidence from partial checks","Contested expert judgments"]}},"retrievedAt":"2026-10-23T05:32:51-05:00","enrichedAt":"2026-10-23T05:32:52-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Expert human reviewers remain essential; institutions need people able to read both the mathematics and the formal code.","procurementImplications":"Claims by AI vendors that results are \"formally verified\" should be scrutinised for statement fidelity before being relied upon.","operatingModelImplications":"Formal verification becomes one checkpoint in a human-led review process rather than a replacement for it.","sourceVerification":{"openedUrl":"https://arxiv.org/abs/2610.08144","referenceExcerpt":"we show that the formalised Lean proof does not correspond to the NL proof of blow-up of solutions to the Navier-Stokes equations.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}