Verification abundance, adjudication scarcity: what happens to mathematical knowledge when proof checking becomes free
Maher Kallel, Mohamed El Louadi
cs.AI
Aug 29, 2026 · v1
cs.LO
TL;DR
Analyzes an OpenAI corpus of ten machine-generated proofs shipped with Lean 4 certificates, measuring the human audit surface and bespoke definitions.
Abstract
In May 2026 an OpenAI model produced a counterexample to the Erdős unit distance conjecture. Five mathematicians published a human-verified version the same day, and the result entered the literature within weeks. In August 2026 the same laboratory published ten mathematical and theoretical computer science results, each accompanied by a machine-checkable Lean 4 certificate with no unproved steps. Four weeks later, one remained the subject of an unresolved dispute over whether its formalization meant what it claimed. We argue that this difference is structural. We distinguish three layers of verification: derivational validity, which a kernel checks; representational fidelity, whether the formal statement means the intended question; and epistemic significance. Only the first is mechanizable. Making it effectively free therefore does not eliminate verification work but shifts the burden to layers dependent on scarce expert attention. Measurements of the August corpus illustrate the shift. The kernel-checked proofs total 20.6 MB, while the statements requiring human audit total 55.6 KB, a ratio of 379 to 1. Yet those statements contain 218 bespoke definitions rather than relying on community-vetted ones. The audit surface is therefore small in volume but irreducibly expert. We argue that machine checking produces verification abundance while leaving adjudication scarce. We propose a six-category taxonomy of representational mismatch, a disclosure schema for machine-generated mathematical claims, and implications for software, cryptography, and regulated decision systems.
Problem
Machine-checkable proofs (e.g., Lean 4 certificates) make derivational checking essentially free, but this does not eliminate the human work of verifying that a formal statement means the intended informal question. The paper asks what happens to mathematical knowledge when proof checking becomes cheap while expert adjudication remains scarce.
Approach
Three layers of verification are distinguished: derivational validity (kernel-checkable), representational fidelity (expert-checked), and epistemic significance. The authors measure the openai/ten-proofs Lean 4 repository, comparing proof-corpus size against statement-corpus size and counting local definitions. They connect the analysis to the 1979-1988 verification debate and propose a taxonomy of representational mismatch plus a disclosure schema.
Results
The Lean proof corpus totals 20.6 MB versus 55.6 KB of statements needing human audit (379:1 ratio), yet the statements contain 218 bespoke local definitions instead of Mathlib-vetted ones, keeping the audit surface small in volume but irreducibly expert. One result (a claimed Connes rigidity counterexample) remained in unresolved dispute despite a valid Lean certificate.