← All papers
First page of A dataset of formalised theorem statements from the Annals of Mathematics

A dataset of formalised theorem statements from the Annals of Mathematics

Thomas Browning, Katerina Hristova, David Ledvinka, Justus Springer, Hang Lu Su, Jack McKoen, Kevin Buzzard

cs.AI Oct 13, 2026 · v1
Hand-written Lean 4 statements of 50 Annals of Mathematics main theorems, built on Mathlib, released as a LeanEval proving benchmark.
Recent progress in autoformalisation of mathematics using AI has been impressive. Measuring this progress requires datasets of formal statements that are both hard and trustworthy. We present AnnalsChallenge: 50 formalised theorem statements written by hand in Lean 4 using Mathlib. Each is the main result of a paper published in the Annals of Mathematics since 2020. Every formalisation was manually reviewed and then audited by AI. We release them without formalised proofs.

Measuring progress in AI autoformalisation needs formal statement datasets that are both hard and trustworthy. Existing benchmarks focus on competition, undergraduate, or single-domain mathematics rather than contemporary research results.

The authors triaged all 207 Annals of Mathematics papers from volumes 191–203 by how hard it would be to state their main theorems in current Mathlib, rated on a scale of 1 to 5. They hand-formalised 50 main results in Lean 4 on top of Mathlib, adding missing definitions to Mathlib or, for paper-specific ones, defining them locally. Each statement was manually reviewed and audited by AI, and statements were corrected to match the authors' intent, sometimes after consulting those authors. The dataset was released on GitHub and on LeanEval without proofs, where submitted proofs are checked without extra axioms.

Most formalised statements came from difficulty levels 1–2, and coverage varies widely by subject area. Many fields remain unstatable because Mathlib lacks definitions in areas such as Riemannian geometry and Shimura varieties. In community submissions to LeanEval, which were not run under controlled conditions, proofs were accepted for 40 of the 50 statements; the best single system, Axiom Prover, accounted for all 40.

DifficultySampleFormalised
14036
23711
3563
4–5740
Total20750
Distribution of papers by estimated difficulty of formalising main theorem statements
Model/HarnessProofs / 50%
Axiom Prover4080.0%
Humanifa + GPT 5.6 sol3468.0%
NEAR AI w/ DeepSeek V43366.0%
Tau (caj.al)2346.0%
Midas2040.0%
Accepted community proof submissions on LeanEval (as of 2 October 2026)