A neuro-symbolic evolutionary prover uses the Lean 4 kernel with Mathlib to verify proof-DAG transitions and reusable schemas on competition benchmarks.
Abstract
Automated theorem proving offers a natural foundation for recursive self-improvement in scientific discovery. However, existing neural provers do not fully preserve this recursive structure, where the learning process should be self-improving over time. Existing methods either embed proof experience into model parameters through expensive weight updates, or keep verified intermediate deductions only within the current problem. In addition, these methods also heavily rely on sparse whole-proof feedback, even when unsuccessful partial attempts contain useful discoveries. To close the gap, we propose ProofEvolve, a neuro-symbolic framework that evolves explicit, formally verified symbolic proof structures with neural models to decisively expand the knowledge boundary. In this framework, the neural model proposes variation operators, including decompositions, repairs, and schema recombinations. The symbolic Lean kernel verifies every proof transition. Over the evolution loops, ProofEvolve computes verified closure over the resulting proof directed acyclic graphs (DAGs). Within each problem, ProofEvolve evolves partial AND-OR proof DAGs in a behaviorally indexed archive. Across problems, kernel-checked schema extraction adds newly proved sub-DAGs to a persistent schema library. Proof DAGs inherit the solved results through typed schema recombination, with every residual premise exposed as a new subgoal. This evolutionary process preserves verified results from incomplete attempts and makes them available for later proofs without weakening formal soundness. Across three competition-level Lean benchmarks, ProofEvolve achieves the highest average solve rate among the evaluated proof systems.
Problem
Neural theorem provers embed proof experience into model weights or discard verified partial results within a single problem, relying on sparse whole-proof feedback. This limits recursive self-improvement and reuse of verified intermediate deductions across problems.
Approach
ProofEvolve keeps the neural model fixed and evolves explicit, formally verified symbolic proof structures. The model proposes variation operators (decompositions, repairs, schema recombinations), while the Lean 4 kernel with Mathlib verifies every proof transition and schema application. Partial proofs are represented as AND-OR proof DAGs ranked by a graded verified-closure fitness, stored in a behaviorally indexed archive per target, and closed sub-DAGs are extracted into a persistent schema library reused across targets via typed recombination.
Results
Across three competition-level Lean benchmarks (PutnamBench, IMO-LeanProofBench, CombiBench), ProofEvolve achieves the highest average solve rate among evaluated systems. On Lean Workbook theorems disjoint from its library, using its own verified schema library adds about four points over zero-shot, while random retrieval adds nothing.
Figure 6: Test-time budget scaling (a) Kernel-verified transitions per target across seeds; (b) Union of distinct targets solved across seeds and configuration. In (a) : Qwen3.5 think \circ / instant \square ; Qwen3.6 instant \Diamond / think \triangle ; GLM-5.1 + ; Kimi-K2.6 \times ; gpt-oss med \triangledown / low \times .