← All papers
First page of CausalForge: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference

CausalForge: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference

Jiyuan Tan, Vasilis Syrgkanis

stat.ML Jul 24, 2026 · v1 cs.AI cs.LG econ.EM
Introduces Causalean, a Lean 4 library of 7,035 machine-checked causal-inference declarations, plus an agentic pipeline that formalizes and proves self-proposed results in Lean.
Automating theoretical research is constrained not only by the generation of candidate results, but also by their reliable evaluation. A common approach is to close the research loop with a large language model (LLM) reviewer. However, such reviewers remain empirically unreliable: they may accept fabricated papers and detect them at rates close to chance (Bad Scientist, 2025). We present CausalForge, a framework for automated theoretical research in causal inference grounded in the Lean proof assistant. CausalForge combines Causalean, a foundational Lean library for causal inference containing 7,035 machine-checked declarations developed with language-model assistance under human design and review, with CausalSmith, a self-improving agentic pipeline that selects research topics, proposes results, formalizes statements, constructs proofs, and presents the resulting artifacts for human inspection. Because a machine-checked proof establishes only that a formal statement follows from its assumptions, not that the statement faithfully captures the intended scientific claim, the pipeline augments kernel verification with a statement audit that compares each formal theorem against the informal claim it is intended to express. We evaluate the system using artifacts produced by completed autonomous research runs. The source code, formal library, and run records are available at https://github.com/Jiyuan-Tan/CausalForge.

Automating theoretical research is bottlenecked by unreliable evaluation, since LLM reviewers accept fabricated papers at high rates. Machine-checked proofs establish soundness but not that a formal statement faithfully captures the intended claim.

CausalForge combines Causalean, a foundational Lean 4 library of causal inference (7,035 declarations built with LLM assistance under human review), with CausalSmith, a self-improving agentic pipeline. The pipeline selects topics, proposes results, formalizes statements, constructs kernel-checked Lean proofs, and presents artifacts. It augments kernel verification with a statement audit comparing each formal theorem against its intended informal claim, and a library feedback loop promotes reusable lemmas.

The run record holds 123 runs: 9 accepted (sound, novel, proved in Lean 4), 44 downgraded, and 70 failed. Accepted results span causal discovery, estimation, panel methods, and experimentation, while identification and SCM results appeared only in lower tiers.

DispositionRunsGate that determined it
Accepted9sound, novel at tier, proved in Lean 4
Downgraded44sound, below novelty target
Failed70rejected at proposal or mathematics
Total123
Run catalogue: 123 recorded CausalSmith runs by disposition.
ClusterFilesLinesDefsThms/Lem
Estimation16854,246298621
Stat20247,165213894
PO13841,415592947
SCM8836,342208523
Total973261,9407,035 declarations
Library clusters and declaration counts.