← All papers
First page of Building Shor's Algorithm in Lean: An Agentic Formalization of Quantum Attacks on RSA-2048 and P-256

Building Shor's Algorithm in Lean: An Agentic Formalization of Quantum Attacks on RSA-2048 and P-256

Lei Zhang, Yusheng Zhao, Hongshun Yao, Xin Wang

quant-ph Jul 15, 2026 · v1
Formalizes Shor's algorithm family in Lean via agentic LLM systems, verifying quantum resource estimates for attacking RSA-2048 and P-256.
Large language models are increasingly assisting with demanding formal theorem-proving tasks, particularly when grounded in machine-checked libraries such as Lean. Agentic systems further amplify this process by searching, reusing, and extending existing formal developments to uncover new discoveries. In quantum computing, Shor's algorithm and its variants present such a demanding case for Lean formalization. In this work, we formalize this algorithm family in Lean through agentic formalization: software agents analyze sources, write Lean code and repair proofs, with human review of the scientific claims and machine checking of the resulting formal proofs. Our formalization develops the mathematical foundations for analyzing quantum attacks in two cryptographic settings: a 2048-bit modulus in the RSA-2048 and the standardized elliptic curve over a 256-bit prime field (P-256). To support these analyses, the formalization ranges from quantum algorithms for order finding to reversible quantum circuits for modular and elliptic-curve arithmetic. Based on [Quantum 5, 433] and [ASIACRYPT 2017, 241–270], we formalize the logical resource estimates for RSA-2048 and P-256, respectively, and provide additional estimates of classical operations. We expect the results pave the way for broader machine-checked quantum cryptanalysis and represent a step toward AI-assisted design and verification of quantum algorithms.

Quantum attacks on RSA-2048 and elliptic-curve P-256 cryptography rely on Shor's algorithm and resource estimates that are complex to verify. Machine-checked formalization of such quantum cryptanalysis is lacking.

Software agents analyze source papers, write Lean code, and repair proofs, with human review of scientific claims and machine checking of the formal proofs. The formalization covers quantum order finding, reversible quantum circuits for modular and elliptic-curve arithmetic. It targets two cryptographic settings following prior resource-estimate literature.

Logical resource estimates for RSA-2048 and P-256 are formalized in Lean, along with additional estimates of classical operations, providing machine-checked foundations for quantum cryptanalysis.