← All papers
First page of ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization

ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization

Aksel Fristrup, Sumit Pandey, Ankit Kariryaa

cs.LG Oct 6, 2026 · v1
Section 3 theoretical results (re-isotropization, decay law, spherical marginals) are machine-checked in Lean 4 against Mathlib, with 154 public theorems.
We introduce ApexQuant, a calibration-free quantization method that recursively re-quantizes the residual error, serving as a refinement layer on top of existing quantizers. We establish that a fresh random rotation returns each residual to the uniform distribution on the hypersphere, which characterizes the rate of progressive error decay across successive passes. This result lets us determine, before any weight is read, how many passes a layer needs for a target weight-space error. Every prefix is itself a valid lower-rate model, so one artifact serves several precisions. We instantiate ApexQuant with three interchangeable stages, scalar, $E_8$ and trellis, and validate it on four open-weight LLMs and on Earth-observation and medical domains where in-distribution data is often unattainable as imagery arrives under restrictive licences or due to patient material under privacy constraints. Progressive re-isotropization comes within a few percent of full precision at four bits and gives the best two-bit arm we measure, in a completely data-free setting.

Calibration-free post-training quantization of neural networks is needed when calibration data is unavailable, for example because of licensing or privacy restrictions. Existing data-free quantizers also serve only a single bit-width per stored model.

ApexQuant recursively re-quantizes the residual error, applying a fresh random rotation before each pass. A proposition shows that a Haar rotation returns each residual to the uniform distribution on the sphere, so one codebook is optimal at every pass and error decay follows a closed-form law. The method is instantiated with scalar Lloyd–Max, E8 lattice and trellis stages. All Section 3 results except an arithmetic proposition are machine-checked in Lean 4 against Mathlib (154 public theorems, no extra axioms), including Mathlib-based statements about the normalised surface measure.

The predicted decay matches measured values to at least three decimals. On four LLMs, ApexQuant with the trellis stage is close to full precision at 4 bits and gives the best 2-bit results among data-free methods. Every prefix of passes is a valid lower-rate model, enabling elastic multi-precision inference from one artifact.

Methodb/wTinyLlamaPhi-1.5Mistral-7BQwen2.5-7B
SINQ, g=64≤2.534.5371.4312.1076.152
HQQ, g=642.508.1151.9126.3614.091
ApexQuant, E82.035.7560.6932.8360.681
ApexQuant, trellis2.033.2010.4471.9030.477
KL divergence (nats/token) vs fp16 on WikiText-2, 2-bit class (selected rows)