ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization
Calibration-free post-training quantization of neural networks is needed when calibration data is unavailable, for example because of licensing or privacy restrictions. Existing data-free quantizers also serve only a single bit-width per stored model.
ApexQuant recursively re-quantizes the residual error, applying a fresh random rotation before each pass. A proposition shows that a Haar rotation returns each residual to the uniform distribution on the sphere, so one codebook is optimal at every pass and error decay follows a closed-form law. The method is instantiated with scalar Lloyd–Max, E8 lattice and trellis stages. All Section 3 results except an arithmetic proposition are machine-checked in Lean 4 against Mathlib (154 public theorems, no extra axioms), including Mathlib-based statements about the normalised surface measure.
The predicted decay matches measured values to at least three decimals. On four LLMs, ApexQuant with the trellis stage is close to full precision at 4 bits and gives the best 2-bit results among data-free methods. Every prefix of passes is a valid lower-rate model, enabling elastic multi-precision inference from one artifact.
| Method | b/w | TinyLlama | Phi-1.5 | Mistral-7B | Qwen2.5-7B |
|---|---|---|---|---|---|
| SINQ, g=64 | ≤2.53 | 4.537 | 1.431 | 2.107 | 6.152 |
| HQQ, g=64 | 2.50 | 8.115 | 1.912 | 6.361 | 4.091 |
| ApexQuant, E8 | 2.03 | 5.756 | 0.693 | 2.836 | 0.681 |
| ApexQuant, trellis | 2.03 | 3.201 | 0.447 | 1.903 | 0.477 |
