arXiv published two studies on large-model compression on Nov 6, 2026, tackling deployment costs from two angles: quantization precision allocation and the degrees of freedom in parameter representation. TileQuant proposes using hardware-aligned 2D weight tiles as the unit of mixed-precision allocation; experiments show generation throughput reaches 2.66x that of the original model. The other paper, "Neural Compression over Equivalence Classes: Exact Gauges and Functional Rate-Distortion," exploits the degrees of freedom in network parameterizations to cut Zstandard-compressed checkpoint size by up to 23.4% on SmolLM2 and Qwen3.
TileQuant: tiles as precision-allocation units
The paper notes that post-training quantization (PTQ) lowers LLM deployment costs, but preserving quality requires accounting for uneven weight sensitivity. Uniform PTQ uses a single weight bit-width; importance-aware PTQ adjusts scales or reconstructs weights within that width; column-wise mixed precision keeps selected columns at higher precision. Yet sensitivity also varies within a column, so keeping a whole column also protects less sensitive weights, while runtime outlier detection adds decoding overhead.
TileQuant therefore proposes a training-free framework that allocates precision to hardware-aligned 2D weight tiles. Offline calibration provides two scores: an input-activation-aware score based on forward statistics, which is cheaper to calibrate, and a loss-sensitivity score based on gradient information, which preserves quality better. Within the retention budget of each projection, the highest-scoring tiles stay at 16 bits and the rest use 8 bits.
Experiments show TileQuant reaches 2.66x the generation throughput of the original model. It preserves quality in language modeling, reasoning, long-context retrieval and question answering, and beats both quantized models and the original model on several tasks.
Equivalence-class compression: using representational freedom
The other paper notes that neural networks admit many parameterizations of the same or nearly the same function, but deployment typically stores whichever parameter vector training happens to produce. That representational freedom can itself be used for compression, the work shows. Rather than redesigning the codec, the method searches over exact function-preserving transformations and controlled function perturbations, letting an unmodified physical compressor pick the cheaper representation.
The paper says exact gauge families provide a zero-distortion reference under strict auditing, while allowing tiny function changes yields larger rate-distortion gains. On SmolLM2 and Qwen3, the method cuts Zstandard-compressed checkpoint size by up to 23.4%, with similar relative reductions under gzip, Brotli and ZipNN, establishing the representational freedom of trained networks as a practical storage resource.
Both target inference cost pain points
Both studies address cost in large-model deployment: TileQuant focuses on raising inference throughput while preserving quality through mixed-precision quantization, while equivalence-class compression focuses on shrinking stored checkpoint size. The former is a training-free framework; the latter exploits representational freedom without changing the compressor. The two cut deployment overhead at different stages.
Questions to watch include TileQuant's generality across model architectures and hardware, and how the equivalence-class method performs across more model families and compressors. Both works are arXiv preprints and have not been peer-reviewed.