spectral-kv

Quantize What Counts: Bit Allocation Insights Informed by Spectral Gaps in Keys and Values

Source code for Quantize What Counts: Bit Allocation Insights Informed by Spectral Gaps in Keys and Values.

Supported backends

Citation

If you find our method useful, please kindly cite our paper.

@article{hariri2025quantize,
  title={Quantize What Counts: Bit Allocation Insights Informed by Spectral Gaps in Keys and Values},
  author={Hariri, Mohsen and Luo, Alan and Nemati, Mohammadreza and Nguyen, Lam and Zhong, Shaochen and Wang, Qifan and Hu, Xia and Han, Xiaotian and Chaudhary, Vipin},
  journal={arXiv preprint arXiv:2502.15075},
  year={2025}
}

License

The code is released under the MIT License.