Source code for Quantize What Counts: Bit Allocation Insights Informed by Spectral Gaps in Keys and Values.
If you find our method useful, please kindly cite our paper.
@article{hariri2025quantize,
title={Quantize What Counts: Bit Allocation Insights Informed by Spectral Gaps in Keys and Values},
author={Hariri, Mohsen and Luo, Alan and Nemati, Mohammadreza and Nguyen, Lam and Zhong, Shaochen and Wang, Qifan and Hu, Xia and Han, Xiaotian and Chaudhary, Vipin},
journal={arXiv preprint arXiv:2502.15075},
year={2025}
}
The code is released under the MIT License.