🎞️ Slide
Test-Time Scaling Under Budget
M.Sc. Thesis in Computer Science
🏷️ Compression
Tag: Compression
4 items tagged with "Compression"
📝 Post
Entropy of bfloat16 During Training: How Optimizers Shape Weight Distributions
📝 Post
Entropy of bfloat16: 8 Bits Are Doing 2.6 Bits of Work
📄 Paper
70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float
Tianyi Zhang, Mohsen Hariri, Shaochen Zhong, Vipin Chaudhary, Yang Sui, Xia Hu, Anshumali Shrivastali
DFloat11 compresses LLMs to 70% of their original size while maintaining bit-for-bit identical outputs. A lossless compression framework with efficient GPU inference that enables running Llama 3.1 405B on a single node.