Entropy of bfloat16 During Training: How Optimizers Shape Weight DistributionsNovember 17, 2025Compression TrainingInformation TheoryOptimizersStatisticsCompression
Entropy of bfloat16: 8 Bits Are Doing 2.6 Bits of WorkOctober 28, 2025Compression LLMsInformation TheoryEfficiencyStatisticsCompression
Simulating LLM Evaluation Datasets Using Psychometric ModelsOctober 23, 2025Statistics SimulationLLMsReasoning