Posters

Ranking Reasoning LLMs under Test-Time Scaling

ACL 2026 Main•April 6, 2026 Mohsen Hariri, Michael Hinczewski, Jing Ma, Vipin Chaudhary

Ranking reasoning LLMs under repeated sampling, comparing 72 ranking methods across four Olympiad-style math benchmarks and packaging them in Scorio.

Preview of Ranking Reasoning LLMs under Test-Time Scaling

Statistics Bayesian LLM Ranking Test-Time Scaling Benchmarking Scorio

Don't Pass@k: A Bayesian Framework for Large Language Model Evaluation

ICLR 2026•January 25, 2026 Mohsen Hariri, Amirhossein Samandar, Michael Hinczewski, Vipin Chaudhary

Proposed a Bayesian framework that estimates models' success probabilities with quantified uncertainty, yielding more reliable rankings and enabling categorical evaluation of LLMs.

Preview of Don't Pass@k: A Bayesian Framework for Large Language Model Evaluation

Statistics Bayesian LLM Evaluation Test-Time Scaling Benchmarking Scorio