ποΈ Slide
Test-Time Scaling Under Budget
M.Sc. Thesis in Computer Science
π·οΈ Reasoning
Tag: Reasoning
4 items tagged with "Reasoning"
ποΈ Slide
Psychometric Modeling of LLM Evaluation Datasets
A principled Bayesian framework that replaces Pass@k with posterior estimates, credible intervals, and stable rankings for LLM evaluation
π Post
Simulating LLM Evaluation Datasets Using Psychometric Models
π Paper
Donβt Pass@π: A Bayesian Framework for Large Language Model Evaluation
Mohsen Hariri, Amirhossein Samandar, Michael Hinczewski, Vipin Chaudhary
A Bayesian framework for evaluating large language models that replaces unstable Pass@k metrics with robust posterior estimates and credible intervals. This method improves sample efficiency, supports graded outcomes, and enables statistically sound model comparisons.