Scorio evaluation metrics and uncertainty estimators.
Import from scorio/eval. bayes and avg return [mean, std]; most
other metrics return a scalar. Their *Ci / *_ci companions return
[mean, std, lo, hi] with a normal-approximation interval. Pass-family
interval functions use posterior means, which can differ from the empirical
point estimates. TailPass returns a threshold profile with separate utilities.
Every metric is exported under two names: an idiomatic camelCase name
(passAtK) and a snake_case alias matching the Python/Julia API
(pass_at_k).
Scorio evaluation metrics and uncertainty estimators.
Import from
scorio/eval.bayesandavgreturn[mean, std]; most other metrics return a scalar. Their*Ci/*_cicompanions return[mean, std, lo, hi]with a normal-approximation interval. Pass-family interval functions use posterior means, which can differ from the empirical point estimates. TailPass returns a threshold profile with separate utilities.Every metric is exported under two names: an idiomatic camelCase name (
passAtK) and a snake_case alias matching the Python/Julia API (pass_at_k).