Convergence Analysis of Non-Deterministic LLM Rankings

Step 1: Generate data with your parameters. Step 2: Select and compare metrics instantly without regenerating data!

Number of Models (L): 5

Number of Questions (M): 20

Number of Trials (N): 80

Bootstrap Repetitions (B): 100

Simulation Type:

Model Separation:

Select Metrics to Analyze:

Avg@N (Gold Standard) Pass@2 Pass@4 Pass@8

Interactive Demo