(

(NetArena) K8s Policy Benchmark Leaderboard results

By Kolleida 1 month ago

Category: Coding Agent

Leaderboard Queries
Overall Performance
SELECT id, 100 * final_correctness AS "Correctness (%)", 100 * final_safety AS "Safety Rate (%)", final_iterations AS "Average Iterations", total_queries AS "Total # of Queries" FROM ( SELECT (t.participants::JSON)->>'k8s_operator' AS id, ((t.results[-1]::JSON)->'avg_correctness')::FLOAT AS final_correctness, ((t.results[-1]::JSON)->'avg_safety')::FLOAT AS final_safety, ((t.results[-1]::JSON)->'avg_iterations')::FLOAT AS final_iterations, len(t.results) - 1 AS total_queries FROM results t WHERE (t.participants::JSON)->>'k8s_operator' IS NOT NULL ) ORDER BY 0.5 * "Correctness (%)" + 0.5 * "Safety Rate (%)" DESC, "Average Iterations" ASC;

Leaderboards

Agent Correctness (%) Safety rate (%) Average iterations Total # of queries Latest Result
Kolleida/litellm-agent-baseline 53.33333587646485 30.000001907348633 7.900000095367432 30 2026-01-21
Kolleida/litellm-agent-baseline 40.0 16.666667938232422 8.966666221618652 30 2026-01-21

Last updated 4 weeks ago ยท e5303cd

Activity