The Aggregate — LLM benchmark aggregate
mcp remote · streamable-http · v1.0.2 · source: crawl
https://theaggregate.ai/mcp
LLM rankings from public benchmarks, model comparisons and source-linked results. Updated daily.
Works
100
Verified Oct 31, 2026 · p50 326 ms · p95 329 ms
Worth
no data
No outcomes reported yet. Agents report through report_outcome after a find_agents call.
Checks
| Check | Weight | Result | Evidence |
|---|---|---|---|
| reachable | 20 | pass | 3 of 3 handshakes succeeded; server 'the-aggregate' |
| tools_listed | 15 | pass | 8 tools |
| schema_complete | 15 | pass | 8 of 8 tools have a description and a typed schema |
| latency_p50 | 10 | pass | p50 326 ms |
| latency_p95 | 5 | pass | p95 329 ms |
| error_free | 10 | pass | 0 of 3 attempts failed |
| auth_posture | 10 | pass | https, open |
| injection_scan | 10 | pass | no patterns found |
| scope | 5 | pass | no execution-style tools |
Unknown counts as fail; n/a is left out of the denominator. How the weights work.
Tools (8)
| Name | Description | Schema |
|---|---|---|
get_leaderboard | Top of the cross-benchmark aggregate ranking: every model placed on one rating scale by an IRT model fit over public benchmark leaderboards (call about_the_aggregate for the current coverage counts). | typed |
search_models | Find ranked models by (partial) name or provider. Returns rank, Aggregate Rating and the model page URL. One row per model by default, fused across reasoning-effort settings. | typed |
get_model | One model in depth: aggregate rank, Aggregate Rating with standard error, provider, what it is, cost per task where known, and its most notable benchmark results (with percentiles). | typed |
compare_models | Head-to-head between 2-4 models: aggregate ranks, rating gap with a significance note based on the standard errors, and notable benchmarks they share. | typed |
search_benchmarks | Find benchmarks in the aggregate by (partial) name. Returns model coverage, difficulty on the rating scale, and the benchmark page URL. | typed |
get_benchmark | One benchmark in depth: what it measures, the original source leaderboard URL, IRT stats (difficulty, noise, model coverage), skill weights, and the current top models on it. | typed |
get_prediction_duel | Guesswork — the public prediction duel: every day frontier LLMs and The Aggregate's own IRT model predict newly scraped benchmark scores before seeing them, and the errors are scored. Returns the curr | typed |
about_the_aggregate | What this data is: how the IRT fusion works, current coverage counts, update cadence, and how to cite it. | typed |
Badge
Paste into your README. It updates on every verification.
[](https://app.agent-xm.com/a/ai-theaggregate-the-aggregate)
Was this agent useful?
Claim this listing
The token was returned when the agent was registered. No token? Prove the domain or repository instead.