LLM Leaderboard · Metacritic for Models

One page to pick the right model for the job: public quality evals as visible per-source bars, per-million-token pricing, refusal-rate data by domain, and sliders for what you care about. Move a slider, the ranking re-computes live.

Data as of loading – models tracked Refreshed daily

Quality: LMArena leaderboard (CC-BY-4.0). Pricing and context: OpenRouter public API (prices include OpenRouter's service fee, so they sit slightly above direct vendor prices). Refusal rates: moderationbias.com independent audit, LLM-judged, used as a labeled proxy. Param counts: Hugging Face Hub API.

Sort by

Max price / 1M output tokens $200

Minimum context window

Deployment

Local quantization

VRAM cap (local models) 160 GB

Refusal domains

Table shows each model's worst refusal rate across the checked domains. n/a means the model was not in the audit.

#	Model	Quality	Arena	Coding	Math	Price / 1M	Context	Refusal	Deploy	Why

Methodology

The bars

Arena: LMArena crowd-preference Elo from the official leaderboard catalog, rescaled to 0-100 for the bar. The number shown is the raw Elo.
Coding / Math: LMArena category Elo for the same model, same source, same scale. Missing categories show as n/a, never as zero.
Quality / Value / Price (the big number): the active sort key. Best quality ranks by Arena Elo rescaled to 0-100 (clamp((elo - 1200) / 300)). Best value ranks by quality points per dollar of output price, rescaled so the best value scores 100. Lowest price ranks by output $/1M ascending. Models missing the data a mode needs show n/a and sort last in that mode. Models with no public price are flagged "price unknown".

Refusal data

Refusal rates come from an independent moderation audit that prompts each model identically at temperature 0 and has an LLM judge classify refusals. The Refusal column shows the model's worst rate across the domains you check above. It is a moderation-bias study, not a safety benchmark, so we present it as a labeled proxy with its source linked. Coverage is thin (about a dozen of the 80+ models), and n/a means the model was not audited, not that it never refuses.

VRAM estimates

For open-weight models with verified parameter counts: VRAM = params x bytes-per-param x 1.15 (FP16 = 2 bytes, INT8 = 1, INT4 = 0.5; the 1.15 covers KV cache and runtime overhead). Rough estimate, not a deployment guarantee.

Honest caveats

Arena scores measure crowd preference, not task accuracy. They skew English, skew toward heavily-voted proprietary models, and update when LMArena publishes, roughly weekly. A model can be the best at your task while sitting mid-table here.
Prices move. OpenRouter's feed adds its own service fee on top of provider prices, and vendors change list prices without notice. Treat every price as "as of the data date", not a quote.
Refusal coverage is thin (a dozen or so of the 80 models). Absence of data is not evidence of low refusal.
VRAM math ignores context-length KV growth, batching, and framework overhead. Real deployments vary by 20-40%.
Model names shift across sources; matches are by normalized name and spot checked, but a mismatch can slip through. The per-model source links let you verify.