Best AI model for following operator instructions

How well an agent stays on the rails it was given during a session. Ranked by Arena agent_steerability, priced against live API rates. 29 models have a published score on this board.

Capability published 2026-09-08 · pricing retrieved 2026-09-10

Most capable
Claude Opus 5
Anthropic
$10.00 / 1M blended
100% of leader strength
anthropic/claude-opus-5
Best value
Claude Opus 5
Anthropic
$10.00 / 1M blended
100% of leader strength
anthropic/claude-opus-5
Budget
Claude Sonnet 5
Anthropic
$4.00 / 1M blended
72% of leader strength · 60% cheaper
anthropic/claude-sonnet-5
Best for agents
Claude Opus 5
Anthropic
$10.00 / 1M blended
100% of leader strength
anthropic/claude-opus-5

Top 25 models for following operator instructions

Rows marked frontier are Pareto-optimal — nothing we track is both stronger and cheaper. "Strength" rescales the board so 100% = parity with the leader.

#ModelProviderScoreStrength$/1MContextTools
1 Claude Opus 5
anthropic/claude-opus-5
Anthropic 0.1361 100% $10.001M tools
2 Claude Fable 5
anthropic/claude-fable-5
Anthropic 0.1100 81% $20.001M tools
3 Claude Opus 4.8
anthropic/claude-opus-4.8
Anthropic 0.1098 81% $10.001M tools
4 Claude Sonnet 5
anthropic/claude-sonnet-5
Anthropic 0.0974 72% $4.001M tools
5 GPT-5.6 Sol
openai/gpt-5.6-sol
OpenAI 0.0877 64% $4.001.05M tools
6 GPT-5.6 Terra
openai/gpt-5.6-terra
OpenAI 0.0670 49% $4.501.05M tools
7 Grok 4.5
x-ai/grok-4.5
xAI 0.0531 39% $3.00500K tools
8 GLM 5.2
z-ai/glm-5.2
Z.ai (Zhipu) 0.0292 21% $1.491.048576M tools
9 Qwen3.8 Max (0902)
qwen/qwen3.8-max-0902
Qwen (Alibaba) 0.0276 20% $3.001M tools
10 Grok 4.6
x-ai/grok-4.6
xAI 0.0244 18% $3.00500K tools
11 GPT-5.6 Luna
openai/gpt-5.6-luna
OpenAI 0.0088 6% $0.451.05M tools
12 Kimi K3
moonshotai/kimi-k3
Moonshot AI -0.0015 -1% $6.001.048576M tools
13 DeepSeek V4 Pro 0813
deepseek/deepseek-v4-pro-0813
DeepSeek -0.0092 -7% $1.571.048576M tools
14 DeepSeek V4 Pro 0423
deepseek/deepseek-v4-pro
DeepSeek -0.0092 -7% $1.201.048576M tools
15 GLM 5.3
z-ai/glm-5.3
Z.ai (Zhipu) -0.0104 -8% $2.151.31072M tools
16 GLM 5.3 Flash
z-ai/glm-5.3-flash
Z.ai (Zhipu) -0.0113 -8% $0.241.31072M tools
17 Claude Fable 5.1
anthropic/claude-fable-5.1
Anthropic -0.0121 -9% $20.001M tools
18 DeepSeek V4 Flash 0731
deepseek/deepseek-v4-flash-0731
DeepSeek -0.0143 -11% $0.101.31072M tools
19 DeepSeek V4 Flash 0423
deepseek/deepseek-v4-flash
DeepSeek -0.0143 -11% $0.111.048576M tools
20 Claude Sonnet 4.6
anthropic/claude-sonnet-4.6
Anthropic -0.0249 -18% $6.001M tools
21 Mistral Medium 3.5
mistralai/mistral-medium-3-5
Mistral -0.0320 -24% $3.00262K tools
22 Gemini 3.8 Flash
google/gemini-3.8-flash
Google -0.0334 -25% $1.501.048576M tools
23 Qwen3.7 Max
qwen/qwen3.7-max
Qwen (Alibaba) -0.0354 -26% $2.211M tools
24 Qwen3.7 Plus
qwen/qwen3.7-plus
Qwen (Alibaba) -0.0381 -28% $0.561M tools
25 Gemini 3.6 Flash
google/gemini-3.6-flash
Google -0.0453 -33% $1.501.048576M tools

Capability: Arena leaderboard dataset (CC-BY-4.0), Arena agent_steerability, published 2026-09-08. Pricing: OpenRouter, retrieved 2026-09-10. (input x 3 + output x 1) / 4.

What this measures: Human pairwise preference votes. Measures perceived answer quality on this category, not correctness on a fixed test set. For each model this is its score as a share of the board leader's score — 1.0 means parity.

Get this as JSON

curl -s https://agentleaderboards.com/api/v1/route/agent-steerability.json | jq .picks

No key, open CORS, refreshed daily. Set your own budget and constraints →

Other tasks