Best AI model for following operator instructions

How well an agent stays on the rails it was given during a session. Ranked by Arena agent_steerability, priced against live API rates. 28 models have a published score on this board.

Capability published 2026-10-23 · pricing retrieved 2026-10-25

Most capable
Claude Opus 5.5
Anthropic
$8.00 / 1M blended
100% of leader strength
anthropic/claude-opus-5.5
Best value
Claude Opus 5.5
Anthropic
$8.00 / 1M blended
100% of leader strength
anthropic/claude-opus-5.5
Budget
Gemini 4 Argon
Google
$4.00 / 1M blended
82% of leader strength · 50% cheaper
google/gemini-4-argon
Best for agents
Claude Opus 5.5
Anthropic
$8.00 / 1M blended
100% of leader strength
anthropic/claude-opus-5.5

Top 25 models for following operator instructions

Rows marked frontier are Pareto-optimal — nothing we track is both stronger and cheaper. "Strength" rescales the board so 100% = parity with the leader.

#ModelProviderScoreStrength$/1MContextTools
1 Claude Opus 5.5
anthropic/claude-opus-5.5
Anthropic 0.1760 100% $8.001M tools
2 Claude Fable 5.1
anthropic/claude-fable-5.1
Anthropic 0.1533 87% $20.001M tools
3 GPT-6 Astra
openai/gpt-6-astra
OpenAI 0.1446 82% $20.001.05M tools
4 Gemini 4 Argon
google/gemini-4-argon
Google 0.1440 82% $4.001.048576M tools
5 GPT-6.1 Sol
openai/gpt-6.1-sol
OpenAI 0.1370 78% $4.001.05M tools
6 GPT-6 Sol
openai/gpt-6-sol
OpenAI 0.1107 63% $4.001.05M tools
7 Claude Sonnet 5.5
anthropic/claude-sonnet-5.5
Anthropic 0.1082 61% $4.001M tools
8 Claude Fable 5
anthropic/claude-fable-5
Anthropic 0.0960 55% $20.001M tools
9 Claude Opus 5
anthropic/claude-opus-5
Anthropic 0.0669 38% $10.001M tools
10 Claude Sonnet 5
anthropic/claude-sonnet-5
Anthropic 0.0596 34% $4.001M tools
11 GPT-6 Luna
openai/gpt-6-luna
OpenAI 0.0565 32% $0.201.05M tools
12 Claude Haiku 5.5
anthropic/claude-haiku-5.5
Anthropic 0.0453 26% $0.201M tools
13 Qwen3.8 Max (0902)
qwen/qwen3.8-max-0902
Qwen (Alibaba) 0.0143 8% $3.001M tools
14 GLM 5.2
z-ai/glm-5.2
Z.ai (Zhipu) 0.0130 7% $1.771.048576M tools
15 Gemini 3.8 Flash
google/gemini-3.8-flash
Google 0.0116 7% $1.661.048576M tools
16 DeepSeek V4.1 Flash
deepseek/deepseek-v4.1-flash
DeepSeek 0.0099 6% $0.271.048576M tools
17 Grok 4.6
x-ai/grok-4.6
xAI 0.0049 3% $3.00500K tools
18 Kimi K3
moonshotai/kimi-k3
Moonshot AI 0.0029 2% $2.881.048576M tools
19 GLM 5.3
z-ai/glm-5.3
Z.ai (Zhipu) -0.0024 -1% $0.411.048576M tools
20 DeepSeek V4 Pro 0813
deepseek/deepseek-v4-pro-0813
DeepSeek -0.0038 -2% $0.991.048576M tools
21 DeepSeek V4 Pro 0423
deepseek/deepseek-v4-pro
DeepSeek -0.0038 -2% $0.261.048576M tools
22 Grok 4.7
x-ai/grok-4.7
xAI -0.0150 -9% $3.00500K tools
23 GLM 5.3 Flash
z-ai/glm-5.3-flash
Z.ai (Zhipu) -0.0327 -19% $0.241.048576M tools
24 Qwen3.8 27B
qwen/qwen3.8-27b
Qwen (Alibaba) -0.0374 -21% $0.781M tools
25 Gemini 3.7 Flash
google/gemini-3.7-flash
Google -0.0453 -26% $1.501.048576M tools

Capability: Arena leaderboard dataset (CC-BY-4.0), Arena agent_steerability, published 2026-10-23. Pricing: OpenRouter, retrieved 2026-10-25. (input x 3 + output x 1) / 4.

What this measures: Human pairwise preference votes. Measures perceived answer quality on this category, not correctness on a fixed test set. For each model this is its score as a share of the board leader's score — 1.0 means parity.

Get this as JSON

curl -s https://agentleaderboards.com/api/v1/route/agent-steerability.json | jq .picks

No key, open CORS, refreshed daily. Set your own budget and constraints →

Other tasks