Best AI model for recovering from shell errors

How well the model recovers after a failed terminal command instead of thrashing. Ranked by Arena agent_bash_recovery_steps, priced against live API rates. 30 models have a published score on this board.

Capability published 2026-10-08 · pricing retrieved 2026-10-25

Most capable
Claude Sonnet 5.5
Anthropic
$4.00 / 1M blended
100% of leader strength
anthropic/claude-sonnet-5.5
Best value
Claude Sonnet 5.5
Anthropic
$4.00 / 1M blended
100% of leader strength
anthropic/claude-sonnet-5.5
Budget
Claude Sonnet 5.5
Anthropic
$4.00 / 1M blended
100% of leader strength
anthropic/claude-sonnet-5.5
Best for agents
Claude Sonnet 5.5
Anthropic
$4.00 / 1M blended
100% of leader strength
anthropic/claude-sonnet-5.5

Top 25 models for recovering from shell errors

Rows marked frontier are Pareto-optimal — nothing we track is both stronger and cheaper. "Strength" rescales the board so 100% = parity with the leader.

#ModelProviderScoreStrength$/1MContextTools
1 Claude Sonnet 5.5
anthropic/claude-sonnet-5.5
Anthropic 0.1504 100% $4.001M tools
2 Claude Opus 5
anthropic/claude-opus-5
Anthropic 0.1357 90% $10.001M tools
3 Claude Opus 5.5
anthropic/claude-opus-5.5
Anthropic 0.1355 90% $8.001M tools
4 Claude Fable 5.1
anthropic/claude-fable-5.1
Anthropic 0.1160 77% $20.001M tools
5 Claude Fable 5
anthropic/claude-fable-5
Anthropic 0.0960 64% $20.001M tools
6 DeepSeek V4.1 Flash 1017
deepseek/deepseek-v4.1-flash-1017
DeepSeek 0.0786 52% $0.261.048576M tools
7 DeepSeek V4.1 Flash
deepseek/deepseek-v4.1-flash
DeepSeek 0.0786 52% $0.271.048576M tools
8 Claude Sonnet 5
anthropic/claude-sonnet-5
Anthropic 0.0738 49% $4.001M tools
9 Claude Opus 4.8
anthropic/claude-opus-4.8
Anthropic 0.0722 48% $10.001M tools
10 Grok 4.7
x-ai/grok-4.7
xAI 0.0720 48% $3.00500K tools
11 GPT-6 Sol
openai/gpt-6-sol
OpenAI 0.0703 47% $4.001.05M tools
12 Grok 4.6
x-ai/grok-4.6
xAI 0.0568 38% $3.00500K tools
13 GPT-6 Astra
openai/gpt-6-astra
OpenAI 0.0553 37% $20.001.05M tools
14 GPT-6 Luna
openai/gpt-6-luna
OpenAI 0.0521 35% $0.201.05M tools
15 Grok 4.5
x-ai/grok-4.5
xAI 0.0514 34% $3.00500K tools
16 GPT-6.1 Sol
openai/gpt-6.1-sol
OpenAI 0.0453 30% $4.001.05M tools
17 DeepSeek V4 Pro 0813
deepseek/deepseek-v4-pro-0813
DeepSeek 0.0440 29% $0.991.048576M tools
18 DeepSeek V4 Pro 0423
deepseek/deepseek-v4-pro
DeepSeek 0.0440 29% $0.261.048576M tools
19 Kimi K3
moonshotai/kimi-k3
Moonshot AI 0.0438 29% $2.881.048576M tools
20 Qwen3.8 Max (0902)
qwen/qwen3.8-max-0902
Qwen (Alibaba) 0.0280 19% $3.001M tools
21 GLM 5.2
z-ai/glm-5.2
Z.ai (Zhipu) 0.0067 4% $1.771.048576M tools
22 MiniMax M3
minimax/minimax-m3
MiniMax 0.0058 4% $0.531.048576M tools
23 GLM 5.3
z-ai/glm-5.3
Z.ai (Zhipu) -0.0005 0% $0.411.048576M tools
24 Gemini 3.8 Flash
google/gemini-3.8-flash
Google -0.0069 -5% $1.661.048576M tools
25 Gemini 3.7 Flash
google/gemini-3.7-flash
Google -0.0544 -36% $1.501.048576M tools

Capability: Arena leaderboard dataset (CC-BY-4.0), Arena agent_bash_recovery_steps, published 2026-10-08. Pricing: OpenRouter, retrieved 2026-10-25. (input x 3 + output x 1) / 4.

What this measures: Human pairwise preference votes. Measures perceived answer quality on this category, not correctness on a fixed test set. For each model this is its score as a share of the board leader's score — 1.0 means parity.

Get this as JSON

curl -s https://agentleaderboards.com/api/v1/route/agent-recovery.json | jq .picks

No key, open CORS, refreshed daily. Set your own budget and constraints →

Other tasks