How rarely the model hallucinates or misuses tool calls during agent runs. Higher is better. Ranked by Arena agent_tool_hallucination, priced against live API rates. 28 models have a published score on this board.
Capability published 2026-10-23 · pricing retrieved 2026-10-25
openai/gpt-6.1-solopenai/gpt-6-lunaopenai/gpt-6-lunaopenai/gpt-6-lunaRows marked frontier are Pareto-optimal — nothing we track is both stronger and cheaper. "Strength" rescales the board so 100% = parity with the leader.
| # | Model | Provider | Score | Strength | $/1M | Context | Tools |
|---|---|---|---|---|---|---|---|
| 1 | GPT-6.1 Solopenai/gpt-6.1-sol | OpenAI | 0.0075 | 100% | $4.00 | 1.05M | tools |
| 2 | Kimi K3moonshotai/kimi-k3 | Moonshot AI | 0.0075 | 100% | $2.88 | 1.048576M | tools |
| 3 | GLM 5.2z-ai/glm-5.2 | Z.ai (Zhipu) | 0.0073 | 97% | $1.77 | 1.048576M | tools |
| 4 | GPT-6 Astraopenai/gpt-6-astra | OpenAI | 0.0071 | 95% | $20.00 | 1.05M | tools |
| 5 | GLM 5.3 Flashz-ai/glm-5.3-flash | Z.ai (Zhipu) | 0.0070 | 93% | $0.24 | 1.048576M | tools |
| 6 | GLM 5.3z-ai/glm-5.3 | Z.ai (Zhipu) | 0.0070 | 93% | $0.41 | 1.048576M | tools |
| 7 | Claude Opus 5anthropic/claude-opus-5 | Anthropic | 0.0070 | 93% | $10.00 | 1M | tools |
| 8 | GPT-6 Lunaopenai/gpt-6-luna | OpenAI | 0.0069 | 92% | $0.20 | 1.05M | tools |
| 9 | Grok 4.7x-ai/grok-4.7 | xAI | 0.0068 | 91% | $3.00 | 500K | tools |
| 10 | Claude Sonnet 5.5anthropic/claude-sonnet-5.5 | Anthropic | 0.0065 | 87% | $4.00 | 1M | tools |
| 11 | GPT-6 Solopenai/gpt-6-sol | OpenAI | 0.0064 | 85% | $4.00 | 1.05M | tools |
| 12 | Claude Fable 5anthropic/claude-fable-5 | Anthropic | 0.0064 | 85% | $20.00 | 1M | tools |
| 13 | Claude Fable 5.1anthropic/claude-fable-5.1 | Anthropic | 0.0061 | 81% | $20.00 | 1M | tools |
| 14 | Grok 4.6x-ai/grok-4.6 | xAI | 0.0061 | 81% | $3.00 | 500K | tools |
| 15 | DeepSeek V4 Pro 0813deepseek/deepseek-v4-pro-0813 | DeepSeek | 0.0059 | 79% | $0.99 | 1.048576M | tools |
| 16 | DeepSeek V4 Pro 0423deepseek/deepseek-v4-pro | DeepSeek | 0.0059 | 79% | $0.26 | 1.048576M | tools |
| 17 | Claude Opus 5.5anthropic/claude-opus-5.5 | Anthropic | 0.0057 | 76% | $8.00 | 1M | tools |
| 18 | Gemini 3.8 Flashgoogle/gemini-3.8-flash | 0.0056 | 75% | $1.66 | 1.048576M | tools | |
| 19 | DeepSeek V4.1 Flashdeepseek/deepseek-v4.1-flash | DeepSeek | 0.0055 | 73% | $0.27 | 1.048576M | tools |
| 20 | Gemini 3.7 Flashgoogle/gemini-3.7-flash | 0.0048 | 64% | $1.50 | 1.048576M | tools | |
| 21 | Claude Sonnet 5anthropic/claude-sonnet-5 | Anthropic | 0.0045 | 60% | $4.00 | 1M | tools |
| 22 | Gemini 4 Argongoogle/gemini-4-argon | 0.0035 | 47% | $4.00 | 1.048576M | tools | |
| 23 | Qwen3.8 27Bqwen/qwen3.8-27b | Qwen (Alibaba) | -0.0008 | -11% | $0.78 | 1M | tools |
| 24 | Qwen3.8 Max (0902)qwen/qwen3.8-max-0902 | Qwen (Alibaba) | -0.0083 | -111% | $3.00 | 1M | tools |
| 25 | Claude Haiku 5.5anthropic/claude-haiku-5.5 | Anthropic | -0.0089 | -119% | $0.20 | 1M | tools |
Capability: Arena leaderboard dataset (CC-BY-4.0), Arena agent_tool_hallucination, published 2026-10-23. Pricing: OpenRouter, retrieved 2026-10-25. (input x 3 + output x 1) / 4.
curl -s https://agentleaderboards.com/api/v1/route/agent-tool-reliability.json | jq .picksNo key, open CORS, refreshed daily. Set your own budget and constraints →
Writing & editing code · Autonomous agent work · Following operator instructions · Recovering from shell errors · Hard reasoning · Mathematics · Precise instruction following · Long multi-turn chat · Long inputs · Creative writing · General assistant · Software & IT services · Legal & government · Medicine & healthcare · Science · Business & finance · Writing & language