Claude Code is the fastest agent framework but costs nearly three times more than the cheapest rival
By Matthias Bastian
AI 摘要
Composio tested Deepseek V4 Flash across four agent frameworks on 30 real-world tasks. Success rates were mostly similar, but costs varied by nearly 3x: OpenCode came in cheapest at $0.073 per task, while Claude Code cost $0.195 despite using the fewest tool calls and output tokens. The choice of fr
原文正文
Claude Code is the fastest agent framework but costs nearly three times more than the cheapest rival
The software wrapper around an AI model has a major impact on what you pay. AI tooling company Composio tested DeepSeek V4 Flash across four agent frameworks (Claude Code, Codex, OpenCode, and Oh My Pi) on 30 tasks using real-world tools like Gmail, GitHub, Slack, and Notion. No single framework won across all categories. Oh My Pi had the highest success rate (17/30) but was the slowest at 272 seconds per task. OpenCode was cheapest at $0.073 per successful task, while Claude Code was fastest at 122 seconds but most expensive at $0.195, despite using the fewest tool calls and generating the least output tokens.
While seven tasks passed or failed based solely on which framework ran them, overall success rates stayed close. Only OpenCode trailed slightly at 14/30. The real gaps were in cost and speed, with nearly a 3x price difference and a 2.2x speed difference depending on the framework.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now