Arena's Agent Arena adds plots of performance against output tokens and wait time

Arena, the leaderboard publisher, says its Agent Arena now shows which agents give the best performance for every output token generated and every minute a user waits, in addition to task spend. Arena says the same level of intelligence can cost 10× more, need 6× more output tokens and take twice as long.

From these plots, drawn from real-world usage on Arena, it says costs grow most steeply with intelligence, waiting longer pays off unevenly, and output tokens barely predict the bill. The figures are Arena's own. The plots are on the Agent Arena Pareto leaderboard at arena.ai.