What AI says about Toolathlon

Toolathlon is a benchmark for language agents that evaluates their ability to execute diverse, realistic, and long-horizon tasks across 32 software applications and 604 tools. It includes 108 manually sourced tasks, each requiring multiple application interactions and verified through dedicated evaluation scripts.