Loading…
Arena Hard Auto is an automatic evaluation tool for instruction-tuned LLMs that uses automatic judges like GPT-4.1 and Gemini 2.5 to approximate human preferences. It provides a leaderboard ranking models based on performance on hard prompts and creative writing queries sourced from Chatbot Arena.
AI named Arena Hard Auto from December 2025 to August 2026.
None of these answers cited github.com. AI leaned on arxiv.org, benchlm.ai, and cazton.com.
github.com/lmarena/arena-hard-auto 0%Other sites 100%