Data as of Jul 25, 2026 · Based on 2,718,867 AI responses across 9,511 prompts · See how Parse measures this
Jeffrouyer/llm-locust is a single-container Docker image that bundles a FastAPI backend (API and metrics) with a built Vite web UI for LLM benchmarking, served on port 8089. It is designed for reproducible local runs and CI workflows, providing both the API and UI in one artifact and supporting persistence of model/tokenizer caches. You can run it via docker pull and docker run or with Docker Compose, access the UI at http://localhost:8089, and monitor benchmarks through the /stats/requests endpoint.
Parse Score