Loading…
Jeffrouyer/llm-locust is a single-container Docker image that bundles a FastAPI backend (API and metrics) with a built Vite web UI for LLM benchmarking, served on port 8089. It is designed for reproducible local runs and CI workflows, providing both the API and UI in one artifact and supporting persistence of model/tokenizer caches. You can run it via docker pull and docker run or with Docker Compose, access the UI at http://localhost:8089, and monitor benchmarks through the /stats/requests endpoint.
We haven’t found jeffrouyer/llm-locust in the AI answers we’ve checked.