Data as of Jul 25, 2026 · Based on 2,718,867 AI responses across 9,511 prompts · See how Parse measures this
dustynv/local_llmhub.docker.comDustynv/local_llm is a Docker image that provides an optimized local LLM inference engine with quantization support (AWQ and MLC), multimodal capabilities, and live ASR/TTS. It includes a Flask-based web UI with WebSockets, WebAudio, HTML5, and Bootstrap5, and offers modes for Text Chat, Multimodal Chat, Voice Chat, and Live Llava. The image supports tested models such as Llama-2 variants and various vision-language models and is associated with NanoLLM, with documentation moved to a separate repo.
Parse Score
