Loading…
LLM API is an open-source project that provides a versatile API for running various large language models on different consumer hardware configurations. It supports Docker deployment, YAML configuration, automatic model downloads, and offers an OpenAI-compatible client along with LangChain integration.
We haven’t found 1b5d/llm-api in the AI answers we’ve checked.