Loading…
OneLLM is a lightweight Python library that provides a unified, OpenAI-compatible interface for interacting with over 300 large language models from 22 different providers. It offers features like intelligent semantic caching, automatic fallback, and connection pooling to enhance reliability and performance.
We haven’t found OneLLM in the AI answers we’ve checked.