Loading…
GPTCacheLite is a lightweight semantic caching system for LLM API calls that reduces costs and latency by caching query/response pairs. It supports both synchronous and asynchronous wrappers for OpenAI and Mistral APIs, using Vlite V2 for fast semantic matching.
AI named GPTCacheLite from January 2026 to March 2026.
