Loading…
VectorCache is a Python library that caches LLM responses based on semantic similarity to reduce latency and costs. It supports multiple vector stores and adaptive thresholding to improve cache hit rates.
AI named vector-cache from November 2025 to February 2026.