Loading…
fastllm is a collection of LLM services that can be self-hosted via Docker or Modal Labs to support application development. It provides endpoints compatible with the OpenAI API, including embedding, JSONFormer, and cross-encoder services.
We haven’t found fastllm in the AI answers we’ve checked.