Loading…
@react-llm/headless provides headless React Hooks to run large language models in the browser, accelerated by WebGPU and executed in a WebWorker. It leverages Vicuna 13B with a browser-compiled tokenizer and TVM runtime, loads models from a CDN, caches them in browser storage, and ensures no data leaves the browser. The useLLM hook exposes initialization, message sending with configurable max tokens and stop sequences, and full conversation management for building custom UIs.
We haven’t found React LLM Headless in the AI answers we’ve checked.