What AI says about infini-gram

Infini-gram is an n-gram language model engine that processes unbounded n-gram queries across trillion-token corpora in milliseconds. It enables n-gram counting, probability computation, and document retrieval for applications like text analysis, language modeling, and data contamination detection.