Loading…
TruthTorchLM is a Python package that provides a comprehensive toolkit for assessing and predicting the truthfulness of language model outputs, offering over 30 methods including Google search checks, uncertainty estimation, and multi-LLM collaboration. It integrates with Huggingface and LiteLLM to enable easy incorporation of truth assessments into existing workflows with minimal code changes. The toolkit includes evaluation and calibration features (AUROC, AUPRC, PRR, accuracy) and supports long-form generation, with an extendable interface for adding new truth methods.
AI named TruthTorchLM from December 2025 to March 2026.