What AI says about Protego

Data as of Oct 20, 2026Based on 11,112 AI responsesReviewed by

How we measure

pypi.org

Protego is a pure-Python library that parses robots.txt files and supports modern conventions. It exposes a Protego class with methods such as can_fetch(url, user_agent), crawl_delay(user_agent), and request_rate(user_agent), and includes sitemaps and a preferred_host derived from robots.txt. It is compatible with Python 3.10+ and installable via pip (pip install protego).

Package on PyPI

Mentioned in

<1%

across Protego’s markets · since Jul 5

Where AI mentions Protego

Each engine’s share of its own answers across Protego’s markets · since Jul 5

  • ChatGPT Search<1%
  • Google AI Mode<1%

Questions and answers