Loading…
Reppy is a Python library for parsing and interacting with robots.txt files according to the Robots Exclusion Protocol. It provides utilities for fetching, caching, and checking URL permissions, including support for wildcard matching, crawl delays, and sitemaps.
We haven’t found reppy in the AI answers we’ve checked.
