What AI says about scrapy-rotating-proxies

scrapy-rotating-proxies provides a Scrapy middleware that uses rotating proxies, checks their availability, and adjusts crawling speed. It supports configuring proxies from a list or file and integrates as Scrapy downloader middlewares (RotatingProxyMiddleware and BanDetectionMiddleware). It tracks working and non-working proxies with a site-specific failure heuristic (such as non-200 responses, empty bodies, or exceptions) and allows per-proxy concurrency settings with periodic re-checks.