Data as of Oct 20, 2026Based on 16,436 AI responses
Reviewed by Dimitry Apollonsky
Scrapy-playwright is a Scrapy integration that provides a Playwright-powered download handler to render JavaScript-heavy pages within Scrapy’s standard workflow. It lets you process pages that require JavaScript without altering Scrapy’s request scheduling or item processing, and it requires Python >= 3.10, Scrapy >= 2.7, and Playwright >= 1.40; install via pip install scrapy-playwright and run 'playwright install' to install the necessary browsers. Activation is achieved by replacing the default download handlers (for example https) with ScrapyPlaywrightDownloadHandler in settings and using an asyncio-based Twisted reactor, then enabling Playwright-powered requests via Request.meta.
Hosted on GitHub
1%
across scrapy-playwright’s markets · since Jul 5
Position in answers
Each engine’s share of its own answers across scrapy-playwright’s markets · since Jul 5
71% of analyzed statements about scrapy-playwright are positive.
Common descriptions
excellent · robust · mature · gold standard · best python option