This is a simple template for using Scrapy with Playwright for web scraping. It combines the power of Scrapy for web crawling and Playwright for web automation to create a versatile scraping tool.
- Scrapy: A fast, high-level web crawling and web scraping framework.
- Playwright: A Node.js library to automate Chromium, Firefox, and WebKit with a single API.
- Easy to Use: Provides a basic structure to start your web scraping project using Scrapy and Playwright.
- Customizable: You can easily modify and extend the template to suit your scraping needs.
- Python 3.x
- Scrapy
- Playwright
This project is licensed under the MIT License.
Contributions are welcome! Feel free to submit pull requests or open issues if you encounter any problems or have suggestions for improvements.
Please be responsible and respectful when scraping websites. Make sure to review and comply with the terms of service and robots.txt of the websites you intend to scrape. Unauthorized scraping may violate the terms of service of certain websites and could potentially lead to legal issues.