Scrapify is a lightweight and customizable Python web scraper for collecting data from websites with minimal setup. Ideal for quick scraping tasks, educational purposes, and rapid prototyping.
- 🔍 Extract text, links, or custom elements from any public webpage
- 🧩 Easily extensible with custom parsing logic
- ✅ Works on Google Colab or locally
- 💾 Export scraped data to JSON
This folder contains Jupyter or Google Colab notebooks that:
- Demonstrate how to use the scraper
- Help debug or test the scraper in real time
- Serve as interactive tutorials
⚠️ These notebooks should import fromsrc/, not contain the full logic themselves.
This is where your actual code lives. It should include:
scrapify.py: your main scraper functions (modular, reusable)- (Optional)
utils.py: helper functions likeclean_text(),fetch_html() - (Optional)
parsers/: separate logic for parsing different types of pages
🎯 Keeping logic in
src/means your code can be easily tested, reused, and extended.
We welcome contributions from the community! To contribute:
- Fork the repository.
- Clone your forked repository to your local machine.
- Create a new branch to work on your changes.
- Make your changes and test them.
- Push your changes to your forked repository.
- Create a pull request describing the changes.