Learn · Create · Master

Simple Hacker News web scraper 👀

This is a simple project I initially did for fun in 2020. Putting it up on GitHub to have some pass time, over the weekend collaborative work done on it. What was this project initially intended to do? Scrape data from Hacker News (a popular social news website focusing on computer science and entrepreneurship) using BeautifulSoup.

⚙ Install

# BeautifulSoup
pip install beautifulsoup4

# Requests
pip install requests

📃 Todo:

• Web Scraping
  • Get Latest news - use top 2 pages
  • Get News with votes > 100
• Store data (JSON or Database) - use a free but reliable option
• Setup cron to get data - use GitHub Actions
• API
• React App

🐱‍👤 Contribute

1. Fork it!
2. Create your feature branch: git checkout -b my-new-feature
3. Commit your changes: git commit -am 'Add some feature'
4. Push to the branch: git push origin my-new-feature
5. Submit a pull request

🧠 Contributors

Vikash Chand 📖 💻 🎨 💡