Skip to content

Hacker news web scraper with few customizations.

Notifications You must be signed in to change notification settings

gkrockz/news-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

News scraper

Usage: using this script you can get customized Hacker news, which has got more than 100 votes; with the help of web scraping.


📑 Libary references:

  1. To scrape information from web pages - Beautifulsoup4

  2. To send HTTP requests easily - Requests

  3. To pretty-print data - pprint


Note :

  1. Data scraping isn't allowed on all websites, so double check with the robots.txt on any website. Try it out now

  2. Don't prefer web scraping at the first place, Rather make of use of API's which are provided by websites. For example, we can perform the same task using HackerNews API

  3. If there isn't any API for a given website, then prefer going for web scraping in a ethical way.


Console Output


About

Hacker news web scraper with few customizations.

Topics

Resources

Stars

Watchers

Forks

Languages