Skip to content

It is a selenium based verge scraper to scrape dates, headlines and links for all the articles in a month and year

Notifications You must be signed in to change notification settings

Athe-kunal/Verge_Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Verge_Scraper

It is a selenium based verge scraper to scrape dates, headlines and links for all the articles in a month and year. It is inspired JimShapedCoding video on Selenium and formatted accordingly.

To get results, run the run.py file with keyword being the Named entitites for which you are searching, like Apple. Year is in string format and in month February can be passed as Feb to get results. It will give a list and dataframe output

Start by passing your driver path in the scraper.py init() function and then pass in your keyword arguments in the run.py file

The future plan is to create a docker file for easy installation and running containers

About

It is a selenium based verge scraper to scrape dates, headlines and links for all the articles in a month and year

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages