Scrape news from https://economictimes.indiatimes.com/
- Download the code from repository
- Run
npm install - Change the follwing values in the file
starttime = date from which scraping should begin
endtime = date on which scraping should end
filename = name of the output csv file
batchsize = number of news articles that should be scraped asynchronously (high if network speed is good, low otherwise)
- Run the file using
node
The starttime and endtime numbers can be found by navigating to any day from the archives (https://economictimes.indiatimes.com/archive.cms) and copying the starttime parameter from the url.