A tool for scraping news data from detik.com official website, based on the keywords you want to search.
How to use:
- Clone this repository, and install "Scrapy Library" and "mysql-connector Library" on your Python.
- Import detik.sql to your mySQL
- Change directory to "DetikScraper"
- Open file detikscraper.py
- Edit on line 9 to determine the year of news you want to search
- Edit on line 10 to determine the keywords of news you want to search
- And run "scrapy crawl detikscraper"