Skip to content
Web Crawler that Collects Daum News (http://media.daum.net/) Article Data
Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
LICENSE
README.md
daumNewsCrawler.py
sample.zip

README.md

news_crawler (Daum News Crawler)

This is a web crawler that collects Daum News (http://media.daum.net/) article data, developed for the purpose of developing an engine that can distinguish fake news from real ones.

Using the Daum News Crawler

  • Enter the start date (the more recent date) and the end date in the format 'YEARMNDY' (e.g. 20170710) (e.g. if collecting from range 07/08/17 ~ 07/13/17, start date = 20170713 and end date = 20170708)
  • If you wish to edit the sections from which you wish to collect article data, edit DEFAULT_SEC_LIST
You can’t perform that action at this time.