Skip to content
Web Crawler that Collects Daum News ( Article Data
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.

news_crawler (Daum News Crawler)

This is a web crawler that collects Daum News ( article data, developed for the purpose of developing an engine that can distinguish fake news from real ones.

Using the Daum News Crawler

  • Enter the start date (the more recent date) and the end date in the format 'YEARMNDY' (e.g. 20170710) (e.g. if collecting from range 07/08/17 ~ 07/13/17, start date = 20170713 and end date = 20170708)
  • If you wish to edit the sections from which you wish to collect article data, edit DEFAULT_SEC_LIST
You can’t perform that action at this time.