Skip to content

AndrewPang321/Crawler-Data-Formatting

Repository files navigation

Crawler-Data-Formatting

Transform the news data got from the crawler to required format and output to a file. Newspaper3k is used to extract news data from newspaper website. For more details for Newspaper3k, please visit: https://github.com/codelucas/newspaper

The initial purpose is to transform the news data to JSON format and import to the Firebase database.

Prerequisites

  • Newspaper3k
  • Python 3+

About

Transform the news data got from the crawler to required format and output to a file

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages