Skip to content

This project get the raw data of gdelt from google. It also unzip the raw file, put them into hdfs and hbase for further use.

Notifications You must be signed in to change notification settings

Stratigraph/gdelt-1

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 

Repository files navigation

gdelt

Gdelt contains all the events happening in this planet since 1979 and is updated every 15 minutes.


  • Python script get the raw data of gdelt from google. Include V1 and V2.
  • Shell scripts unzip the raw zip files and import them into HDFS and HBASE.

For use, you need pay attention to the parameters about the paths used in the scripts and modify them as you need before using.

About

This project get the raw data of gdelt from google. It also unzip the raw file, put them into hdfs and hbase for further use.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published