Skip to content

jo8937/apache-beam-dataflow-python-bigquery-geoip-batch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

bigquery table ip to country dataflow batch

python script use apache-beam and Google Cloud Platform Dataflow.


(1) geoip

BigQuery Table which include IP List to dest table which mapped GeoIP Country.

execute like this

python geoip_mapper.py googleProjectId src_dataset src_tablename dest_dataset dest_tablename gs://test/ testjobname  

BigQuery Table Data Example

Source Table

ip accessTime
112.175.60.132 2017-06-10 17:51:46 UTC
216.58.197.206 2017-06-10 18:12:26 UTC

Result Table

ip accessTime GeoIpCountry
112.175.60.132 2017-06-10 17:51:46 UTC KR
216.58.197.206 2017-06-10 18:12:26 UTC US

This product includes GeoLite data created by MaxMind, available from http://www.maxmind.com.

About

python script use apache-beam and Google Cloud Platform Dataflow.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages