Skip to content

POC for a data ingestion microservice using Go, Elasticsearch, and Rabbitmq

License

Notifications You must be signed in to change notification settings

enriquebris/data-ingestion-poc

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

data-ingestion-poc

POC for a data ingestion microservice using Go, Elasticsearch, and Rabbitmq. The concept is: large feeds are imported via an API written in go which concurrently distributes the messages to N workers (Go) via rabbitmq. Each worker processes the record into elasticsearch.

About

POC for a data ingestion microservice using Go, Elasticsearch, and Rabbitmq

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 90.2%
  • Shell 9.8%