axshivam / Url-Feeder-Service Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

A url feeder service that takes an url, stores it in the MySQL database, and publishes various types of topics into Kafka based on the url's content type; these topics are later subscribed to by different services, and the service extracts the url's metadata and stores it in the MongoDB database.

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 20 Commits
image		image
url-feeder-service		url-feeder-service
worker-service		worker-service
.gitignore		.gitignore
README.md		README.md

Repository files navigation

Url-Feeder-Service

Here is work flow of the application

About

A url feeder service that takes an url, stores it in the MySQL database, and publishes various types of topics into Kafka based on the url's content type; these topics are later subscribed to by different services, and the service extracts the url's metadata and stores it in the MongoDB database.

nodejs mysql docker kafka mongodb docker-compose mongoose

Report repository

Releases

No releases published

Packages

No packages published

Languages