Skip to content
An Elasticsearch to mongo Migration Framework
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.gitignore
LICENSE
README.md
__init__.py
config_reader.py
mongoes.json
mongoes.png

README.md

N|Solid

MongoES

A robust elasticsearch to Mongo Migrator. As of now, the data migration is a one-way lane from Elasticsearch to MongoDB. The migration from mongoDB to Elasticsearch is currently underway.

Features!

  • No external queues/message brokers needed
  • Resumes from the custom mongoes_id custom built-in elastic_search checkpoint, in case of data transfer failures.

Prerequisites:

Steps:

  1. Install all the Prerequisites.
  2. Clone the repository.
  3. Edit the mongoes.json file according to your requirements.
{
	"EXTRACTION":
		{
			"HOST": "localhost",
			"INDEX": "lorem_ipsum",
			"DBENGINE": "elasticsearch",
			"PORT":9200
		},
	"COMMIT":
		{
			"HOST": "localhost",
			"DATABASE": "plasmodium_proteinbase",
			"COLLECTION": "mongoes",
			"DBENGINE": "mongo",
			"PORT":5432
		}
}
  1. Make sure that both the elasticsearch and mongoDB services are up and running.
  2. And finally, fire the migrator engine by keying in:
$ python3 __init__.py
  1. Sit back and relax; for we got you covered! The migration's default value is 1000 entries per transfer.

Happy Wrangling!!! :)

N|Solid

You can’t perform that action at this time.