Skip to content
Sync large datasets easily with smart multithreading
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
debugging-scripts
git-misc
old
unisonctrl
.flake8
.gitignore
README.md
enableGitHooks.sh

README.md

UnisonCTRL

Coverage Status

UnisonCTRL makes it easier to sync large mostly-read-only datasets with unison by spawning multiple unison instances ("threads"). Using the unisonctrl configuration file, instances can be tuned so that each unison instance is only responsible for a specific subset of the data, allowing large datasets to be synced efficently. Additionally, using this technique, an administrator can split up hot-data into smaller groups (allowing faster syncing) and colder data into larger groups (allowing slower syncing with less resources).

To run, execute python3 unisonctrl/unisonctrl.py. This is designed to be run in cron, once per minute.

TODO:

  • Get webhooks working for reporting and monitoring
    • Number of new/existing instances
    • Instance information
    • Report on unknown dead instances - this is important
  • Turn into a proper terminal tool with options, like force restart all, and get stats
You can’t perform that action at this time.