Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also compare across forks.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also compare across forks.
base fork: voldemort/voldemort
base: master
...
head fork: voldemort/voldemort
compare: origin/zone-expansion
Checking mergeability… Don’t worry, you can still create the pull request.
Commits on Jul 01, 2013
@jayjwylie jayjwylie Change Repartioner to swap among nodes from all specified zones.
PartitionBalance
- Added comment about possible weakness of our utility method.

Repartitoiner.java
- Changed random shuffle implementation to swap among all nodes in
  specified zones.
- Left TODOs and 'dead code' implemntation of intra-zone swapping vs
  inter-zone swapping.
078da6d
@voldemort Add rebalance shuffle script 326ed4f
@voldemort Fix location of example stores 7111739
@voldemort Add cluster expansion script a2d7f73
@voldemort Fix comments b404fe7
@voldemort Get rid of tee-ing the plan to a separate file
The rebalance planner writes the output to a file named
plan.out so this is not needed anymore.
d678308
@voldemort Remove vold_home parameter from scripts
These scripts are being shipped as part of vold repo and so
no need for this extra parameter.
baefd00
@voldemort Copy plan outout to the final directory 9592791
@voldemort Cleanup minor typos and comments a114f7e
@voldemort Expose max contiguous partitons option to script e6fee03
Commits on Jul 02, 2013
@jayjwylie jayjwylie Merge branch 'zone-expansion' of github.com:voldemort/voldemort into …
…zone-expansion
dbb8acf
Commits on Jul 03, 2013
@voldemort Make repartitioner interface consistent + cleanup c93bc85
@voldemort More cleanup to repartitioner
Fix varible names, typos add comments
61c15f6
Commits on Jul 04, 2013
@voldemort Rename new cluster script 87691c6
@voldemort Copy analysis file to output_dir 399bd28
Commits on Jul 08, 2013
@voldemort Fix NPE in the test code
Pass an empty list instead of a null.
c0d1599
Commits on Jul 09, 2013
@jayjwylie jayjwylie Drop KeyDistributionGenerator and Entropy
The intended usage of KeyDistributionGenerator and Entropy has been replaced. The PartitionAnalysisCLI and PartitionBalance tools replace the 'skew' estimation functionality of these tools. The KeySampler and KeyVerionFetcher replace the verification functionality of the EntropyChecker.

The helper method KeyDistributionGenerator.getUniqueStoreDefinitionsWithCounts has moved to StoreDefinitionUtils.getUniqueStoreDefinitionsWithCounts.
3b022ae
@jayjwylie jayjwylie Complete dropping KeyDistributionGenerator 279c6c3
@jayjwylie jayjwylie Drop server-side rebalancing optimization, fix proxy put config
The RebalancePlan object now produces "optimized" plans. I.e., data is not moved to a server that already hosts that data. This means that server-side optimizations to not fetch data the server already has are not needed.

The voldemort config had a parameter to turn proxy puts on/off. Now that they are tested, they should always be on for the sake of making sure rebalances are abortable. Also, the proxy put default number of threads was one. It is now set in the same manner as nio selectors.

Sorry for all the unnecessary white space changes. I need to reset my eclipse settings.
111a378
Commits on Jul 10, 2013
@jayjwylie jayjwylie Removed maxTries option from Rebalancing
maxTries was a hack to work around problems with the scheduling of
rebalancing tasks. The new scheduler (is supposed to) ensure that no
node is doing more than one rebalancing thing (stealing or donating) at
time. Therefore, not being able to schedule an asynchronous rebalancing
task (stealer-based) on a node is a big problem and should not be
retried.
616f704
Commits on Jul 12, 2013
@jayjwylie jayjwylie Added 'details' option to KeyVersionFetcherCLI
The 'details' option results in the inclusion of the partition ID,
node ID, and host for each fetched key-version. This should help
relate specific changes in the key-versions fetched before and after
rebalance to specific steps in the rebalancing plan.
bf52cd1