The Omid project provides transactional support for key-value stores using Snapshot Isolation. Omid stands for Optimistically transactional Management in Datastores. At this stage of the project, HBase is the only supported data-store.
If you have any question, please take a look to the Wiki or contact us at omid-project@googlegroups.com or read the online archives
Add UCs.
The main component of Omid is a server called the Status Oracle (TSO.) The TSO contains all the information needed to manage transactions. Applications requiring transactional support in key-value stores need to use the API provided by special components provided by Omid called Transactional Clients (TCs). TCs are in charge of connecting to the TSO and perform the required operations in data-stores. The TSO replicates transactional information to the TCs which just contact the TSO when they want to start a transaction or commit it.
The TSO uses BookKeeper as a Write-Ahead Log where it dumps all its state. In case of crash failures it is possible to restart the TSO without losing any commit information.
The core architecture of the software is described in more detail in the Technical Details section of the Wiki.
Omid uses Maven as its build system. We are using a temporary repository for Zookeeper and Bookkeeper packages to ease the installation procedure.
To compile Omid:
$ tar jxvf omid-1.0-SNAPSHOT.tar.bz2
$ cd omid-1.0-SNAPSHOT
$ mvn install
Tests should run cleanly.
You need to run four components before running the transactional client in your applications: Bookkeeper, Zookeeper, Omid TSO and HBase. These are their dependencies:
- Bookkeeper is needed by the TSO
- Zookeeper is needed by Bookkeeper and HBase.
- The TSO is needed by HBase.
Hence, the order of starting should be:
- Zookeeper
- Bookkeeper
- TSO
- Hbase
Omid doesn't use anything special in Zookeeper or Bookkeeper, so you can use any install for these. However, if you are running this anywhere but localhost, you need to update the setting for HBase and TSO. See the HBase docs for changing the Zookeeper quorum. For TSO, you need to modify bin/omid.sh.
For simplicity we've included a utility script which starts Zookeeper and Bookkeeper. Run:
$ bin/omid.sh bktest
To start the TSO, run:
$ bin/omid.sh tso
To benchmark the TSO alone, run:
$ bin/omid.sh tsobench
We've included a utility script to start a HBase cluster on your local machine. Run:
$ bin/omid.sh tran-hbase
For running in a cluster
The public API is in these classes:
src/main/java/com/yahoo/omid/client/TransactionalTable.java
src/main/java/com/yahoo/omid/client/TransactionState.java
src/main/java/com/yahoo/omid/client/TransactionManager.java
For an example of usage, take a look to this class:
src/test/java/com/yahoo/omid/TestBasicTransaction.java
The logging preferences can be adjusted in src/main/resources/log4j.properties.
This project has been partially supported by the EU Comission through the Cumulo Nimbo project (FP7-257993).