Go Implementation of STF Distributed Object Store
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
api
cache
cli
config
data
dispatcher
drone
eg
etc
stftest
worker
.travis.yml
README.md
build.sh
constants.go
database.go
database_test.go
debug.go
install.sh
murmurhash.go
server_storage.go
stf.go
stf.sql
test.sh

README.md

go-stf-server

Build Status

Coverage Status

Go Implementation of STF Distributed Object Store

Current Status

STF is a simple, amazon S3-like distributed object store, aimed for people who want to run such systems on their own data centers, on commodity hardware.

While the Perl version is used in production for over 3 years handling billions of hits every day, this go version is still in heavy development.

Features

  • Simple GET/POST/PUT/DELETE to perform CRUD operations
  • Multiple copies of the data are stored in the backend storage to prevent data-loss
  • Supports Q4M/Redis as queue backends (use '-tags redis' or '-tags q4m' when compiling)
  • Automatic storage failure detection

Done, so far

  • Object creation works.
  • Object fetch works.
  • Object deletion works.
  • Workers: Auto-balancing via simple leader-election
  • Workers: RepairObject / ReplicateObject / DeleteObject done

TODO

  • Move objects
  • Web UI

Installation

To install go-stf-server's binaries, you can simply use the following:

curl -L https://raw.githubusercontent.com/stf-storage/go-stf-server/master/install.sh | bash -s

This downloads and compiles go-stf-server's binary files into /usr/local/stf

To change where files are installed, you can use the --prefix option:

curl -L https://raw.githubusercontent.com/stf-storage/go-stf-server/master/install.sh | bash -s --prefix /opt/local/stf

To change the queue type, you can use the --queue options:

curl -L https://raw.githubusercontent.com/stf-storage/go-stf-server/master/install.sh | bash -s --queue redis