Bigslice

Bigslice is a serverless cluster data processing system for Go. Bigslice exposes composable API that lets the user express data processing tasks in terms of a series of data transformations that invoke user code. The Bigslice runtime then transparently parallelizes and distributes the work, using the Bigmachine library to create an ad hoc cluster on a cloud provider.

website: bigslice.io
API documentation: godoc.org/github.com/grailbio/bigslice
issue tracker: github.com/grailbio/bigslice/issues
Travis CI: https://travis-ci.org/grailbio/bigslice

Developing Bigslice

Bigslice uses Go modules to capture its dependencies; no tooling other than the base Go install is required.

$ git clone https://github.com/grailbio/bigslice
$ cd bigslice
$ GO111MODULE=on go test

Name		Name	Last commit message	Last commit date
Latest commit History 192 Commits
archive/tarslice		archive/tarslice
cmd		cmd
docs		docs
exec		exec
frame		frame
internal		internal
mapio		mapio
sliceconfig		sliceconfig
sliceio		sliceio
slicetest		slicetest
slicetype		slicetype
sortio		sortio
stats		stats
typecheck		typecheck
.gitignore		.gitignore
.travis.yml		.travis.yml
CNAME		CNAME
LICENSE		LICENSE
README.md		README.md
accum.go		accum.go
accum_test.go		accum_test.go
cache.go		cache.go
cache_test.go		cache_test.go
cogroup.go		cogroup.go
cogroup_test.go		cogroup_test.go
doc.go		doc.go
func.go		func.go
func_test.go		func_test.go
go.mod		go.mod
go.sum		go.sum
name_test.go		name_test.go
reduce.go		reduce.go
reduce_test.go		reduce_test.go
reshard.go		reshard.go
reshard_test.go		reshard_test.go
scan.go		scan.go
scan_test.go		scan_test.go
slice.go		slice.go
slice_test.go		slice_test.go

License

mbrukman/bigslice

Folders and files

Latest commit

History

Repository files navigation

Bigslice

Developing Bigslice

About

Resources

License

Stars

Watchers

Forks

Languages