Skip to content

tsileo/blobsfile

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
1 branch 4 tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
.build.yml
 
 
LICENSE
 
 
README.md
 
 
blobsfile.go
 
 
blobsfile_test.go
 
 
go.mod
 
 
go.sum
 
 
index.go
 
 
index_test.go
 
 
BlobsFile Features

README.md

BlobsFile

builds.sr.ht status    Godoc Reference

BlobsFile is an append-only (i.e. no update and no delete) content-addressed blob store (using BLAKE2b as hash function).

It draws inspiration from Facebook's Haystack, blobs are stored in flat files (called BlobFile) and indexed by a small kv database for fast lookup.

BlobsFile is BlobStash's storage engine.

Features

  • Durable (data is fsynced before returning)
  • Immutable (append-only, can't mutate or delete blobs)
  • Optional compression (Snappy or Zstandard)
  • Extra parity data is added to each BlobFile (using Reed-Solomon error correcting code), allowing the database to repair itself in case of corruption.
    • The test suite is literraly punching holes at random places

About

BlobStash's storage engine. Mirror of https://git.sr.ht/~tsileo/blobsfile

Topics

go storage-engine content-addressed blobstash

Resources

Readme

License

MIT license
Activity

Stars

16 stars

Watchers

5 watching

Forks

2 forks
Report repository

Releases

4 tags

Packages

No packages published

Languages