Skip to content

DFS is a prove of concept for a single volume datastore written in Python

License

Notifications You must be signed in to change notification settings

dblommesteijn/dfs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DFS

Hosting and storing multiple small files in a single larger file-container (reducing multiple file open actions). Prove of concept.

  • first results: 111Kb files load in ~800ms (rather slow)

Installation

Prerequisites

  • Python 2.7
  • pip
  • virtualenv
  • uwsgi

Usage

Create volumes

Create storage volumes for dfs, this will not overwrite existing files (by default, -f flag will overwrite).

./script/dfs init <target> <size_in_mb>

Upload file

Uploading multiple files through curl (example)

curl -iX POST http://localhost:5000/file/append -F "file[]=@path_to_file.ext" -F "file[]=@path_to_file2.ext"

Development

Running Local Server

./script/dfs serve <target>

Production

Running wsgi server

TODO: add config options

uwsgi configs/wsgi.yml

Nginx config

  • stub

About

DFS is a prove of concept for a single volume datastore written in Python

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages