Skip to content

streaming file uploads to s3, without touching the disk

Notifications You must be signed in to change notification settings

miketaylr/streamr

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

streamr

This is an experiment to see how well node can handle streaming file uploads directly to S3, without touching the file system on the server. To do this, it uses modified versions of node-formidable to handle the file parsing and knox to push the files out to S3.

Formidable has been changed to accept a custom WriteStream, instead of the default fs.WriteStream. Knox's client.putStream method has been updated to expect any type of stream, not just a file stream (and to use stream.pipe instead of manual event bindings).

Example

To run the example app you'll need to set your AWS creds (and bucket name) as environment variables.

$ export AWS_KEY=(your aws key) AWS_SECRET=(your secret) BUCKET=(bucket name)
$ node server
> server listening on port 3000

Once the demo is running, just drag a file into the window and it will upload straight to your S3 bucket. Check the console for file info.

Contributings

I'd love feedback, so please open a pull request or submit an issue!

About

streaming file uploads to s3, without touching the disk

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 100.0%