Skip to content
Commits on Sep 20, 2012
  1. @garnaat

    Merge pull request #1001 from basak/add_description_parameter

    Add description to Vault.create_archive_from_file
    garnaat committed Sep 19, 2012
Commits on Sep 19, 2012
  1. Add description to Vault.create_archive_from_file

    Allow archive creation via create_archive_from_file to specify an
    archive description.
    Robie Basak committed Sep 19, 2012
  2. @garnaat

    Merge pull request #975 from tedder/8cd93058131df93932d8ea99e4e78ce06…

    …95a3ad8
    
    Add initial Glacier support in root boto object.
    garnaat committed Sep 19, 2012
Commits on Sep 18, 2012
  1. @garnaat

    Merge pull request #994 from jamesls/glacier-concurrent

    Add threaded multipart archive upload for glacier
    garnaat committed Sep 18, 2012
  2. @jamesls

    Add threaded multipart archive upload for glacier

    This will internally create a thread pool that concurrently
    uploads the various chunks of a file using the multipart
    API for glacier.
    
    When testing upload speeds, this was approximately 13 times faster
    than the single threaded archive upload.  It also is much better
    at sustaining a constant upload rate, in the single threaded
    upload, the upload rate fluctuated quite a bit (which makes sense
    given that it part of the time it's reading from disk and computing
    hashes instead of sending data).
    
    For comparison, for a 1GB file:
    
    Operation          | Time (secs) | Average Upload rate (MB/s) |
    ---------------------------------------------------------------
    s3multiput              216                6.0
    glacier-single         1291                2.0
    glacier-concurrent       98               11.5
    jamesls committed Sep 17, 2012
  3. @jamesls
  4. @jamesls

    Bug fix: format strings had an extra '%s'

    This was for abort_multipart_upload and list_parts,
    and list_multipart_uploads
    jamesls committed Sep 18, 2012
  5. @jamesls

    Pep 8 cleanup

    jamesls committed Sep 18, 2012
  6. @jamesls
  7. @jamesls
  8. @jamesls

    Bug fix: import urllib

    The make_request method uses urllib yet it is not
    imported.
    jamesls committed Sep 18, 2012
Commits on Sep 17, 2012
  1. @jamesls
  2. @jamesls

    Ensure file is opened in binary mode, fixes #988

    Was able to repro the issue by trying to submit a binary
    file, verified the fix works with binary files on windows.
    jamesls committed Sep 17, 2012
Commits on Sep 16, 2012
  1. @garnaat

    A few PEP8 cleanups.

    garnaat committed Sep 16, 2012
  2. glacier: fix Vault.retrieve_archive result type

    retrieve_archive is documented to return a Job object, but currently it
    returns a job id string. As this is layer 2, it would make more sense to
    return a full Job object, so do this instead.
    Robie Basak committed Sep 16, 2012
Commits on Sep 12, 2012
  1. @garnaat

    Merge pull request #980 from almost/glacier

    Support for retrieve-inventory by @yamatt
    garnaat committed Sep 12, 2012
  2. @almost

    Merge pull request #1 from yamatt/glacier

    Added retreive-inventory function
    almost committed Sep 12, 2012
Commits on Sep 11, 2012
  1. @jamesls
  2. @jamesls

    Raise a ValueError when writing to a closed file

    This is consistent with other file like objects including:
    
    * file
    * tempfile
    * StringIO
    jamesls committed Sep 10, 2012
Commits on Sep 10, 2012
  1. @garnaat

    Merge pull request #977 from jamesls/glacier-fileread

    Allow upload_archive to accept file like objects
    garnaat committed Sep 10, 2012
  2. @garnaat

    Merge pull request #968 from jamesls/glacier-perf

    Reduce memory usage for chunk_hashes
    garnaat committed Sep 10, 2012
  3. @jamesls

    Allow upload_archive to accept file like objects

    The entire file is never read into memory, only (configurable)
    single chunks are read at a single time.
    jamesls committed Sep 10, 2012
  4. @yamatt

    Added retreive-inventory function

    yamatt committed Sep 10, 2012
Commits on Sep 9, 2012
  1. @tedder
Commits on Sep 7, 2012
  1. @jamesls

    Allow single op threshold to be configurable

    This is the threshold at which the Vault class will
    use a multipart upload instead of a single operation
    upload.
    jamesls committed Sep 6, 2012
Commits on Sep 6, 2012
  1. @jamesls

    Reduce memory usage for chunk_hashes

    On a 180MB file this reduced total memory
    usage by approximately 40%.  This was also marginally
    faster (but not by much).
    
    I've also added the start of unittests for the writer module,
    and I've written some very basic unittests for the chunk_hashes
    function.
    jamesls committed Sep 6, 2012
  2. @jamesls
  3. @jamesls

    Pep8 cleanup to glacer l2 unit tests

    Also switched the assert statements to use
    assertEqual for better error diagnostics.
    jamesls committed Sep 6, 2012
  4. @jamesls
  5. @almost

    Added glacier to the readme :)

    almost committed Sep 6, 2012
  6. @almost

    Fixed tests

    almost committed Sep 6, 2012
  7. @almost

    Merge branch 'glacier' of github.com:boto/boto into glacier

    Conflicts:
    	boto/glacier/layer2.py
    almost committed Sep 6, 2012
  8. @almost
  9. @almost
  10. @almost

    Remove print statements, whoops

    almost committed Sep 6, 2012
Something went wrong with that request. Please try again.