Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Commits on Jul 23, 2015
  1. @jcwilson
Commits on Jul 21, 2015
  1. @fviard

    Merge pull request #586 from Tim-Anderson/remove_ignore_failed_copy

    fviard authored
    Replace ignore_failed_copy with stop_on_error
Commits on Jul 20, 2015
  1. @Tim-Anderson

    Replace ignore_failed_copy with stop_on_error

    Tim-Anderson authored
    This fully removes the option and switches its use to stop_on_error.
    Also document the new EX_PARTIAL and use of stop_on_error in the README.
    
    Signed-off-by: Tim Anderson <tsa@biglakesoftware.com>
  2. @Tim-Anderson

    Change Multipart error so it can continue

    Tim-Anderson authored
    Raise S3UploadError() instead of S3Error() so the PARTIAL handling will
    continue to work.
    
    Signed-off-by: Tim Anderson <tsa@biglakesoftware.com>
Commits on Jul 17, 2015
  1. @Tim-Anderson

    Error check on multipart upload

    Tim-Anderson authored
    This addresses #577
    
    Signed-off-by: Tim Anderson <tsa@biglakesoftware.com>
Commits on Jul 16, 2015
  1. @fviard

    Merge pull request #580 from Tim-Anderson/error_stop

    fviard authored
    Add stop_on_error
    Merged! Thanks!
Commits on Jul 14, 2015
  1. @fviard

    Don't slurp whole file while computing SHA256 checksum. Rework of the…

    fviard authored
    … PR of petr-tichy.
    
    When using large --multipart-chunk-size-mb or --disable-multipart, the whole file was read into memory.
    
    Based on: #579
  2. @Tim-Anderson

    Add better exit errors on stop_on_error

    Tim-Anderson authored
    This will now return either EX_DATAERR on transfer error or EX_OSFILE if
    invalid file name, when stop_on_error is selected. Also add the 2
    missing exit paths from the original pull request.
    
    Signed-off-by: Tim Anderson <tsa@biglakesoftware.com>
Commits on Jul 13, 2015
  1. @Tim-Anderson

    Add stop_on_error

    Tim-Anderson authored
    Add a configuration option that allows an error return on any transfer
    error of a file. This is a config option (stop_on_error)  and a
    commandline option (--stop-on-error). The Default is the current
    continue behavior. With the option or config setting to True, the
    commands (get, put, sync remote2remote, remote2local, or local2remote)
    will all return an error status. The Get and Put commands return
    EX_PARTIAL where the typical response on sync will be EX_TEMPFAIL but
    could be any of:
    
    * EX_SERVERMOVED
    * EX_SERVERERROR
    * EX_ACCESSDENIED
    * EX_NOTFOUND
    * EX_CONFLICT
    * EX_PRECONDITION
    * EX_SERVICE
    * EX_SOFTWARE
    
    Signed-off-by: Tim Anderson <tsa@biglakesoftware.com>
Commits on Jul 2, 2015
  1. @fviard

    Merge pull request #574 from koenrh/https-by-default

    fviard authored
    Use HTTPS by default
    Merged, thank you for the patch!
Commits on Jun 21, 2015
  1. @koenrh

    Use HTTPS by default

    koenrh authored
Commits on Jun 17, 2015
  1. @fviard

    Fixes #528 (#528).

    fviard authored
        There is a lot of different "python-magic" libraries/versions, all doing different things, so all cases need to be covered.
    file-5.11 has be switched with "filemagic" as it should be more commonly used.
    Introspection in each python magic lib has been done to ensure to handle encoding or not only when it is needed.
Commits on Jun 15, 2015
  1. @mdomsch

    Try using Config.bucket_location if we haven't received a redirect

    mdomsch authored
    Right now the send_file() routine is always sending a
    GetBucketLocation request before actually trying to send the file,
    because the S3Request.region_map is empty initially.
    
    Instead, we should trust the value of Config.bucket_location until
    such time as we have received a 400 failure and been told the correct
    location.  This avoids needing to have s3::GetBucketLocation
    IAM permission also, when we know the correct bucket_location already
    (either from config file or command line option).
Commits on Jun 14, 2015
  1. @mdomsch

    Merge pull request #538 from kahing/bigger_chunk_size

    mdomsch authored
    enlarge write and read buffers
Commits on May 18, 2015
  1. @mdomsch

    Merge pull request #537 from flisky/master

    mdomsch authored
    FIX #535 mark delay-updates obsolete
Commits on May 11, 2015
  1. @mdomsch

    [info] use last-modified value, not date

    mdomsch authored
    The date header contains the remote server's current time.  That's not
    what we want.  Instead, we want the last-modified value for the file
    being inspected with the [info] (or equivalent) request.
    
    Thanks to Andrew Trusty for finding, diagnosing, and suggesting a
    fix.  And thanks to DreamObjects for "forgetting" to include a date
    header in their response to a HEAD of an object on occasion, that led
    us to find this.
    
    This should also improve --no-check-md5 cases where the timestamp is
    being checked, as we won't think that remote files have a timestamp of
    "now".
Commits on Apr 30, 2015
  1. @kahing

    enlarge write and read buffers

    kahing authored
    I was able to get 30% better put performance to local S3 endpoint
Commits on Apr 29, 2015
  1. @flisky

    FIX #535 mark delay-updates obsolete

    flisky authored
Commits on Apr 23, 2015
  1. @ddzialak
Commits on Apr 3, 2015
  1. @BCrookAtRA

    Adding -l option for long_listing

    BCrookAtRA authored
    list_storageclass now provided by long_listing and -l.
    Minor whitespace cleanup.
  2. @BCrookAtRA

    Added support for listing StorageClass attribute.

    BCrookAtRA authored
    Disabled by default.  Enable with list_storageclass = True in .s3cfg
Commits on Mar 30, 2015
  1. @mdomsch

    add [payer] command

    mdomsch authored
    which takes the --requester-pays as its argument (or not), and sets
    the payer policy accordingly.
  2. @mdomsch

    move setting requester-pays into S3Request() init

    mdomsch authored
    This way we can catch all all GET and POST calls as
    https://docs.aws.amazon.com/AmazonS3/latest/dev/ObjectsinRequesterPaysBuckets.html
    indicates we should do.  This also lets us [ls] an object in a
    requester-pays bucket which we couldn't do before.
  3. @mdomsch
  4. @mdomsch

    add --requester-pays (#511)

    mdomsch authored
    This introduces a --requester-pays command line option, which is used
    in the recv_file() function to add the proper
    x-amz-request-payer:requester header to the GET request in downloading
    the file.
Commits on Mar 24, 2015
  1. @mdomsch

    more IOError EPIPE catches

    mdomsch authored
Commits on Mar 18, 2015
  1. @mdomsch

    Merge pull request #508 from fviard/fix_encoding_multipart_filename

    mdomsch authored
    Another fix related to fix encoding issues. (file.name / stream.name are...
  2. @fviard

    Another fix related to fix encoding issues. (file.name / stream.name …

    fviard authored
    …are bytes, so unicodise them also)
  3. @fviard

    For copy and modify, take care to check if there is an error after th…

    fviard authored
    …e start of the operation (reported by a status 200 but an "Error" root entry in the xml body)
    
    In addition, for the move, It is good to check for the CopyObject xml reply to see if it is a success.
    But, if there is a status of 200 and no "data" in response, don't fail. Other S3 server implementations use only status code and don't return any body when there is no error.
    
    References:
    http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectCOPY.html
    http://doc.s3.amazonaws.com/proposals/copy.html
  4. @mdomsch

    Remove useless imports and unused variables

    mdomsch authored
    as noted by pyflakes.
  5. @LocutusOfBorg
Commits on Mar 16, 2015
  1. @mdomsch

    Merge pull request #495 from fviard/batch_encoding_fixes

    mdomsch authored
    Fixes for encoding issues
  2. @fviard

    Fix wrong exception used for EOF from S3 error during recv_file. (S3E…

    fviard authored
    …rror expect an http response, not a text message)
  3. @fviard

    fix encoding : Added encode_to_s3 and decode_from_s3 function + switc…

    fviard authored
    …hed to "unicode" call instead of "decode" as it is supposed to be more efficient.
Commits on Mar 13, 2015
  1. @fviard
Something went wrong with that request. Please try again.