v2.3.0

Changelog

• bbc13fd .github/workflows/ci: bump staticcheck to v0.4.3 (peak#612)
• 4218176 .github/workflows/ci: run on push/pr against master branch (peak#605)
• 3efbbe8 .github/workflows: Add external endpoint test before release (peak#508)
• 1e7234a .github/workflows: run ci on last the last 3 go versions (peak#361)
• 62cec06 .github/workflows: run goreleaser on go1.17 (peak#362)
• 9da56bd Add --parents option to batch cp and batch mv
• f55def1 Add -cs option for multipart chunk size
• 602db8e Add -gops option to init gops agent
• 5cb2c92 Add -ia option for IA storage, support in ls as well
• a8e0bf8 Add -rr option for reduced-redundancy storage
• 136baf1 Add -version
• 2812c1b Add Github Actions file
• d978f45 Add Homebrew formula
• 90e830f Add LICENSE
• 755ffd2 Add README
• 5c3ceca Add S5CMD_GOPS env variable to enable gops
• c02fdb6 Add a packaging badge (peak#439)
• effae7f Add arg count check to parser
• 914e701 Add benchmark script to compare two different builds of s5cmd (peak#471)
• 1b77a4f Add cenkalti/backoff to vendor/
• 83edca8 Add central log package (peak#80)
• b90e5b5 Add cheggaaa/pb.v1 to vendor/
• b342f1d Add context support for long-running or batch AWS requests
• 3f8a523 Add custom shell installer, simplify instructions
• 565cad1 Add demo recordings
• 3493c3f Add demo recordings to README
• be2646c Add dep manifest/lock files
• 3cf1424 Add e2e tests (peak#44)
• 36d74f6 Add installation instructions for conda (peak#468)
• 01a2df1 Add interruption support and progressbars to upload/downloads
• 9698760 Add mb (make-bucket) command (peak#86)
• 88fd4af Add missing S3->S3 e2e tests (peak#66)
• 601899f Add missing op counter to mv
• b43df69 Add missing sync command flags (peak#409)
• 8fc0c68 Add more notes about preserving dir structure for cp & mv commands
• 518a657 Add more s3manager chunk/worker configuration options (-dlw, -dlp, -ulw)
• f61b4a9 Add more verbose logging
• 372e7c6 Add no-clobber (-n) option to cp and mv
• 9a6245f Add option to disable SSL verification
• 20664fa Add param validation tests, stricter checking
• 1971681 Add retry counters, exit with 127 if failed jobs present
• 8be6322 Add the -h flag to autocompleter
• 4d5c627 Add vendor dir
• 9a0e55d Align ls -e output (peak#129)
• d22c7fa Always send EOF at the end of wildOperation calls
• a56fde9 Append filenames into destinations ending with /
• cfdf8a1 Assume us-east-1 as the default region, set AWS_SDK_LOAD_CONFIG=0 to disable shared configurations
• 9cfe1ee Auto-calculate upload chunk sizes
• 8654856 Autocomplete optional args as well
• 186daa3 Autodetect bucket region in command completion
• aac20a5 Badges.
• 2699c85 Batch-delete objects
• 96435b2 Better "dir" detection in batch operations
• da289c8 Better EOF handling
• 4cf7d8f Better comments support
• 63fff6d Better ls logic
• 72d5d8e Better names for command/option help methods
• e2f8566 Brew formula update for s5cmd version v0.7.8
• 7795501 Brew formula update for s5cmd version v1.0.0
• 0dc7c2f Brew formula update for s5cmd version v1.1.0
• 5ac8d70 Brew formula update for s5cmd version v1.2.0
• a2fa501 Brew formula update for s5cmd version v1.2.1
• ed0556d Brew formula update for s5cmd version v1.3.0
• 840db92 Brew formula update for s5cmd version v1.4.0
• eec4e72 Brew formula update for s5cmd version v1.4.0-rc.1
• 2fb7a3e Bump dependencies, use new dep format
• fa8f356 Bump go module version to v2 (peak#556)
• af8d725 CHANGELOG: add bugfix entry for peak#576 (peak#588)
• 32597b7 CHANGELOG: add reference to peak#412 (peak#434)
• 7f3ce74 Catch the rare s3manager panics and retry exponentially
• 6e3fc4f Change cp error not being descriptive (peak#463)
• 8501ba5 Change default chunk size (5 to 50) and s3manager related param names
• 7aa10f4 Change default copy behaviour to preserve directory structure (peak#133)
• 9622049 Change flag to no-verify-ssl
• 2264e5f Change idle worker detection logic, reduce idle-timer values
• 3a25427 Change package naming
• 0f060f8 Change sub-job output, add batch-operation and ls counters
• 36e4ea5 Clean up dependencies in vendor
• 03f170a Clean up messages and errors
• 6f8df33 Clean up verbose output
• e7f2068 Cleanup
• 9b80dfa Cleanups, add test and bench goals to Makefile
• bedc013 Clear up -numworkers help message
• 464ffd8 Clear up number of workers in single command invocation description
• 4f42700 Clearer S3 source params (don't allow source buckets without an object/prefix in copy operations)
• 40b0fbe Consider "RequestError" retryable
• 76e7ce0 Correctly parse key if prefix is not a directory (peak#53)
• 442764c Default to 256 workers, use negatives to specify multiples of NumCPU
• cdc5215 Detect and retry if the sub-error is retryable as well
• 880fc6e Display sub-job error messages in short format
• d4aa0cf Dockerfile: use /aws as working directory (peak#412)
• c7df42e Don't list all available commands with descriptions and options in help screen, just list commands and general opts instead. Equalize "-h" invocation with invocation without any args
• 44b25e5 Don't make exponential backoff stop if the retry took more than 15 minutes
• 6df64b6 Enable shared AWS configuration
• 318dcad Exit when file ends
• 0a35645 Exponential retries for S3 throttling
• 50e0dff Few more comments
• dabe2eb Fix anchor in README
• 62a9ff9 Fix bare-bucket operations and misformatted s3 url handling
• fc6223f Fix basic job tests
• f348c42 Fix comment-only line handling
• 2d45404 Fix comments for ErrObjectIsNewer/ErrObjectSizesMatch (peak#159)
• 714d7ee Fix default value for -f
• 22cafd0 Fix get/cp without 2nd param or exact destination filename
• 3b05dee Fix glob misdetection
• 10c173a Fix graceful exit on interrupt
• b2cdb60 Fix hang condition if all workers are cancelled before the sub-job queue is empty
• d582275 Fix option highlighting in README
• b3b74f4 Fix race
• fd66eed Fix test
• 1f731c7 Fix test
• e81de7d Fix the AcceptableError interface
• 85515d2 Fix typo in README.md (peak#171)
• 8c3ebce Fix vendored gops
• 7ee75de Fixes for the linter, massive godoc update
• 1d6ef70 Formatting
• 4fecc17 Gear up for release!
• a511ab5 Get rid of name collision
• 1f727ea Get rid of the uint32 for numWorkers, use zero-value for idlingCounter
• 965c911 Glob argument types should not match S3 URIs
• 15bd7d8 Handle too many open files errors (peak#131)
• 19d6cd0 Ignore *.iml files
• e13f868 Implement "command -h" help texts, rename human-readable output option as "-H"
• e9cdfa9 Implement "s5cmd get"
• 84868a7 Implement peak#279 (peak#280)
• 13fc4c6 Implement ls -e to show ETags in listing.
• 9df4277 Implement exit command, blocking improvements
• 980555d Implement filesystem storage (peak#62)
• deec719 Implement human-readable size (-h) option for ls and du commands
• 945e680 Implement list-buckets and list-objects (with wildcard support) commands
• 5056920 Implement local-to-local batch copy and move operations
• 90ddcef Implement new du option: "du -g" to group by storage class
• eb42485 Implement s3-to-s3 batch copy and move operations
• 8cd2683 Implement shell autocompletion
• cf79cab Implement standalone job producer (peak#65)
• 473aebc Implement storage package (peak#50)
• e55987b Implement the du command
• d0e2f20 Implement verbose output, mostly for the command parser (-vv flag)
• 7565043 Introduce AcceptableErrors: A failed "cp -n" due to the object/file existence is not really an error
• a74e799 JobArgument: Don't mix receiver types
• 6698292 Keep a changelog (peak#39)
• 57f6cb6 Keep and display statistics after finishing
• 0b6039b List available commands
• 9a7fa24 Location of credentials for accessing Google Cloud (peak#377)
• 38b0fdf Make it possible to override content-type and content-encoding from CLI arguments (peak#467)
• b6ed99a Make megacheck happy
• f79ed0b Makefile: check if the vendor has no diffs (peak#731)
• c5b9c97 More comments
• cf44100 More godoc comments
• b29d6b6 More godoc to make golint happy.
• 66e5463 Move s3url to separate package
• 0fbb6ec Nested commands
• d51e1f8 Parser errors with unlimited params: Log verbosely only if -vv is set
• f559191 Prefix local-running commands with !, clarify README
• dfec9ef Prepare v0.7.0
• b7f0c3e Reallow single commands, start lines with hash for comments
• 978a6b8 Rearrange README
• cad84f2 Refactor S3 listing
• c436687 Refactor core/JobArgument into its own file
• 3e51198 Refactor s3 url parser (peak#49)
• 7166ad5 Release v0.5.1
• 8d65bab Release v0.5.2
• f6bea31 Release v0.5.4
• 0254706 Release v0.5.5
• bc7b87c Release v0.5.6
• 44890d7 Release v0.5.7
• 633d01e Release v0.5.8
• 4d9293f Release v0.6.0
• 3db868a Release v0.6.2
• b5106e8 Remove Dockerfile (peak#42)
• ee01a3f Remove Github Actions file
• 0b863bd Remove TODO
• 1ac8fbc Remove artifact file from peak#194
• 26e9887 Remove dependency
• 3effa47 Remove progress bars. Gets rid of memory leak + concurrent display problems
• d5dde3c Remove stat flag unnecessary prints (peak#455)
• 10137b2 Remove stray file
• 93d4627 Remove unused dependencies
• 3cc9414 Rename file for clarity
• 17851d1 Reorder README
• dc66543 Resolve golint, misspell and gofmt issues (peak#158)
• f4306f0 Retry even more errors
• e093b6e Retry more errors
• a4865c1 Retry on closed connection (peak#189)
• eda137f Revert "Brew formula update for s5cmd version v0.7.8"
• b9d3a6d Shell-exec now prints stdout/stderr
• 503fb5f Show command option descriptions in command listing/help message
• 2b5660d Show correct path downloading from bucket roots
• a3c74f4 Show correct path uploading to bucket roots
• 11b1bd7 Show sub-command options in output
• 83354bb Simplify Makefile, clarify things in version/
• 91b0c23 Simplify commands: Use the same command set for both local and remote operations
• 599908b Single command invocation
• 0ca87cf Small fix on last line of the help text
• 90ae57d Special-case exec
• f71807b Split up the main package
• 0cd7bce Start info messages with #
• 6a0dfb4 Start workers after validating jobs (peak#55)
• f393ec4 Suggest more than one match for s3 bucket listing, so that s3 works without needing a backspace
• a0791f8 Support Environment S3_ENDPOINT_URL (peak#343)
• 134761f Support json formatted output (peak#85)
• 892f726 Support variable arguments for 'rm' command (peak#106)
• 2060d14 Tests & benchmarks for local file operations
• 96cb094 Travis ci (peak#15)
• 09bfd15 Try a new version-expose scheme using go:generate
• 2001dfb Try to clean up retryable error handling, don't retry HTTP 400
• 7a14393 Typo fix.
• 7bf1a3a Unvendor aws-sdk-go
• 323aac8 Update Makefile
• b832325 Update README
• d9dcd86 Update aws-sdk-go dependency in Gopkg.toml
• 6508cf3 Update brew formula
• 05b893a Update brew formula
• eea87b1 Update changelog for v2.0.0 (peak#458)
• c9311cf Update dep/Gopkg files
• a57bc7a Update homebrew formula
• 5d139af Update import paths (peak#24)
• 9bb02f8 Update installation instructions
• 682070e Update license file (peak#170)
• 2e0587f Update posener/complete dependency
• 61b6ce3 Update posener/complete, lock it in Gopkg.toml, delete unnecessary code
• be27e5c Update timing on demo recording
• 4556b6c Update vendored aws-sdk-go to 1.7.5
• db1ff1c Update vendored aws-sdk-go to 1.8.22, remove the gvt manifest file
• 985dfc5 Update vendored aws-sdk-go to 1.8.42
• a9c6bb4 Update vendored posener/complete
• b80266a Upload and download functionality
• a93f6fa Use 50mb chunks by default
• 0726467 Use OS-specific path separators on local filenames
• cdd8d99 Use a constructor method for *JobArgument
• 99f7043 Use compctl for better zsh autocompletion
• e596802 Use global flags (peak#72)
• ea1c7e7 Use go modules (peak#35)
• 99fbca8 Use struct composition for s3.Object in s3listItem
• 9fa34b2 Use urfave/cli package (peak#94)
• 36b2faa Use virtual-style if the endpoint is known to has support (peak#102)
• 259437c Vendor github.com/posener/complete
• 7a1e9f5 Vendor gops
• 55f01d4 Vendor minimum of aws-sdk-go
• 853efcb Wild-operation sub-jobs: Allow cancellation in waitgroup wait state
• dd03485 Wild-operation sub-jobs: use a WaitGroup instead of notify channel, simpler and not panicky on out-of-order cancellations
• 75919ca Wildcard (both glob and directory) uploads, more refactoring
• 2aa7f76 Wildcard downloads
• 967fedf Wildcard match: Assume "$"
• 6ae0774 Wildcard match: Assume "^", fixes single-char matches
• f02f7c8 Working s3 cp/mv/del operations
• 130d385 add CONTRIBUTING.md (peak#342)
• e81b978 add cache-control and expires options (peak#318)
• ec39987 add endpoint-url flag
• 7200415 add trace level logging to enable sdk debug mode (peak#430)
• e1bf6cf all: add docstrings
• fb03bce all: enable -race flag for tests (peak#336)
• 924092f all: fix wrong subtest usages (peak#130)
• 168781a all: get rid of testify package (peak#577)
• f9453a4 all: min Go version is 1.19, build with 1.20 (peak#622)
• b467d85 all: pass 'go vet' and 'staticcheck' checks (peak#45)
• 390930f all: print errors as they occur (peak#199)
• 0c01435 all: remove all shell operations (peak#77)
• 3602059 all: return structured type after running each job (peak#56)
• 9d49411 app: rename use-v1-api to use-list-objects-v1 (peak#424)
• e381c5e app: replace obsolete global option value in app.go (peak#174)
• 6264114 brew: pass 'brew audit' checks (peak#157)
• 4292ecc cat: make it concurrent (peak#593)
• 336eb28 changelog,command/presign: add missing points, fix cosmetic issues for presign command (peak#644)
• b42b856 changelog: add 2 new bugfixes (peak#156)
• 6c838d2 changelog: add --log flag
• 21d2501 changelog: add a bug fix entry for peak#479 (peak#610)
• 3fc01af changelog: add auto-region issue (peak#257)
• 99f9d76 changelog: add v1.0.0 milestone changes (peak#108)
• 4947879 changelog: introduce --request-payer flag (peak#427)
• 442e200 changelog: mention about workers stuck issue
• 10e4ccf changelog: prepare v2.2.1 release (peak#652)
• 63d2e7c changelog: prepare for v2.2.0 release (peak#645)
• 991c9fb changelog: prepare for v2.3.0 release (peak#779)
• fb93886 changelog: set v1.3.0 date (peak#307)
• 8220438 changelog: update Improvements sections (peak#473)
• d7a0dda changelog: update for v1.4.0 (peak#358)
• 24afd09 changelog: update release date
• a52ac70 changelog: update section order
• 4fceb89 changelog: update styling
• c4e393a changelog: v1.0.0
• 8f72009 changelog: v1.1.0 (peak#198)
• 5f2fdf9 changelog: v1.2.0 (peak#249)
• 74d21bb changelog: v2.1.0 is released (peak#572)
• 8355901 chore: prefer chan struct{} over chan bool for signalling (peak#733)
• c4be32a ci: Remove circleci configuration (peak#193)
• 0ef43b1 ci: add Github Actions support (peak#175)
• a679512 ci: add basic circleci config file (peak#138)
• bc4c4c8 ci: remove travis configuration (peak#146)
• e7c51f9 ci: use Go 1.18 for builds, remove 1.15 support (peak#417)
• 2a6c7cc ci: use Go 1.19 for builds, remove 1.16 support (peak#481)
• 9adb792 command/: add stat flag for s5cmd (peak#201)
• cefca32 command/app: add --no-sign-request global flag to access public buckets (peak#305)
• cada16f command/app: exit with code 1 if given command is not found (peak#296)
• 84c3696 command/app: force endpoint-url to have scheme (peak#496)
• ed764a9 command/cat: fix grammar
• 84cbec8 command/cat: update command usage string (peak#246)
• bad1796 command/copy: don't try to copy Glacier objects (peak#143)
• 2079136 command/copy: drop local->local copy support (peak#125)
• 44688b2 command/copy: fix part-size typo
• f54f07a command/copy: ignore delete errors if download is canceled (peak#141)
• 3b05782 command/copy: move copy constants to where they're used
• 5a611da command/cp&rm: add --raw flag (peak#315)
• 601ee14 command/cp: KMS encryption support (peak#185)
• 582a86d command/cp: add ACL support (peak#186)
• fbd99c5 command/cp: add force-glacier-transfer flag (peak#312)
• 2dad7e1 command/cp: add cross-region transfer support (peak#194)
• 8bbd960 command/cp: add progress bar (peak#590)
• b4c91bd command/cp: allow overriding bucket region (peak#270)
• b161fa6 command/cp: fix mime type inference (peak#220)
• e20e974 command/cp: fix minor printing issue if 'cp' command is called without arguments (peak#291)
• 9f56645 command/cp: fix sse flag examples (peak#243)
• 3c25ace command/cp: fixed windows filepath issue on upload (peak#181)
• 6727f39 command/cp: remove misleading "mirroring" in help text (peak#248)
• 414060c command/cp: revert the append error commit (peak#349)
• be98337 command/error: dont print cancelation errors (peak#109)
• d80fc02 command/expand: fix data race for concurrent writes (peak#330)
• 74e97c4 command/ls, ese/ls_test: added an option to show storage class (peak#187)
• d92535e command/ls: do not miss printing errors (peak#212)
• 68f797b command/mb: fix incorrect usages in help output (peak#316)
• d5e5ea3 command/mv: fix option usage (peak#338)
• b7babaf command/pipe: add more examples (peak#643)
• c13b860 command/pipe: update pipe file compression example (peak#708)
• 0aa49cb command/rm: batch rm with different buckets not allowed (peak#241)
• ef19ae8 command/run: drop inline comment support (peak#422)
• babc8d5 command/run: fix concurrent writes to the flags list (peak#335)
• d69bc37 command/run: handle errors returned from parallel.Manager (peak#351)
• c978e4a command/run: handle large tokens in scanner (peak#438)
• ef27f95 command/run: print error if run argument doesn't exist (peak#410)
• 0993c6d command/storage: add versioning support (peak#475)
• 4c30eb3 command/sync: add --include flag (peak#600)
• 36485ed command/sync: create source client only for local objects (peak#423)
• bb3723b command/sync: fix delete option with empty target (peak#578)
• cb948fa command/sync: handle object listing errors (peak#597)
• dddc619 command/sync: update default strategy, update tests (peak#369)
• 393df26 command: add --request-payer flag (peak#383)
• 604f03a command: add --exclude flag (peak#334)
• ac09d28 command: add content-disposition flag. (peak#589)
• 6a1ea3c command: add presign command (peak#634)
• ce2537d command: add sync command using run method. (peak#347)
• db6b53f command: add arbitrary metadata support to cp and pipe (peak#621)
• c79b10e command: add cat command (peak#139)
• 7d70158 command: add examples for each command (peak#122)
• 5e867c9 command: add extensive autocompletion support (peak#500)
• 18145bd command: add pipe command (peak#182)(peak#587)
• 9defce6 command: append object error to multierror to return non-zero exit code error (peak#328)
• a115f0c command: extend select api support (peak#611)
• 6ac390f command: fix file overriding when download fails (peak#479) (peak#582)
• 13aa68a command: fix target file is created despite the download failure (peak#477)
• 5495dd4 command: implement 'remove bucket' feature (peak#310)
• c2a9d31 command: implement 'select' command (peak#300)
• 1c8d827 command: match filenames with commands names (peak#134)
• 7987898 command: move copy flags from global to copy command (peak#110)
• 9c3241d command: print destination url on info logs (peak#128)
• 917fd7e command: rename autocomplete function
• 7aca503 command: rename missing commands (peak#137)
• 7c90f8a command: retry upload on s3.NoSuchUpload (peak#470)
• 234874b command: return non-zero exit code for errors and add ignore-glacier-warnings option (peak#404)
• 393e8dd command: skip nonregular files (peak#618)
• 2487d6f command: update misleading help descriptions (peak#581)
• f0ce87d command: use external sort for comparison in sync (peak#483)
• 1bd182b complete: Always call the cancel func to avoid a leak
• 7712586 complete: Fallthrough and list bucket contents if we have a single bucket match
• 4b0bbb7 complete: Handle empty buckets and empty results
• c6224f5 complete: Ignore 0-byte *_$folder$ objects (in shell completion only)
• d3c4d93 completion installer: Add a FIXME
• 5bb45b6 context: put quotes around flagvalue incase of whitespaced values (peak#636)
• c7643ff copy: Update function signature (peak#126)
• 8471cfa copy: follow symbolic links by default (peak#135)
• b29787d core/job*: log object.Err values returned from storage.List (peak#87)
• 17890cc core: add Runnable interface to test workermanager semaphore logic (peak#75)
• 7461c79 core: check if StorageClass is nil (peak#36)
• 698c5b7 core: check missing StorageClass deferences (peak#38)
• 48f0ce4 core: consolidate local and s3 executions (peak#78)
• 0f9de65 core: eparate command logic from job (1st phase) (peak#47)
• a8ce3ed core: fix relative copy regression (peak#71)
• 8b4516d core: move aws session constructor into s3.go
• 74d45d1 core: remove && and || support (peak#61)
• b28b180 core: remove cancelation error logs if verbose is disabled (peak#63)
• 3415ef0 core: remove stat logic from command actions (peak#48)
• 48f53d5 core: remove unused message.go file
• e074b96 core: set ContentType for uploaded files (peak#84)
• 3e16764 core: use client's endpoint in GetSessionForBucket
• a235f25 core: use fs.readDir if we are reading a directory in non-recursive mode (peak#67)
• 48f7e59 cp,pipe: don't omit some of the metadata flags (peak#658)
• 194ca28 cp/mv: Add -s and -u options to overwrite if sizes differ or last modification time is newer
• 643d24b cp: add remote copy examples to help text (peak#151)
• 293a117 cp: set storage class if provided (peak#169)
• 5b64469 disable aws sdk logger if log level is not "trace" (peak#460)
• b037325 dockerfile: add dockerfile (peak#223)
• 0398a0b dockerfile: build with Go 1.17 (peak#364)
• 92785ff dockerfile: disable CGO (peak#256)
• c1c7ee3 dockerfile: use Alpine 3.18 as base for release image (peak#661)
• 518fc56 du: remove unused param (peak#150)
• 711ddf0 e2e/app_test: fix failed test due to new cleanup (peak#504)
• ef362f3 e2e/run: update racy test case (peak#606)
• d949fe0 e2e/util_test: enable tests to work using external endpoint (peak#506)
• 37e9a68 e2e/util_test: remove unnecessary test directory cleanup (peak#512)
• 83c415d e2e: Remove empty line checks (peak#142)
• e3e15cd e2e: add ls with prefix test (peak#54)
• c142829 e2e: asserted line count should be greater than the actual line count
• 0944f43 e2e: enable RemoveTenThousandS3Objects test (peak#140)
• 15bba2a e2e: fix broken cat test after the latest commit
• dbd909d e2e: fix incorrect flag usage (peak#255)
• 9224689 e2e: handle empty lines (peak#79)
• d50ef44 e2e: refactor cleanup behavior using t.Cleanup (peak#502)
• fce1e2a fdlimit: avoid rlimit syscall on windows (peak#167)
• 8829d3b feat: add go 1.22 build (peak#764)
• 75d6f7a feat: add semgrep to the static checkers list (peak#735)
• 89218dc feat: add wildcard and prefix support to cat (peak#736)
• b5e5143 feat: added Head command (peak#730)
• 987b4ae feat: dependabot workflow automation for updating dependency (peak#530)
• 706f74a feat: implement metadata-directive (peak#668)
• 541b5e1 fix: close result channel to fix hang (peak#370)
• c280956 fix: cp command S3toS3 --content-type flag (peak#739)
• 787bc88 fix: fix single object cases for sync (peak#740)
• 693fc3a fix: increase test s5cmd command timeout for slow CI (peak#767)
• 21fa2da fix: ls differentiate exit codes for empty and non-existent buckets (peak#732)
• 2f6e9da fix: remove debug lines (peak#614)
• d72716a fix: sync glacier objects overwrite (peak#734)
• 35bb2fa flag/stat: fix omitted stat in error log level (peak#451)
• 7fd6a15 github/ci: add Go 1.16.x to build and testing matrix (peak#290)
• ab52b9c github/dependabot: create security fix PRs only (peak#639)
• 550a846 github/goreleaser: pin goreleaser version to release s5cmd v2.2.0 (peak#647)
• cfb1d43 github/goreleaser: trigger just for tags with 'v' prefix (peak#292)
• 20d6a22 github/workflows: Drop EOL versions and added latest 1.20 (peak#583)
• 714dfeb github: add CODEOWNERS file (peak#230)
• 5765b01 github: add Go 1.15.x to build/test jobs (peak#240)
• 6eb2302 github: add goreleaser action (peak#247)
• f7ae28f github: publish multi-arc images to hub (peak#242)
• 7874c17 goimports
• 9a51c87 goreleaser: Support multiple release artifacts (peak#100)
• c67760e goreleaser: add nfpm configuration for Debian packages (peak#437)
• 24c89b1 goreleaser: add ppc64le support (peak#552)
• 4c36b52 goreleaser: disable before hooks (peak#197)
• b533495 goreleaser: embed tag and commit hash into the binary (peak#103)
• 045fa7e goreleaser: fix go-version value (peak#646)
• fe80af8 goreleaser: fix brew binary test
• 0543ca8 goreleaser: move formula to github.com/peak/homebrew-tap repo (peak#429)
• bb1775a goreleaser: rename github to tap (peak#308)
• 2ccaa12 goreleaser: update to latest config schema
• ee8128a job: use chan struct{} for closer
• 88a4641 log, parallel: fix help flag panicking (peak#509)
• c7d2366 ls: Show storage class
• 7006118 ls: add --show-fullpath flag (peak#599)
• 4f54f64 ls: update --show-fullpath flag (peak#601)
• aa525e7 main: cosmetic changes (peak#46)
• 90b7418 main: use signal.NotifyContext to handle signals (peak#510)
• be63977 makefile: correctly inject vcs information into the binary (peak#650)
• a2d6209 makefile: drop release target (peak#339)
• 0adfb9b makefile: fail semgrep if any check fails (peak#737)
• 02f63b3 makefile: fix check-fmt target (peak#327)
• a563b33 objurl: unify s3 and local file url representation (peak#57)
• dc0777f parallel: move global manager into its own file (peak#162)
• f75c262 progressbar: remove duplicate assertions (peak#638)
• 4ddadc3 readme.md: add benchmarks section (peak#192)
• fc557c7 readme: add 'retry-logic' section (peak#127)
• 89baee6 readme: add 'windows' to the list of supported operating systems (peak#323)
• 55f4204 readme: add Advanced Usage Patterns section (peak#204)
• bd1c80d readme: add a note for wildcard shell expansion issue
• 71cdc2e readme: add instructions on how to install on FreeBSD (peak#573)
• c24cc52 readme: add integrity verification section (peak#616)
• c73528f readme: add steps for installation using macports (peak#311)
• c0c852f readme: at least go 1.7 is required
• 439061f readme: clarify specifying credentials section (peak#570)
• e2e2782 readme: correct error message
• 3e08061 readme: fix ci badge URL (peak#546)
• bf4c6ff readme: fix typo
• 20ae461 readme: fix typo
• 5ff3dac readme: fix typo in overview section (peak#202)
• 391e9cc readme: fix wording
• 6b97a9e readme: mention AWS_PROFILE environment variable (peak#275)
• 53d41e4 readme: move 'wildcard' section above
• b37c546 readme: remove tag badge
• 6bc84f9 readme: syncing different cloud providers is not supported (peak#598)
• e5bd3a7 readme: update 's5cmd cp' command and shell output (peak#176)
• 7f694fd readme: update Faster Beast Mode example (peak#394)
• 670b138 readme: update using wildcards section (peak#432)
• 9005f76 readme: update build from source instruction (peak#574)
• f58add9 readme: update filters section (peak#642)
• f907aea readme: update minimum go version
• e9c4d7e readme: we dont support inline comments since v2 (peak#486)
• 688f8e5 s3: treat "connection reset" errors as retryable. (peak#298)
• 86dfcf2 s5cmd: initial commit
• f55ee1a stats: Add missing fail_count to stats json (peak#89)
• f758adf storage,command: handle Stat() errors (peak#620)
• 4130a7e storage/fs: change order of precedence for URL expansion (peak#322)
• 358a6c4 storage/fs: require just the read-bit for opening source files (peak#259)
• c01c5a2 storage/s3: Fix proxy with no-verify-ssl flag (peak#457)
• ab77f69 storage/s3: add S3 transfer acceleration support (peak#83)
• d21a491 storage/s3: add SlowDown as retryable (peak#507)
• 071a0f8 storage/s3: add custom retryer for custom error codes (peak#132)
• ca37216 storage/s3: add legacy flag for backward compatibility with ListObject (peak#407)
• 343c232 storage/s3: add more retry tests (peak#180)
• 19656e1 storage/s3: allow any storage-class value (peak#163)
• 0ea24d3 storage/s3: create object urls after mod validation (peak#239)
• 5ba7ee0 storage/s3: do not retry on expired token (peak#337)
• a142870 storage/s3: do retry RequestTimeTooSkewed error (peak#221)
• 3e5ff3c storage/s3: don't fail early if there are any auto-fetch errors during session init (peak#254)
• 065c3cf storage/s3: enable ListObjectsV2 for GCS (peak#617)
• 6fac3f1 storage/s3: fix precedence of region detection (peak#331)
• 3accc9e storage/s3: fix recursive upload issue on wildcard usage (peak#188)
• 0b522a3 storage/s3: fix time related test flakiness (peak#203)
• 3fabd0e storage/s3: propagate retryable errors from sdk to the user (peak#261)
• c072a50 storage/s3: refactor session reuse logic (peak#145)
• c0188f8 storage/s3: remove s3 factory (peak#149)
• fd03f6e storage/s3: retry connection timed out errors (peak#371)
• 910cf21 storage/s3: retry on connection reset by peer error (peak#226)
• 766a545 storage/s3: use correct AWS region value (peak#96)
• 6b87fb4 storage/url: Allow usage of adjacent slashes (peak#459)
• 22592e5 storage/url: add nil check for URL.filterRegex in URL.Match (peak#511)
• 83ce8bc storage/url: allow wildcards to match new line characters (peak#505)
• 6727b11 storage/url: fixes the bug where some part of destination path is removed by cp (peak#456)
• b7d7a77 storage: Remove maxKeys parameter from List (peak#115)
• ee4de82 storage: add --dry-run option (peak#216)
• 8d895f6 storage: add GCS list support (peak#123)
• 43e3512 storage: add metadata parameter to Storage.Put method (peak#68)
• 717bf5b storage: add profile flag (peak#453)
• acb97e9 storage: move objurl package to storage/url (peak#121)
• 7ac1fbe storage: remove unused UpdateRegion method
• 73f4abb storage: remove unused notImplemented type (peak#476)
• 64dc884 storage: return custom errors on storage.{Stat,List} (peak#64)
• 66767d7 storage: reuse AWS session for better performance and resiliency (peak#74)
• 60b1ac1 storage: use session path style in HeadBucket call (peak#411)
• 2dac49e update README
• 3ec31d3 update README add s5cmd logo (peak#425)
• 2ca872c update Travis configuration (peak#16)
• 1631a0d update go report url to match module name (peak#664)
• a8a226f update readme: add a section about numworkers/concurrency (peak#465)
• 8516f33 url: build correct filter regex for objects that contain regex metacharacters (peak#111)
• f24e0f6 us-east-1 fallback: Use const from the aws endpoints package
• d559cfb v0.5.3
• 6abfea8 vendor/: upgrade aws-sdk-go (peak#227)
• 1a5e546 vendor: Update AWS SDK (peak#684)
• 363ec2e vendor: update AWS SDK to v1.29.14 (peak#82)
• a06e19a vendor: update aws-sdk-go to v1.40.25 (peak#408)
• 44ab31d vendor: update gofakes3 version (peak#195)
• deb16c9 vendor: update urfave/cli to v2.11.2 (peak#495)
• 123b1c7 vendor: upgrade gofakes3 to v0.0.11 (peak#472)
• f6b79a1 vendor: use github.com/igungor/gofakes3 to fix go install (peak#421)
• 2f44428 vendor: use lanrat/extsort v1.0.2 (peak#778)
• 9429ade version/cmd/generate: Use the new auto-generated code convention
• f6bff1b version: fix -version flag usage (peak#76)
• df6b29f write usage errors to stderr (peak#431)