Non Amazon S3
s3fs supports a variety of non-Amazon S3 services. Users can override the default URL via the -o url=https://
option. Some providers do not support the full S3 API, e.g., lacking multi-part upload. Examples follow:
s3fs BUCKET PATH \
-o url=https://oss-ap-northeast-1.aliyuncs.com \
-o nomixupload
s3fs BUCKET PATH \
-o url=https://s3.us-west-001.backblazeb2.com
s3fs BUCKET PATH \
-o url="https://[account-id].r2.cloudflarestorage.com" \
-o nomultipart \
-o endpoint=auto
s3fs BUCKET PATH \
-o url=https://objects-us-east-1.dream.io
With s3fs 1.89 or earlier:
s3fs BUCKET PATH \
-o url=https://storage.googleapis.com \
-o nomultipart
With s3fs 1.90 or later:
s3fs BUCKET PATH \
-o url=https://storage.googleapis.com
TODO: add endpoint
To use IBM IAM Authentication, use the -o ibm_iam_auth
option, and specify the Service Instance ID and API Key in your credentials file:
echo SERVICEINSTANCEID:APIKEY > /path/to/passwd
The Service Instance ID is only required when using the -o create_bucket
option.
s3fs BUCKET PATH \
-o url=https://s3.us-west-1.idrivecloud.io
s3fs BUCKET PATH \
-o url=http://minio.server:9000/ \
-o use_path_request_style
s3fs BUCKET PATH \
-o url=https://[api node]:8082 \
-o use_path_request_style
Additional proven settings for transferring many large files:
-o readwrite_timeout=210,multipart_size=250,multipart_threshold=5120,parallel_count=20,tmpdir=[large directory for temp files]/,dbglevel=warn
s3fs BUCKET PATH \
-o url=https://[tenant-id].compat.objectstorage.[region-id].oraclecloud.com/ \
-o use_path_request_style \
-o nomultipart
For details on how to get tenant-id, region-id and AWSACCESSKEYID/AWSSECRETACCESSKEY values please follow this post Using Oracle Cloud Object Storage as Docker Volume.
s3fs BUCKET PATH \
-o url=https://s3-cn-east-1.qiniucs.com \
-o use_path_request_style
S3Proxy allows mounting non-S3 buckets, e.g., Microsoft Azure Blob.
s3fs BUCKET PATH \
-o url=http://127.0.0.1:8081 \
-o use_path_request_style
s3fs BUCKET PATH \
-o url=https://s3.nl-ams.scw.cloud
s3fs BUCKET PATH \
-o url=https://sdc1.storage.serverius.net
-o use_path_request_style
See for further information the Serverius knowledgebase.
s3fs BUCKET PATH \
-o url=https://eu-002.s3.synologyc2.net
s3fs BUCKET PATH \
-o url=https://cos.ap-shanghai.myqcloud.com
s3fs BUCKET PATH \
-o url=https://[REIGON].vultrobjects.com
For example, Silicon Valley (sjc1) would be https://sjc1.vultrobjects.com
.
s3fs BUCKET PATH \
-o url=https://s3.wasabisys.com
s3fs BUCKET PATH \
-o url=https://storage.yandexcloud.net \
-o use_path_request_style