Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for large files #10

Open
changlinli opened this issue Dec 9, 2016 · 1 comment
Open

Support for large files #10

changlinli opened this issue Dec 9, 2016 · 1 comment

Comments

@changlinli
Copy link

Normal files in B2 have an upper limit of 5GB. There is support for files up to 10TB, but it requires a separate API to use. This bit me recently where I kept getting odd Java exceptions (i guess B2 doesn't have the cleanest error messages) when uploading files.

This might be something that is better suited for your dependency, but just wanted to give you a heads up that this sometimes happens if you wanted to look into it (I'll try to pick up Go one of these weekends and have a whack at it if you haven't).

Thanks a bunch for writing this special remote!

@encryptio
Copy link
Owner

Good point; I always use git-annex's built-in chunking support because it makes everything resumable (you can enable it by passing chunk=100M or similar to initremote or enableremote, and even change it while data is at rest in the remote.)

Looks like the large file API is not supported by the upstream B2 client library I use; I'll open an issue there to add it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants