-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
It can only submarine directories of up to 5697 files #2
Comments
I have fixed a number of bugs I found in the scripts, mainly to do with wrong paths being included (I am assuming you worked around this). After that, I tried generating a test folder with 6000 entries, and I get a 404 not found error. Subsequently I generated a test folder with 5697 entries, and get a listing of all the file names. So I have reproduced the problem. My initial suspicion here is that this is a bug in the ipfs web ui. I will investigate further. |
It looks like it is an IPFS limitation:
I'm now investigating something called "directory sharding", which is experimental, but is meant to allow larger directories. |
Nope, nothing in that topic area provides a solution. I think it's an IPFS problem, and that's something I can't fix. |
@kf106 I figured out a fix. See this ipfs pr: https://github.com/ipfs/kubo/pull/8527/files
Increasing the sharding threshold will let you submarine larger directories. I just set it to 1GB. |
Web UI when the submarined directory contains 5698 files:
Web UI when the submarined directory contains 5697 files:
Our project is an NFT collection of 10,000. Right now we're forced to split the ipfs files into two because of this.
The text was updated successfully, but these errors were encountered: