Skip to content
This repository has been archived by the owner. It is now read-only.

large files question about duplication #110

Closed
icf20 opened this issue Apr 17, 2016 · 2 comments
Closed

large files question about duplication #110

icf20 opened this issue Apr 17, 2016 · 2 comments
Labels

Comments

@icf20
Copy link

icf20 commented Apr 17, 2016

I have a question about the block part, if i take a 100MB video and add it into IPFS, then a person take that video and cut the file in half and add the file again, will duplicate the 50% of the blocks or will share the blocks ?

(first posted on the wrong place ipfs/kubo#2575)

so my new question is there any chance to save space and dont duplicate blocks even if is 1%

@jurgen-kluft
Copy link

jurgen-kluft commented Apr 18, 2016

As far as i understand IPFS the default block-size is 256KiB, so the answer would be that there is de-duplication happening assuming the 'cut the file in half' means that the part that is left is binary wise the same as its part in the original video file.

'added':
Actually you can make it visible to see for yourself, when you add a large file you get a hash-link, you can use that hash-link to list the internals. You can also do that for the part you added, if the hashes of all the parts are the same then the answer is that chunks are shared.

@flyingzumwalt
Copy link
Contributor

flyingzumwalt commented May 23, 2017

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

4 participants