Skip to content
This repository has been archived by the owner. It is now read-only.

Which chunking algorithms are available? #214

Closed
JustinDrake opened this issue Dec 22, 2016 · 3 comments
Closed

Which chunking algorithms are available? #214

JustinDrake opened this issue Dec 22, 2016 · 3 comments

Comments

@JustinDrake
Copy link

JustinDrake commented Dec 22, 2016

The ipfs add command has the following flag:

-s, --chunker string - Chunking algorithm to use.

What chunking algorithms are available?
@JustinDrake
Copy link
Author

JustinDrake commented Dec 22, 2016

See here. The default is to use a block size of DefaultBlockSize int64 = 1024 * 256. Another block size can be specified using size-*. There's also the rabin-* chunker which uses rabin-[min]-[avg]-[max].

@JustinDrake
Copy link
Author

JustinDrake commented Dec 22, 2016

As far as I can tell, the Rabin chunker is a "Content Defined Chunker" to improve deduplication. See here.

@hmeine hmeine mentioned this issue Jan 13, 2017
Closed
@madavieb
Copy link

madavieb commented May 23, 2017

This issue has been moved to https://discuss.ipfs.io/t/which-chunking-algorithms-are-available/363.

@thisconnect thisconnect mentioned this issue Oct 4, 2017
Closed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JustinDrake @madavieb