Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improvement: put the data folder into a file container (VHD) #937

Open
ch1p2 opened this issue May 18, 2017 · 2 comments
Open

Improvement: put the data folder into a file container (VHD) #937

ch1p2 opened this issue May 18, 2017 · 2 comments

Comments

@ch1p2
Copy link

ch1p2 commented May 18, 2017

Some operating systems does really bad in copying/moving a large number of small files. So using file containers (such as a virtual hard disk) can improve the performance when you want to move your data folder into another disk or partition.

@ch1p2 ch1p2 changed the title Improvement: put the daa folder into a file container (VHD) Improvement: put the data folder into a file container (VHD) May 18, 2017
@HelloZeroNet
Copy link
Owner

This is especially problem on mobile phones where the file system chunk size is high (32k), so it takes up lot more (up to 10times) space.
To solve this problem I planning to add site archiving method that stores moves the older user content to a zip/tar.gz archive, so it would dramatically reduce the file numbers, initial sync time and could solve scalability problems (older content archives can be marked as optional files)

@adrix89
Copy link

adrix89 commented Oct 23, 2017

Archiving won't solve the problem, you need some form of chunking for recent content also if you don't want to kill hard drives with fragmentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants