Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test out new colima options vz and virtiofs mounting #4466

Closed
4 tasks done
rfay opened this issue Dec 17, 2022 · 10 comments
Closed
4 tasks done

Test out new colima options vz and virtiofs mounting #4466

rfay opened this issue Dec 17, 2022 · 10 comments

Comments

@rfay
Copy link
Member

rfay commented Dec 17, 2022

We need to test out the complexities and possibilities of colima v05.0 and what the heartaches are regarding DDEV.

@75th
Copy link

75th commented Dec 18, 2022

Tried to ddev import-db a large database using the new options. Both a 567 MB .sql file uncompressed, and the same data as a 75 MB gzip. Results:

qemu vz
virtiofs Done in 3 minutes Incredibly slow. ETA and import speed fluctuated widely, with completion estimates between 20 minutes and over an hour. With the gzipped file it took a longer time for the progress bar to even appear, and when it did it wasn't significantly faster than the uncompressed.
sshfs Done in 3 minutes Fails immediately with an error like pv: /mnt/ddev_config/.importdb3453168728/*.*sql: No such file or directory

EDIT Okay I've just this moment realized that a VM created with colima start --disk 100 --memory 6 --vm-type qemu --runtime docker --mount-type virtiofs reports that it's using 9p mount type. Investigating further

@75th
Copy link

75th commented Dec 18, 2022

Re: my EDIT above, I opened an issue at colima

@abiosoft
Copy link

@75th as mentioned in the issue, vz and virtiofs goes hand in hand. The test result above is most likely 9p and not virtiofs.

@balajiv113
Copy link

@75th I believe the poor performance in vz is related to how persistent disk are attached in lima. I will update this in lima once Code-Hex/vz#117 is merged.

Temporarily if you are interested you can do this workaround and then try importing.

colima ssh
sudo -i
echo 'write through' > /sys/class/block/vda/queue/write_cache

Check this for more Detailed Reference

@rfay
Copy link
Member Author

rfay commented Dec 21, 2022

@balajiv113 I confirm that that makes colima with vz BLAZINGLY fast on ddev import-db.

@rfay
Copy link
Member Author

rfay commented Dec 27, 2022

Here are my results of testing the various permutations, https://ddev.com/ddev-local/ddev-docker-desktop-and-colima-benchmarking-updated-dec-2022/

@abiosoft
Copy link

This #4466 (comment) can be handled in Colima directly as a workaround for now.

@abiosoft
Copy link

This #4466 (comment) can be handled in Colima directly as a workaround for now.

Now that this is included in v0.5.2, it would be nice to see the blog post updated.

@rfay
Copy link
Member Author

rfay commented Dec 28, 2022

Awesome, will test!

@rfay
Copy link
Member Author

rfay commented Dec 28, 2022

@abiosoft updated the blog, it did indeed solve lots of things, and Colima/VirtioFS is now the fastest non-mutagen option out there! https://ddev.com/ddev-local/ddev-docker-desktop-and-colima-benchmarking-updated-dec-2022/

Of course I know you already saw my report of SEGFAULTS in VirtioFS,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants