New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Google Drive ocamlfuse is very slow #79

Closed
wallnas opened this Issue Jul 17, 2014 · 13 comments

Comments

Projects
None yet
8 participants
@wallnas

wallnas commented Jul 17, 2014

Good morning,
i have install ocmlfuse on ubuntu 14.04 64 bit and is very slow for download and upload.

my config is:
max_cache_size_mb=512
new_revision=true
sqlite3_busy_timeout=500
read_only=false
conflict_resolution=server
verification_code=
drawing_format=png
document_format=odt
form_format=ods
docs_file_extension=true
keep_duplicates=false
presentation_format=pdf
download_docs=true
client_secret=
metadata_cache_time=60
client_id=
spreadsheet_format=ods
debug=false
umask=0o002

There is a method to speed ?

Tanks for help.

@idevin

This comment has been minimized.

idevin commented Jul 17, 2014

Same thing

@astrada

This comment has been minimized.

Owner

astrada commented Jul 19, 2014

You can try to increase metadata_cache_time. This way there are less server requests e the cache will not be invalidated too frequently.

@wallnas

This comment has been minimized.

wallnas commented Aug 9, 2014

I have modify metadata_cache_time = 180 and 360 : There is very slow.

@astrada astrada added the question label Aug 26, 2014

@lightsurge

This comment has been minimized.

lightsurge commented Nov 24, 2014

I'm also experiencing this slow-down even with a high metadata_cache_time. In my case I gzip a large amount of data into the google drive folder... so possibly because it gradually writes the compressed file into the google drive folder this is causing excessive syncing. I'm going to try moving pre-prepared files rather than performing heavy operations on files inside the sync folder.

@ardhipoetra

This comment has been minimized.

ardhipoetra commented Nov 23, 2016

Second this.

I know this is old issue, I got only 100-150 kB/s with FUSE. In the other hand, I can upload 2-3 MB/s with browser. Tried changing the metadata_cache_time produces the same result.

My concern (for now) only for uploading though.

@astrada

This comment has been minimized.

Owner

astrada commented Nov 23, 2016

You can try setting async_upload=true, or you can try the new beta version (0.6.0). that you can install from a new PPA, if you are on Ubuntu.

@ardhipoetra

This comment has been minimized.

ardhipoetra commented Nov 23, 2016

Still, the speed very slow. Now it has around 400kB/s. Moreover, I uploaded from SSD, so I don't think the bottleneck is from the disk.

As for comparison, I can get good performance with https://github.com/odeke-em/drive

@astrada

This comment has been minimized.

Owner

astrada commented Nov 29, 2016

I think the problem is that FUSE uses blocks of 128KB (at maximum), so you have to wait for a (relatively slow) copy to end before the upload begins. If your use case requires frequent uploads of very big files, you should go with https://github.com/odeke-em/drive. You can then use my app to stream the uploaded files (if they contain videos, for example).

@ardhipoetra

This comment has been minimized.

ardhipoetra commented Nov 29, 2016

rclone also implements FUSE to mount cloud storage, one of them is google drive. I tried that before and mostly can get higher speed although it still in experimental stage. I will look into the details later.

@astrada

This comment has been minimized.

Owner

astrada commented Nov 29, 2016

OK, but from the source code you linked:

Limitations

This can only write files seqentially, it can only seek when reading.
Rclone mount inherits rclone's directory handling. In rclone's world
directories don't really exist. This means that empty directories
will have a tendency to disappear once they fall out of the directory
cache.

I think that rclone has a simple in-memory model, so it's optimized for uploading but has those limitations.

@astrada astrada closed this Jan 14, 2017

@hbakhtiyor

This comment has been minimized.

hbakhtiyor commented Sep 5, 2017

i'm experiencing the same issue with speed of uploading

@vi

This comment has been minimized.

Contributor

vi commented Oct 29, 2017

Maybe the slowness is due to not using the database properly: #308 (comment). It fully syncs the database state to disk every 128 kilobytes.

Using libeatmydata hack forces unsafe, unsynced database mode and makes uploads fast.

@wifiuk

This comment has been minimized.

wifiuk commented Jun 11, 2018

i also get crippling slow folder loading and file transfers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment