-
-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
drive: Significant slowdown for accessing files in the range of 35MB - 100MB #2612
Comments
I managed to replicate this. I also managed to replicate without mount. This has the 30 pause every 3 tries or so:
However there is a work-around using
Which kind of indicates that this is a google drive problem rather than an rclone problem. @B4dM4n any ideas? You were going to report an issue about the whole v2 vs v3 API for drive weren't you? See also: #2573 |
i experienced the same thing, sudden extreme slowdown (to ~5mbit/s). using the --drive-v2-download-min-size 0 helped. a curious detail: it is only reproducible with some particular files in my drive, others were not effected. EDIT; dang it. it also happend with the drive v2 api... anything i can provide to help with this? i ran some tests. If i download the file at full speed from the mount (to /dev/null) the slowdown never happens, only if the requesting process is reading at a moderate speed. |
Well it seems i was barking at the wrong tree. My issue is likely related to a kernel bug. |
@seuffert well done for tracking down the problem! Kernel bugs are tricky at the best of times. |
@jm-85 Does the problem reproduce with rclone 1.54? |
Closing stale requests |
What is the problem you are having with rclone?
Unexpected slow responses for accessing files with sizes in the range of 35MB to 100MB
Files of this type often take an additional 30s to 1m to access.
Note this does not occur every time.
Typical transfer time is less than 2s for files above or below the aforementioned range.
What is your rclone version (output from
rclone version
)rclone-beta-latest --version
rclone v1.43-116-g22ac80e8-beta
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Ubuntu 18.04.1 LTS
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg
rclone copy /tmp remote:tmp
)Rclone remote mounted with:
/usr/bin/rclone-beta-latest mount
--allow-other
--buffer-size 1G
--dir-cache-time 72h
--fast-list
--log-file='/opt/logs/rclone-debug.log'
--log-level "DEBUG"
--read-only
--vfs-read-chunk-size 128M
--vfs-read-chunk-size-limit off
plex-debug:/debug
/debug
Testing file accessibility with:
cp /debug/64M.file
Files were creating using:
dd if=/dev/zero of= bs= count=1
A log from the command with the
-vv
flag (eg output fromrclone -vv copy /tmp remote:tmp
)##Note the time gap between 64M.file: ChunkedReader.openRange at 0 length 134217728 and
##64M.file: ChunkedReader.Read at 0 length 4096 chunkOffset 0 chunkSize 134217728
The text was updated successfully, but these errors were encountered: