Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

i/o input/output error on Hard disk (5000rpm) when you have high download/upload speed #17632

Open
estatistics opened this issue Aug 29, 2022 · 10 comments

Comments

@estatistics
Copy link

qBittorrent & operating system versions

(how i can copy them automatically from qbitt? )
qt 5.12.2
libtorr: 1.2.15
boost: 1.74
openssl 1.1.1n
zlib 1.2.11

What is the problem?

i/o input/output error on Hard disk (5000rpm) when you have high download/upload speed

I have a high speed internet connection ~5mb download / ~1mb upload (not mbps).
So due to sharing many files, i have broken upload to small pieces eg. 12kb per torrent and download 100kb per torrent.
This results many torrent concurrently to be downloaded / shared.

However, i suppose this create a lot of read/write i/o processes on HDD.
My HDD are of low speed: 5000rpm.

Therefore, if i put max speed down/up on qbittorent, my screen will flood from input/output HDD errors.

So i think this is a bug of qbittorent, isnt it?

I think it must manage better i/o read /write HDD processes.

Steps to reproduce

I have 1000 torrent downloaded concurrently at max speed 10mb / sec. with limits of 10-20kb per torrent in an HDD with 5000 rpm.

Your screen will flood with read / write errors

Additional context

No response

Log(s) & preferences file(s)

No response

@estatistics
Copy link
Author

qbittorent 4.4.2 - linux on bullseye 11. fully upgrded (KDE). Qt: 5.15.2

@R-Adrian
Copy link

in Tools -> Options -> Advanced... try setting Asynchronous i/o threads to something lower than the default (10) and restart qbt. See if that helps?

I usually keep mine at 1 with 7200 rpm drives but i also increased the allowed RAM + buffer memory for qbt to compensate for the reduction in i/o threads.

@estatistics
Copy link
Author

I successfully run qbittorent 4.4.4 - only openssl not update (i will check it) Επιλογή_102

So maybe i could run some tests to check...

@R-Adrian
Copy link

the problem essentially comes from the mechanical limitations of the drives... too many requests at (roughly) the same time are simply impossible to service for a single mechanical device (the read/write heads assembly of the drive) - this is why a large RAM + buffer memory and a reduction of i/o threads helps: the slow drive can execute only a limited number of tasks at a time.

@estatistics
Copy link
Author

estatistics commented Aug 29, 2022

the problem essentially

the speed of internet (the high end) is much faster from any available disk (few exceptions) i think.
HDD is mostly seriasly read / write which is a serious limit. So i believe a new type of read/write must be found which will be much faster (or even medium).

So essentially, i am looking at advance options. I must limit download rate... in order to limit i/o errors. I think such errors dont present at reading only.

thanks for any help.
#vegan4years

@OpenSpaghettiSauce
Copy link
Contributor

Therefore, if i put max speed down/up on qbittorent, my screen will flood from input/output HDD errors.

How do you see this? Like the torrents will error out?
Could you enable Execution Log and show what kind of errors do you get?

Just because storage is slow, you should not get errors. But, I would definitely check the HDD with smartctl and see if it's health is 100%. You can also post the whole output of smartctl -a /dev/sda and we can help analyze it.

@cpe-1704-tks
Copy link

Just a thought, but you might try reducing "Disc queue size" in the Advanced options to better match the download speed to the drive performance.

@estatistics
Copy link
Author

there are also software / hardware limits to this. When 1mb upload, almost whole system is like hanging up. So i have now the speed at 500kb. Which offers much more stability to my system.

@Seeker2
Copy link

Seeker2 commented Jul 30, 2023

Excessive IO on storage drives may also be to blame: #14844

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants
@Seeker2 @R-Adrian @estatistics @OpenSpaghettiSauce @cpe-1704-tks and others