Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

review of SETI limits #3387

Closed
captainiom opened this issue Dec 2, 2019 · 20 comments
Closed

review of SETI limits #3387

captainiom opened this issue Dec 2, 2019 · 20 comments
Labels
T: Informational Information only, no code changes required

Comments

@captainiom
Copy link

captainiom commented Dec 2, 2019

As AMD hardware develops with ever increasing cores and hyperthreading the SETI limits become increasingly outdated. The maximum cpu limit of 100 tasks is particularly irrelevant as it constrains crunching with all threads and when SETI servers go off line - whether for maintenance or due to a problem - the back up tasks awaiting start are quickly used up and dedicated machines just become idle which is hardly optimal.
Thus I suggest that all of these limits which are holding back performance should be reviewed. If necessary there could be two limits the standard exiting set and an enhanced set selectable in preferences?

@dioguerra
Copy link

You can request more work from boinc

@truboxl
Copy link
Contributor

truboxl commented Dec 2, 2019

You can run multiple boinc clients on a single machine

@KeithMyers
Copy link

You can run multiple boinc clients on a single machine

But takes concerted effort to arrange multiple running clients. More than the casual user will want to do. Much better to have a configurable preference setting accessible from the Manager.

@davidpanderson
Copy link
Contributor

This a SETI@home issue, not a BOINC issue.

@captainiom
Copy link
Author

If it is thought not relevant to this thread then which thread would be appropriate?

@RichardHaselgrove
Copy link
Contributor

SETI@Home has Message Boards

@KeithMyers
Copy link

The OP was requesting a feature that in BOINC that allows more than 100 threads to be used. Is that not a limit in BOINC? Do projects other than Seti allow more than 100 threads to be active. Use case is for mainstream processors with 128 threads or server processors with 256 threads.

For these processors, is only running multiple clients simultaneously the only solution?

@davidpanderson
Copy link
Contributor

davidpanderson commented Dec 2, 2019 via email

@KeithMyers
Copy link

OK, thanks for clarifying there is no underlying BOINC limit on active threads. How does the OP contact the people responsible for the the Seti server configuration. I don't know of an equivalent to the github.com/BOINC/boinc/issues avenue for just Seti.

@RichardHaselgrove
Copy link
Contributor

Volunteers are welcome to post on the project's message boards: there is even a 'wish list' in the Questions and Answers area.

But if @captainiom is willing to read before he posts, he will find that the same question has been asked many times before. And I expect that the answer will remain the same: project configurations are set for the benefit of the smooth running of the project as a whole, not to suit the private aspirations of any single member.

@KeithMyers
Copy link

All well and good. However I doubt you can show me one single "wish list" item that has made it onto the BOINC/Seti Issues >>pull request>>Projects/ToDo list. Can you show me any sign the Seti developers even read any of the posts in the Wish List forum? The only way I know of to track a deficiency and make it actionable for Seti/BOINC is to get it logged into Github/BOINC.

All the Wish List forum is good for is a place to vent your frustration.

The Seti configuration has not kept up with trend of cpus having more threads than the single core cpus of the time that Seti first started. A lot of crunching horsepower is being underutilized.

@captainiom
Copy link
Author

I would echo Keith's comments. Moreover, I am aware that there has been concern in the past but I feel that the current thrust by AMD and to a lesser extent by Intel for ever more cores and threads requres a review at this time. Hyperthreading will inevitably develop to 4 threads per core and EPYC already have 128 threads available.
Thus I don't believe it is 'for any one member' but for the members as a whole that I am asking for a review at this time. If it is inappropriate in github/BOINC but that it should be in Github to galvanise the SETI developers then why not make a github/SETI main thread?
If I have learned anything from my 50 years in IT it is that change is inevitable - even dinosaurs became extinct.
JSM

@RichardHaselgrove
Copy link
Contributor

@SETIguy, @davidpanderson

There's been no official announcement from either of you, but the 'work in progress' limits were raised on Friday evening to 200 per CPU, 400 per GPU. I hope whoever did that is keeping a close eye on the database performance as the caches fill.

@captainiom
Copy link
Author

Do these seti limits impinge on BOINC operation?

@RichardHaselgrove
Copy link
Contributor

No - except if you personally abuse the freedom, and download too many tasks (your own machine might slow down), or if a large group of users abuse the freedom (in which case, the whole SETI project might encounter database problems).

@RichardHaselgrove
Copy link
Contributor

Using your JSM handle, you reported in your 'Ryzen' (CPU) thread on the SETI message boards that

I am pleased to report that the limits WILL be reviewed and if possible and practical will be increased slowly.

I am not yet sure that a four-fold increase in GPU limits counts as 'slowly', or addresses the specific Ryzen issue: that's why I'm urging caution and close monitoring, here and on the SETI boards. We had an intervention in 2013 (also at a weekend) which spiked the database to well over 10 million tasks, slowed everything to a crawl, and took at least a week to recover from.

@SETIguy
Copy link
Contributor

SETIguy commented Dec 9, 2019 via email

@RichardHaselgrove
Copy link
Contributor

Thanks - that's reassuring. Total in progress has reached 6.93 million, and still seems to be rising slowly, but under control. I'll pass on the news.

@SETIguy
Copy link
Contributor

SETIguy commented Dec 10, 2019 via email

@AenBleidd AenBleidd added the T: Informational Information only, no code changes required label Jan 2, 2020
@captainiom
Copy link
Author

captainiom commented Jan 2, 2020 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
T: Informational Information only, no code changes required
Projects
None yet
Development

No branches or pull requests

8 participants