Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Worker count exhaustion [Bug] #9

Open
AshishMahendra opened this issue Feb 29, 2024 · 1 comment
Open

Worker count exhaustion [Bug] #9

AshishMahendra opened this issue Feb 29, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@AshishMahendra
Copy link
Collaborator

🐞 Bug Report

Describe the bug

  • When a worker attempts to log in after the worker count has been exhausted, the system currently allows them to go through the process of entering a captcha and worker ID. However, after this, instead of preventing the login at the initial stage, it displays a warning message: "Something seems to be Wrong. Dev team is notified. Please Try Again Later. Thank You!"

Is this a regression?

No

To Reproduce

Steps to reproduce the error:

  1. Wait until the worker count is exhausted.
  2. Attempt to log in as a worker.
  3. Complete the captcha verification.
  4. Enter the worker ID.
  5. Encounter the warning message after the login attempt.

Expected behaviour

  • The expected behavior is that the worker should be informed on the launch page itself that no more logins are being accepted if the worker count has been exhausted. This would prevent unnecessary attempts to log in and improve the user experience by setting the correct expectations upfront.

Media prove


Additional context

@AshishMahendra AshishMahendra self-assigned this Feb 29, 2024
@AshishMahendra AshishMahendra added the bug Something isn't working label Feb 29, 2024
@AshishMahendra AshishMahendra linked a pull request Mar 4, 2024 that will close this issue
@ypkang
Copy link
Collaborator

ypkang commented May 2, 2024

I think we can close this one. Given that this is just expected behavior with the nature of human evaluation setup. Thoughts @AshishMahendra @chandralegend ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants