Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add perpetual deep_searcher scheduler #53

Draft
wants to merge 32 commits into
base: main
Choose a base branch
from

Conversation

latekvo
Copy link
Owner

@latekvo latekvo commented Jul 12, 2024

No description provided.

@latekvo
Copy link
Owner Author

latekvo commented Jul 15, 2024

Important before merging:

  • remove deep_searcher from the workers list - create a dedicated schedulers -s flag for it and webui
  • add simple tasks to summarizer
  • move all workload only to the workers while lifting it out of the schedulers class (deep_searcher)

It's all important, without these changes:

  • each new scheduler has to have a useless llm config created for it
  • schedulers are indistinguishable from core chain workers
  • schedulers have to be added to the -w possible options

@latekvo latekvo mentioned this pull request Jul 15, 2024
@latekvo latekvo changed the title Add perpetual deepsearcher scheduler Add perpetual deep_searcher scheduler Jul 15, 2024
@latekvo
Copy link
Owner Author

latekvo commented Jul 15, 2024

As of 55229b7 everything works as intended, but the criteria I pointed out earlier are still not met.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant