Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@tikikun
Copy link
Contributor

@tikikun tikikun commented Dec 21, 2023

  • Use number of logical cores to be a threadpool of drogon (to handle things outside of inference)
  • n_parallel dependency on drogon thread_num has been removed, manually set from now on

@hahuyhoang411 please check and update the docs

@tikikun tikikun added the P0: critical Mission critical label Dec 21, 2023
@tikikun tikikun self-assigned this Dec 21, 2023
@tikikun tikikun linked an issue Dec 21, 2023 that may be closed by this pull request
@tikikun tikikun merged commit 380420e into main Dec 22, 2023
@hiro-v hiro-v deleted the 290-feat-proper-threadpool-allocations branch December 22, 2023 03:00
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

P0: critical Mission critical

Projects

No open projects
Archived in project

Development

Successfully merging this pull request may close these issues.

feat: Proper threadpool allocations

2 participants