Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

low performance on simple replica setup #174

Closed
hanxiao opened this issue Apr 1, 2020 · 3 comments · Fixed by #225
Closed

low performance on simple replica setup #174

hanxiao opened this issue Apr 1, 2020 · 3 comments · Fixed by #225
Labels
priority/critical Urgent: Security, critical bugs, blocking issues. drop everything until this issue is addressed.

Comments

@hanxiao
Copy link
Member

hanxiao commented Apr 1, 2020

CPU util is low
@hanxiao hanxiao added the priority/critical Urgent: Security, critical bugs, blocking issues. drop everything until this issue is addressed. label Apr 1, 2020
@hanxiao
Copy link
Member Author

hanxiao commented Apr 2, 2020 •
edited
Loading

test 1, replicas=24 with/without

    if not socket_type.is_pubsub:
        sock.hwm = int(os.environ.get('JINA_SOCKET_HWM', 4))

image

image

@hanxiao
Copy link
Member Author

hanxiao commented Apr 2, 2020

FlowOptimizeLevel.FULL -> FlowOptimizeLevel.NONE seems improve? but still a lot of workers are idle? need to profile each pea

@hanxiao
Copy link
Member Author

hanxiao commented Apr 2, 2020

i have a feeling this is IO bounded. maybe switch to ssd will solve the issue?

@hanxiao hanxiao mentioned this issue Apr 4, 2020
Closed
This was referenced Apr 5, 2020
Merged
Merged
@hanxiao hanxiao linked a pull request Apr 8, 2020 that will close this issue
feat: add prefetch to gateway #225
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
priority/critical Urgent: Security, critical bugs, blocking issues. drop everything until this issue is addressed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: add prefetch to gateway jina-ai/serve
1 participant
@hanxiao