-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable create_actor_pool to use elastic ip #95
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #95 +/- ##
==========================================
- Coverage 88.97% 85.03% -3.95%
==========================================
Files 48 54 +6
Lines 4038 4552 +514
Branches 770 831 +61
==========================================
+ Hits 3593 3871 +278
- Misses 358 587 +229
- Partials 87 94 +7
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
9589a8b
to
8eaf728
Compare
8d378d2
to
66d7012
Compare
Because ipv6 ip has multiple ':'
Introduced from commit 5ffa0ea Author: Adam Ning <frostyplanet@gmail.com> Date: Wed Jul 10 15:24:08 2024 +0800 ENH: fix non-local client connection problem when server listen on 0.0.0.0 (xorbitsai#92)
4b2ae34
to
112fd2e
Compare
c5fc35b
to
c5aae48
Compare
Usage: create_actor_pool(elastic_address, n_process=0, extra_conf={'listen_elastic_ip': True}, ) While xinference worker serve on cloud elastic_ip, the address used in create_actor_pool() and create_actor both have to be the elastic ip, in order for ActorRef passing around RPC method to client, but we could only listen on 0.0.0.0. (Because the ip is not only valid outside the host)
c5aae48
to
0a5cdf8
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Co-authored-by: Lu Weizheng <luweizheng36@hotmail.com>
create_actor_pool: Add extra_conf option listen_elastic_ip
Usage:
While xinference worker serve on cloud elastic_ip,
the address used in create_actor_pool() and create_actor both have to be the elastic ip,
in order for ActorRef passing around RPC method to client, but we could only listen on 0.0.0.0.
(Because the ip is not only valid outside the host)
Additional fixes:
ucx://127:0.0.1:3456
:
in the ip partAdd cross unittests for ipv6 X listen_elastic_ip X ucx.
The only missing part is ucx X ipv6, because ucx does not supoort ipv6
ISSUE: #96