-
-
Notifications
You must be signed in to change notification settings - Fork 8.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revamp the rabit implementation. #10112
Merged
Merged
Commits on May 8, 2024
-
get host name. send port. all gather. assert. op. begin work on bootstrap. utilities. work on bootstrap. move listener. catch. comm. async send. block. block. Start work on async. batch poll. tests. move. Start working on tracker. better tests. work on tracker. bind. work on accepting workers. complete allgather. Move. Send with JSON. work on shutdown. msg. compare task. rename. Move. cleanup. Start work on broadcast. Work comm. Cleanup bootstrap. hide. Move to bootstrap. non blocking. cleanup. any op. shift. cleanup. Cleanup. per-thread. checks. start working on nccl. backend. Get the prototype compile. log. test print. timeout on connection. get nccl allreduce basic. look into federated. proto. scatter reduce. allreduce prototype. Work on tests. cleanup. Initialization. Init. Work on Python. get args. Start working on allgatherv. convert some allreduce. remove some old use. remove cpu impl. work on gpu. play with dlopen. convert. convert. convert. placeholder. backend. work on federated. remove. Move. Federated tracker. Move. move into comm. GPU variant. not just nccl. fix. fix. Convert. bitwise. stream. copying allgather. replace. Remove. remove. Remove device. Remove rabit. Remove rabit. cmake. tests. use gmock. Move. Split. init. Extract. compiler. test timeout. exc. comments. Tests for federated. Remove. remove. Split up. refactor tests. format. extract magic number. Extract more commands. refactor. Remove. Reduce dependency on c api. remove old code. throw. coll error. indirect. look into dask module. parameters. command. probing. listen for error. debug. host. cleanup. dask. loop. working basic. header. guard. test. type. socket. cleanup & notes. use a state machine. work on tests. header. test channel. cleanup. cleanup broadcast. unneeded changes. allgather string. Fixes. cleanup rebase. fixes after rebase. split up nccl comm. Move data copying. allgatherv test. Extract. tests. test allreduce. remove the use of ctx. tests. rebase. work on fed. work on allgatherv. name. lint. Split. split. remove gmock. move. CPU. CUDA. compile. Cleanup. header. Work on tests. checks. fixes. tests. work on CUDA test. comm. Share the implementation. tests. cleanup. cleanup. cleanup cleanup. set device. cleanup. cleanup. more. cleanup. Get it work. wait. revert dask changes. time. remove reference to encoder. extract. extract. split up the training function. Fix. deterministic. Fix. debug. Fixes. remove. cleanup. fix. Move worker env. cleanup. cleanup. wait. cleanup. extract error handling. get abort to work as well. Move. policy. cleanups. cleanup. Split up. doc. Cleanup ctor. tests. tests. tests. configuration. tests. task id. start working on metric tests. Remove. type. agg. fix seq. tests. start working on cuda test. type. fixes. tests. Use device ord. Remove auc. remove elementwise. remove multi-class cleanup aft. cleanup ranking. remove old tests. headers. Move. move. single gpu tests. Cleanup C API. unknown. C API. Small cleanup. cleanup. Fix. cleanup. work on async queue. work on sync. Use blocking op. result. Fuzzing. result. Remove coll error. Move. cleanup. cleanup. cleanup. cleanup. cleanup. cleanup. cleanup. Fix removal. test lint. remove. cleanup. cleanup. cleanup. invoke result. note. Fix rebase. Fix rebase. fix & cleanup. Fix. remove coll error for now. cleanup. replace. replace. replace. test basic. cleanup, fix. deduced size. cleanup. Convert to new routines. Fixes. Fix. Add test. use vector. cleanup. safe coll. Fix. Fix. Fix. Fix. cleanup. cleanup. Don't throw. Fixes. v6 timeout. Cleanups. Remove error handling for now. Timeout. syc. mac. cli. remove. types. federated. build. build. sortby. build. windows, macos. macos. federated. macos. lint. skip finalize. Forbid empty data. Shutdown before dtor. small allreduce. rounddown. empty input. remove warning. remove get host IP. take down the jvm package for now. stop early. annotation. lint. debug check. windows. np.bool. Work on shutdown. test blocking. remove dask error. Detach. comments. blocking. display timeout. debug github error. checks. Switch the order. revert debug log. fix tests. delete. reverse. don't block. improved error. clear; shutdown the tracker. release lock early. comments. macos. windows. Move. const. Unify ctor. remove exceptions. lint, comment. freeze pyarrow. windows. r package. Fix CI. Start looking into jvm chpk jni. c test. remove extra argument. tracker. interrupt. cleanup. Fix spark profiling. Compile. Start convert the scala package. Log init. cleanup test. communicator. alive. tests log. Revert "log." This reverts commit 3bc6d82. Shutdown when exit. remove tracker return code. windows build. shutdown only if not closed. lint. protect the listener. concat. Debug log. detect EOF. Revert "Debug log." This reverts commit a3e0bd9. Cleanup. Fixes. lint. don't omit frame pointer. Refactor tests. Fix minimum build. Fix distributed tests on single GPU. cleanup & win build. MacOS compilation. typo. macos, jvm. Windows socket. Ignore POLLHUP Handle shutdown. unix socket fix MSVC Sock error Restore the shutdown signal. states windows sock enable win tests lint. update. Skip tests. skip only for gpu. cleanup. cleanup. remove error code for now. Documents. lower case. rename. Fix. Fix.
Configuration menu - View commit details
-
Copy full SHA for 6c446ca - Browse repository at this point
Copy the full SHA 6c446caView commit details -
Configuration menu - View commit details
-
Copy full SHA for abf2419 - Browse repository at this point
Copy the full SHA abf2419View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9fa105d - Browse repository at this point
Copy the full SHA 9fa105dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3929daa - Browse repository at this point
Copy the full SHA 3929daaView commit details -
Configuration menu - View commit details
-
Copy full SHA for ae0f49d - Browse repository at this point
Copy the full SHA ae0f49dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 08ccefc - Browse repository at this point
Copy the full SHA 08ccefcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 22194a7 - Browse repository at this point
Copy the full SHA 22194a7View commit details -
Configuration menu - View commit details
-
Copy full SHA for bb8e40e - Browse repository at this point
Copy the full SHA bb8e40eView commit details -
Configuration menu - View commit details
-
Copy full SHA for e5c35ec - Browse repository at this point
Copy the full SHA e5c35ecView commit details -
Configuration menu - View commit details
-
Copy full SHA for 81d8692 - Browse repository at this point
Copy the full SHA 81d8692View commit details -
Configuration menu - View commit details
-
Copy full SHA for 99d55b3 - Browse repository at this point
Copy the full SHA 99d55b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for baf99f3 - Browse repository at this point
Copy the full SHA baf99f3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 353f2de - Browse repository at this point
Copy the full SHA 353f2deView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4690758 - Browse repository at this point
Copy the full SHA 4690758View commit details -
Configuration menu - View commit details
-
Copy full SHA for 72ef55b - Browse repository at this point
Copy the full SHA 72ef55bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 594bbc9 - Browse repository at this point
Copy the full SHA 594bbc9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2232a6e - Browse repository at this point
Copy the full SHA 2232a6eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 33876f6 - Browse repository at this point
Copy the full SHA 33876f6View commit details -
Configuration menu - View commit details
-
Copy full SHA for c3547ab - Browse repository at this point
Copy the full SHA c3547abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 269090c - Browse repository at this point
Copy the full SHA 269090cView commit details -
Configuration menu - View commit details
-
Copy full SHA for eb7b88e - Browse repository at this point
Copy the full SHA eb7b88eView commit details -
Configuration menu - View commit details
-
Copy full SHA for b4e97f9 - Browse repository at this point
Copy the full SHA b4e97f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for b56ba97 - Browse repository at this point
Copy the full SHA b56ba97View commit details
Commits on May 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ae44c1a - Browse repository at this point
Copy the full SHA ae44c1aView commit details
Commits on May 11, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 83ac716 - Browse repository at this point
Copy the full SHA 83ac716View commit details -
Configuration menu - View commit details
-
Copy full SHA for 56cf189 - Browse repository at this point
Copy the full SHA 56cf189View commit details
Commits on May 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a1bfe5f - Browse repository at this point
Copy the full SHA a1bfe5fView commit details
Commits on May 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 04cb943 - Browse repository at this point
Copy the full SHA 04cb943View commit details -
Configuration menu - View commit details
-
Copy full SHA for 92a1bc2 - Browse repository at this point
Copy the full SHA 92a1bc2View commit details -
Configuration menu - View commit details
-
Copy full SHA for d91cb40 - Browse repository at this point
Copy the full SHA d91cb40View commit details -
Configuration menu - View commit details
-
Copy full SHA for ec4b35c - Browse repository at this point
Copy the full SHA ec4b35cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 44a43a9 - Browse repository at this point
Copy the full SHA 44a43a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for cc70c88 - Browse repository at this point
Copy the full SHA cc70c88View commit details -
Merge remote-tracking branch 'jiamingy/rabit-worker-get-all' into rab…
…it-worker-get-all
Configuration menu - View commit details
-
Copy full SHA for 61983c4 - Browse repository at this point
Copy the full SHA 61983c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for e334141 - Browse repository at this point
Copy the full SHA e334141View commit details -
Configuration menu - View commit details
-
Copy full SHA for 53d072e - Browse repository at this point
Copy the full SHA 53d072eView commit details
Commits on May 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 53d2a73 - Browse repository at this point
Copy the full SHA 53d2a73View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3391490 - Browse repository at this point
Copy the full SHA 3391490View commit details -
Configuration menu - View commit details
-
Copy full SHA for c9129ef - Browse repository at this point
Copy the full SHA c9129efView commit details
Commits on May 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 4c90247 - Browse repository at this point
Copy the full SHA 4c90247View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7bb4f22 - Browse repository at this point
Copy the full SHA 7bb4f22View commit details -
Configuration menu - View commit details
-
Copy full SHA for c5331f4 - Browse repository at this point
Copy the full SHA c5331f4View commit details -
Configuration menu - View commit details
-
Copy full SHA for a53c87b - Browse repository at this point
Copy the full SHA a53c87bView commit details -
Configuration menu - View commit details
-
Copy full SHA for abc5f3b - Browse repository at this point
Copy the full SHA abc5f3bView commit details
Commits on May 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e4aa87b - Browse repository at this point
Copy the full SHA e4aa87bView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.