-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Replace MPI send/receive with asychronous sockets calls #3
Comments
Working on a sender which can automatically chunk the data into packets and send it with its own sequencing logic. Added a new method as well to calculate the size However I'm rethinking the JSON-style approach and might try to use a more rigid approach where we just define bytes in the first X locations to be metadata like sequence/tag/etc.. then the rest is the actual data. Still working out the kinks but with the tests going coming along with development it shouldn't be too bad.
@mariellej If you've got time check out the |
Added more tests and squashed a couple bugs. Needed to set the listening socket to be non-blocking (a 0 second timeout) as well as fix a couple of typos by forgetting to reference `self`
A good chunk of this work has been completed. Completed work:
TODO:
|
Going to close this for now but I'm going to leave the last TODO bullet open TODO:
|
We need to stop using MPI, but rather UDP.
We've shown from some research that the algorithm can run faster if we use UDP rather than MPI communication and can be faster in terms of resiliency.
With this in mind we should create some kind of async socket interface in order to send and listen for data in the background while our algorithm is listening.
The text was updated successfully, but these errors were encountered: