-
Notifications
You must be signed in to change notification settings - Fork 97
TensorSpark productionalized in yarn-cluster mode #8
Comments
Hey @MasoodK ! Thanks for offering this back, and sorry for the late reply! I'll look thru your commits this weekend and we can pull stuff in. I'm super stoked and grateful that you have done this work. |
Good stuff! On Fri, Nov 4, 2016, 8:14 AM Snake Charmer notifications@github.com wrote:
Algorithms of the Mind http://bit.ly/1ReQvEW http://bit.ly/1ReQvEW Christopher Nguyen CEO & Co-Founder Arimo, Inc. http://www.arimo.com/(née Adatao) 2016 Fast Company World's 10 Most Innovative Companies in Data Science |
Thanks @snakecharmer1024 and @adatao-ddf for the comments! After you have gone through my commits, let me know if there is anything aligned with the future direction of your project. If there is something, I'll try to work with you to bring stuff into your repo, if the current format is not ideal. Have a good weekend! |
@MasoodK Sorry for another delay. I think this looks great. Make a pull request with everything? |
closing as PR is merged |
Hey Arimo contributors,
Thanks for open-sourcing your TensorSpark!
I have done few modifications to a fork of your repo that are mostly relevant to someone interested in taking TensorSpark to production in yarn-cluster mode with CPU machines. You can go through my commit comments to see if there is anything you’d like to bring to your repo; feel free to let me know and I’ll send a PR for the branch and you can then “git cherry-pick” the commits you’re interested in.
I’ve been working with the MNIST dataset; if I find the time, I’ll try to create the ImageNet/AlexNet scenario which I see to be on your roadmap as well.
Thanks.
The text was updated successfully, but these errors were encountered: