Skip to content
This repository has been archived by the owner on Dec 26, 2018. It is now read-only.

TensorSpark productionalized in yarn-cluster mode #8

Closed
MasoodK opened this issue Oct 26, 2016 · 5 comments
Closed

TensorSpark productionalized in yarn-cluster mode #8

MasoodK opened this issue Oct 26, 2016 · 5 comments

Comments

@MasoodK
Copy link
Contributor

MasoodK commented Oct 26, 2016

Hey Arimo contributors,
Thanks for open-sourcing your TensorSpark!
I have done few modifications to a fork of your repo that are mostly relevant to someone interested in taking TensorSpark to production in yarn-cluster mode with CPU machines. You can go through my commit comments to see if there is anything you’d like to bring to your repo; feel free to let me know and I’ll send a PR for the branch and you can then “git cherry-pick” the commits you’re interested in.
I’ve been working with the MNIST dataset; if I find the time, I’ll try to create the ImageNet/AlexNet scenario which I see to be on your roadmap as well.
Thanks.

@illuzen
Copy link
Contributor

illuzen commented Nov 4, 2016

Hey @MasoodK ! Thanks for offering this back, and sorry for the late reply!

I'll look thru your commits this weekend and we can pull stuff in. I'm super stoked and grateful that you have done this work.

@adatao-ddf
Copy link

Good stuff!

On Fri, Nov 4, 2016, 8:14 AM Snake Charmer notifications@github.com wrote:

Hey @MasoodK https://github.com/MasoodK ! Thanks for offering this
back, and sorry for the late reply!

I'll look thru your commits this weekend and we can pull stuff in. I'm
super stoked and grateful that you have done this work.

You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#8 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHu6XGzeKGh0p2LTdQiaCnj62iBJbOIxks5q60vdgaJpZM4KhVFe
.

Algorithms of the Mind http://bit.ly/1ReQvEW http://bit.ly/1ReQvEW

Christopher Nguyen

CEO & Co-Founder

Arimo, Inc. http://www.arimo.com/(née Adatao)

2016 Fast Company World's 10 Most Innovative Companies in Data Science
http://bit.ly/1QdFyH2

@MasoodK
Copy link
Contributor Author

MasoodK commented Nov 6, 2016

Thanks @snakecharmer1024 and @adatao-ddf for the comments!

After you have gone through my commits, let me know if there is anything aligned with the future direction of your project. If there is something, I'll try to work with you to bring stuff into your repo, if the current format is not ideal.

Have a good weekend!

@illuzen
Copy link
Contributor

illuzen commented Dec 4, 2016

@MasoodK Sorry for another delay. I think this looks great. Make a pull request with everything?

@aht
Copy link
Member

aht commented Feb 4, 2017

closing as PR is merged

@aht aht closed this as completed Feb 4, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants