Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

xlearning是否能够支持Tensorflow的输入文件自动分割 #34

Closed
sinllychen opened this issue Apr 23, 2018 · 1 comment
Closed

Comments

@sinllychen
Copy link

xlearning默认的tensorflow任务运行方式输入是要求用户自己分割好文件,即ps 的数目要小于或等于输入文件的个数。 而对于input strategy,之前有咨询过Stream模式的输入策略,这个策略要求输入是标准输入。那么对于文件输入的话,xlearning是否支持自动分割文件?

@liyuance
Copy link
Contributor

xlearning集成了inputformat可以实现对文件的切割。如果不想从标准输入,建议先把标准输入的数据预先读取一遍放到本地磁盘,然后提供给tensorflow试用。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants