New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MapReduce 读取大文件问题 #8

Closed

zhaohuxing opened this issue Dec 15, 2017 · 1 comment

zhaohuxing commented Dec 15, 2017

我见源码中读取文件，是一次性加载到内存，如果文件非常大，这样做是不是不太合理？

Owner

happyer commented Dec 15, 2017 via email

Zhaohu Xing <notifications@github.com>于2017年12月15日周五上午11:05写道：

我见源码 <https://github.com/happyer/distributed-computing/blob/master/src/mapreduce/common_map.go#L51> 中读取文件，是一次性加载到内存，如果文件非常大，这样做是不是不太合理？ — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#8>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AEI4gQegByUYEIf_YB5FS5Af86Pv-44oks5tAeHhgaJpZM4RC9Mj> .

这里仅仅是一个讲述以逻辑，在工业界肯定是不能这样做

happyer closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment