Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

local/install_deps.bash seems to fail mysteriously when there isn't enough memory #134

Closed
evverx opened this issue Feb 8, 2019 · 7 comments

Comments

@evverx
Copy link

evverx commented Feb 8, 2019

I launched a VM where install_deps.bash failed with

Running: bazel run //local:create_gopath 2>/dev/null
| Return code is non-zero (1).
| Exit.

, which wasn't very helpful. Without 2 >/dev/null I was able to figure out what happened but unfortunately additionally broke something else because apparently the output is used to set GOPATH :-) I think it would be great if the output wasn't sent to "/dev/null" here.

(I relaxed the limits a bit and got past install_deps.bash and now python butler.py run_server --bootstrap seems to be stuck trying to "build templates for App Engine". The machine is totally unresponsive so it's hard to tell what's going on. I'm going to tweak the limits until it works but it would probably be useful to mention in the documentation how a "typical" machine is supposed to look like, that is something like https://github.com/google/oss-fuzz/blob/master/docs/faq.md#what-are-the-specs-on-your-machines maybe).

@evverx
Copy link
Author

evverx commented Feb 8, 2019

The machine is totally unresponsive

Judging by "Out of memory: Kill process 2299 (node) score 115 or sacrifice child", it was the OOM killer that was busy destroying "polymer-bundler". I hope 32Gb will suffice.

@Dor1s
Copy link
Contributor

Dor1s commented Feb 8, 2019

That's really weird, I don't think you need any beefy machine for that. Which OS are you trying this on?

@evverx
Copy link
Author

evverx commented Feb 8, 2019

That was Ubuntu 18.04.1 LTS run on top of macOS Mojave with VirtualBox.

@evverx
Copy link
Author

evverx commented Feb 8, 2019

Anyway, I kind of found an abandoned beefy machine :-) and everything seems to be working as far as I can tell. I don't think I'll start to dig deeper anytime soon so I think the issue can safely be closed.

And, by the way, congratulations on open-sourcing ClusterFuzz!

@inferno-chromium
Copy link
Collaborator

Reopening to improve the things mentioned in c#0.

@inferno-chromium
Copy link
Collaborator

bazel does not support a quite mode, so everything gets dumped to stderr - https://groups.google.com/forum/#!topic/bazel-discuss/JVCotYRXeyk

till then i will fix this to make it more obvious where we are running this command, like this is run in 'src' subdir. maybe also update code with comment.

inferno-chromium added a commit that referenced this issue Feb 8, 2019
* Make more clear where butler command runs.

* Set GOPATH from last line

* Format

* dir->cwd
@inferno-chromium
Copy link
Collaborator

polymer_bundler will be tracked by its own issue. bazel issue should be fixed now. Thanks for the report.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants