Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Exception while converting Key #129

Closed
tsg opened this issue Sep 15, 2016 · 4 comments
Closed

Exception while converting Key #129

tsg opened this issue Sep 15, 2016 · 4 comments
Assignees
@ph
Labels
bug

Comments

@tsg
Copy link

tsg commented Sep 15, 2016

  • Version: beta1 IRC
  • Operating System: linux/docker

I was trying to test the beta1 IRC, but I'm getting an exception on startup:

[2016-09-15T09:15:36,445][ERROR][logstash.agent           ] Pipeline aborted due to error {:exception=>java.lang.NullPointerException, :backtrace=>["org.logstash.netty.PrivateKeyConverter.generatePkcs8(org/logstash/netty/PrivateKeyConverter.java:43)", "org.logstash.netty.PrivateKeyConverter.convert(org/logstash/netty/PrivateKeyConverter.java:39)", "java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:498)", "RUBY.create_server(/opt/logstash-5.0.0-beta1/vendor/bundle/jruby/1.9/gems/logstash-input-beats-3.1.0.beta4-java/lib/logstash/inputs/beats.rb:139)", "RUBY.register(/opt/logstash-5.0.0-beta1/vendor/bundle/jruby/1.9/gems/logstash-input-beats-3.1.0.beta4-java/lib/logstash/inputs/beats.rb:132)", "RUBY.start_inputs(/opt/logstash-5.0.0-beta1/logstash-core/lib/logstash/pipeline.rb:324)", "org.jruby.RubyArray.each(org/jruby/RubyArray.java:1613)", "RUBY.start_inputs(/opt/logstash-5.0.0-beta1/logstash-core/lib/logstash/pipeline.rb:323)", "RUBY.start_workers(/opt/logstash-5.0.0-beta1/logstash-core/lib/logstash/pipeline.rb:195)", "RUBY.run(/opt/logstash-5.0.0-beta1/logstash-core/lib/logstash/pipeline.rb:153)", "RUBY.start_pipeline(/opt/logstash-5.0.0-beta1/logstash-core/lib/logstash/agent.rb:250)", "java.lang.Thread.run(java/lang/Thread.java:745)"]}

The certificates are the ones from here which should be created with the right openssl version (I did try to recreate them).

The full debugging output can be found here: https://gist.github.com/tsg/965625a1a2aa6aa6bfed1fa9fd81646c
@tsg
Copy link
Author

tsg commented Sep 15, 2016

CC @ph

tsg pushed a commit to tsg/beats that referenced this issue Sep 15, 2016
Update testing environment to beta1 IRC
706d468 
- Changed the logstash dockerfile to use the tar.gz which is much
  simpler.
- Unfortunately it still doesn't work, I posted:
  logstash-plugins/logstash-input-beats#129
- For elasticsearch I did a hack for now, but we should consider moving
  to the tar.gz as well
@tsg tsg mentioned this issue Sep 15, 2016
Merged
@ph ph self-assigned this Sep 15, 2016
@ph
Copy link
Contributor

ph commented Sep 15, 2016

That's problematic, the last release of the beats input shouldn't contains the PrivateKeyConverter.java.

I known whats happening, IIRC the unified build process takes the 5.0 branch to generate the artifact and in our branch the lockfile (which is the source of truth for the version) is set to the
3.1.0.beta4!

See https://github.com/elastic/logstash/blob/5.0/Gemfile.jruby-1.9.lock#L248
Not sure why its not in sync.

ph added a commit to ph/logstash that referenced this issue Sep 15, 2016
@ph
Update Logstash 5 to the latest input beats 3.1.4
c395df7 
The B1 internal releases contained an old version of the beats input which didn't
work well with the private keys, this PR make sure we use the latest version 3.1.4 in the 5.0 and 5.X branches

Fixes: logstash-plugins/logstash-input-beats#129
@ph ph mentioned this issue Sep 15, 2016
Merged
@ph
Copy link
Contributor

ph commented Sep 15, 2016

This will be fixed by elastic/logstash#5925

@ph ph added the bug label Sep 15, 2016
suyograo pushed a commit to elastic/logstash that referenced this issue Sep 15, 2016
@ph
Update Logstash 5 to the latest input beats 3.1.4 (#5925)
4502144 
The B1 internal releases contained an old version of the beats input which didn't
work well with the private keys, this PR make sure we use the latest version 3.1.4 in the 5.0 and 5.X branches

Fixes: logstash-plugins/logstash-input-beats#129
elasticsearch-bot pushed a commit to elastic/logstash that referenced this issue Sep 15, 2016
@ph @suyograo
Update Logstash 5 to the latest input beats 3.1.4
393341c 
The B1 internal releases contained an old version of the beats input which didn't
work well with the private keys, this PR make sure we use the latest version 3.1.4 in the 5.0 and 5.X branches

Fixes: logstash-plugins/logstash-input-beats#129

Fixes #5925
@ph
Copy link
Contributor

ph commented Sep 15, 2016

We will respin a new beta1, the fix is in master

@ph ph closed this as completed Sep 15, 2016
ruflin pushed a commit to elastic/beats that referenced this issue Sep 19, 2016
@tsg @ruflin
Update testing environment to beta1 IRC (#2553)
8bd177a 
- Changed the logstash dockerfile to use the tar.gz which is much
  simpler.
- Unfortunately it still doesn't work, I posted:
  logstash-plugins/logstash-input-beats#129
- For elasticsearch I did a hack for now, but we should consider moving
  to the tar.gz as well
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ph ph

Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ph @tsg