Skip to content

BIGTOP-3635: Bump logstash's log4j dependencies to 2.17.0#858

Merged
iwasakims merged 2 commits into
apache:masterfrom
yoda-mon:update-logstash-log4j
Jan 26, 2022
Merged

BIGTOP-3635: Bump logstash's log4j dependencies to 2.17.0#858
iwasakims merged 2 commits into
apache:masterfrom
yoda-mon:update-logstash-log4j

Conversation

@yoda-mon
Copy link
Copy Markdown
Contributor

Update log4j2 version to 2.17.0 to keep up the issue https://issues.apache.org/jira/browse/BIGTOP-3613.

This PR omits default plugins

  • logstash-input-http
  • logstash-input-log4j
  • logstash-input-kafka
  • logstash-input-beats
  • logstash-output-kafka
    that includes older versions of log4j.
    Those plugins do not seem to be maintained now so I would rather remove them than make efforts to path those plugins.

Copy link
Copy Markdown
Member

@iwasakims iwasakims left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. smoke-tests passed on CentOS 7 x86_64.

$ ./gradlew logstash-clean logstash-pkg repo
$ rpm -qlp output/logstash/x86_64/logstash-5.4.1-2.el7.x86_64.rpm | grep -i log4j
/etc/logstash/conf.dist/log4j2.properties
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/2.17.0
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/2.17.0/log4j-api-2.17.0.jar
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/2.17.0
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/2.17.0/log4j-core-2.17.0.jar
$ cd provisioner/docker
$ ./docker-hadoop.sh \
    --create 1 \
    --image bigtop/puppet:trunk-centos-7 \
    --memory 16g \
    --enable-local-repo \
    --disable-gpg-check \
    --stack logstash \
    --smoke-tests logstash
...
Now testing...
:bigtop-tests:smoke-tests:logstash:test (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 14.174 secs.

BUILD SUCCESSFUL in 46s
34 actionable tasks: 7 executed, 27 up-to-date

$ ./docker-hadoop.sh --exec 1 rpm -ql logstash | grep -i log4j
/etc/logstash/conf.dist/log4j2.properties
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/2.17.0
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/2.17.0/log4j-api-2.17.0.jar
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/2.17.0
/usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/2.17.0/log4j-core-2.17.0.jar

@iwasakims
Copy link
Copy Markdown
Member

looks good on Ubuntu 20.04 too.

$ ./gradlew logstash-clean logstash-pkg repo

$ dpkg-deb -c output/logstash/logstash_5.4.1-2_all.deb | grep -i log4j
-rw-r--r-- root/root      1333 2022-01-26 09:42 ./etc/logstash/conf.dist/log4j2.properties
drwxr-xr-x root/root         0 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/
drwxr-xr-x root/root         0 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/
drwxr-xr-x root/root         0 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/2.17.0/
-rwxr-xr-x root/root    301742 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-api/2.17.0/log4j-api-2.17.0.jar
drwxr-xr-x root/root         0 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/
drwxr-xr-x root/root         0 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/2.17.0/
-rwxr-xr-x root/root   1789297 2022-01-26 09:42 ./usr/lib/logstash/logstash-core/lib/org/apache/logging/log4j/log4j-core/2.17.0/log4j-core-2.17.0.jar

$ cd provisioner/docker

$ ./docker-hadoop.sh \
    --create 1 \
    --image bigtop/puppet:trunk-ubuntu-20.04 \
    --memory 16g \
    --repo file:///bigtop-home/output/apt \
    --disable-gpg-check \
    --stack logstash \
    --smoke-tests logstash
...
Now testing...
:bigtop-tests:smoke-tests:logstash:test (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 13.162 secs.

BUILD SUCCESSFUL in 44s
34 actionable tasks: 7 executed, 27 up-to-date

@iwasakims iwasakims merged commit d723c1b into apache:master Jan 26, 2022
iwasakims pushed a commit that referenced this pull request Jan 26, 2022
@iwasakims
Copy link
Copy Markdown
Member

I merged this to master and branch-3.0. Thanks, @yoda-mon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants