thirdPartyAudit failures in repository-gcs and repository-hdfs

[talevy]

num occurrences: 21 times thus far in 2019

failure message

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.

* What went wrong:
Execution failed for task ':plugins:repository-gcs:thirdPartyAudit'.
> Third party audit task is not configured correctly

2: Task failed with an exception.

* What went wrong:
Execution failed for task ':plugins:repository-hdfs:thirdPartyAudit'.
> Third party audit task is not configured correctly

what seem to be relevant log lines:

Unnecessary exclusions, following classes have no violations:
   * org.apache.hadoop.crypto.CryptoStreamUtils
  * org.apache.hadoop.hdfs.shortcircuit.ShortCircuitShm$Slot

> Task :plugins:repository-hdfs:thirdPartyAudit
  * org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer
  * org.apache.hadoop.io.FastByteComparisons$LexicographicalComparerHolder$UnsafeComparer$1
  * org.apache.hadoop.io.nativeio.NativeIO
  * org.apache.hadoop.security.SecurityUtil$QualifiedHostResolver
  * org.apache.hadoop.util.SignalLogger$Handler

...

Unnecessary exclusions, following classes are not missing:
> Task :x-pack:plugin:sql:jdbc:checkstyleMain
   * com.google.appengine.api.urlfetch.HTTPRequest
  * com.google.appengine.api.urlfetch.URLFetchService
  * com.google.appengine.api.urlfetch.URLFetchServiceFactory
  * javax.servlet.ServletContextEvent
  * javax.servlet.ServletContextListener
  * org.apache.avalon.framework.logger.Logger

attached logs: thirdpartyaudit.txt.zip

[elasticmachine]

Pinging @elastic/es-core-infra

[andyb-elastic]

I wasn't able to reproduce this on a9178b3, which is the last-good-commit from the log attached

it was this 7.x build https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+7.x+multijob-unix-compatibility/os=opensuse/14/console

I did notice that it looks like a few other thirdPartyAudit tasks in there that didn't fail the build (or at least didn't show up in the build scan) had similar messages https://scans.gradle.com/s/pkfvnjzyuqugq/console-log?type=org.elasticsearch.gradle.precommit.ThirdPartyAuditTask

[talevy]

also happened with

:x-pack:plugin:sql:sql-client:thirdPartyAudit

Unnecessary exclusions, following classes are not missing:
   * org.apache.sshd.server.Signal

in 7.0: https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+7.0+multijob-unix-compatibility/os=opensuse/14/console

[droberts195]

There was also a failure of thirdPartyAudit in the discovery-ec2 and discovery-gcs plugins in
https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+6.6+multijob-unix-compatibility/os=opensuse/114/console

09:53:16 1: Task failed with an exception.
09:53:16 -----------
09:53:16 * What went wrong:
09:53:16 Execution failed for task ':plugins:discovery-ec2:thirdPartyAudit'.
09:53:16 > Invalid exclusions, nothing is wrong with these classes:   * org.apache.log.Hierarchy
09:53:16     * org.apache.log.Logger
09:53:16     * software.amazon.ion.system.IonBinaryWriterBuilder
09:53:16     * software.amazon.ion.system.IonSystemBuilder
09:53:16     * software.amazon.ion.system.IonTextWriterBuilder
09:53:16 
09:53:16 * Try:
09:53:16 Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
09:53:16 ==============================================================================
09:53:16 
09:53:16 2: Task failed with an exception.
09:53:16 -----------
09:53:16 * What went wrong:
09:53:16 Execution failed for task ':plugins:repository-gcs:thirdPartyAudit'.
09:53:16 > Invalid exclusions, nothing is wrong with these classes:   * com.google.common.util.concurrent.AbstractFuture$UnsafeAtomicHelper
09:53:16     * org.apache.log.Hierarchy
09:53:16     * org.apache.log.Logger
09:53:16 
09:53:16 * Try:
09:53:16 Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
09:53:16 ==============================================================================

These don't reproduce locally using the exact commit that that build used (352aa7c), so I assume the problem is some sort of flakiness in the build system rather than an actual violation of 3rd party code policy.

[alpar-t]

This is an infra issue on some of the older non ephemeral workers

[jkakavas]

Adding the failure in https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+6.7+multijob-unix-compatibility/os=opensuse/24/console as a data point