Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Failing Test]: PreCommit YAML Xlang Direct fails on GHA #31297

Closed
16 tasks
tvalentyn opened this issue May 15, 2024 · 2 comments
Closed
16 tasks

[Failing Test]: PreCommit YAML Xlang Direct fails on GHA #31297

tvalentyn opened this issue May 15, 2024 · 2 comments

Comments

@tvalentyn
Copy link
Contributor

tvalentyn commented May 15, 2024

What happened?

Sample run: https://github.com/apache/beam/actions/runs/9087570294/job/24975542386

Stacktrace:

INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory

INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar' '41523' '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar' '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "main" java.lang.NoClassDefFoundError: org/slf4j/LoggerFactory
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at org.apache.beam.sdk.expansion.service.ExpansionService.<clinit>(ExpansionService.java:115)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Caused by: java.lang.ClassNotFoundException: org.slf4j.LoggerFactory
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	... 1 more
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:174 Started job service with ['java', '-jar', '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '41523', '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '--alsoStartLoopbackWorker']
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:188 Error bringing up service
Traceback (most recent call last):
  File "/runner/_work/beam/beam/sdks/python/apache_beam/utils/subprocess_server.py", line 175, in start
    raise RuntimeError(
RuntimeError: Service failed to start up with error 1
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:339 Unknown pipeline options received: -v,apache_beam/yaml/integration_tests.py,--deselect,apache_beam/yaml/integration_tests.py::BigqueryTest::test_ReadFromBigQuery_ExternalJavaProvider_0. Ignore if flags are used for internal purposes.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:364 Discarding flag -v, single dash flags are not allowed.
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR /runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar 
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:174 Started job service with ['java', '-jar', '/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '41523', '--filesToStage=/runner/_work/beam/beam/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.57.0-SNAPSHOT.jar', '--alsoStartLoopbackWorker']
ERROR    apache_beam.utils.subprocess_server:subprocess_server.py:188 Error bringing up service

More failures: https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml

Issue Failure

Failure: Test is permared

Issue Priority

Priority: 1

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@tvalentyn
Copy link
Contributor Author

Couldn't repro locally. gradlew :sdks:python:yamlIntegrationTests passed for me.

@damccorm
Copy link
Contributor

Looks like this is back to green - https://github.com/apache/beam/actions/workflows/beam_PreCommit_Yaml_Xlang_Direct.yml?query=event%3Aschedule and probably safe to close? @tvalentyn feel free to reopen if you disagree

@github-actions github-actions bot added this to the 2.58.0 Release milestone Jun 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants