Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unit Tests on Windows Build fail due to Spark Dependency for SparkParquetWriterTest fails unexpectedly #1471

Closed
prb112 opened this issue Sep 2, 2020 · 0 comments · Fixed by #1462
Assignees
Labels
bug Something isn't working

Comments

@prb112
Copy link
Contributor

prb112 commented Sep 2, 2020

Describe the bug
Unit Tests on Windows Build fail due to Spark Dependency for SparkParquetWriterTest fails unexpectedly

To Reproduce

  1. Login to a Windows machine
  2. Clone the IBM/FHIR repo
  3. Run mvn clean install -f fhir-examples
  4. Run mvn clean install -f fhir-parent
2020-09-01T21:12:09.3057183Z 	at java.base/java.lang.Thread.run(Thread.java:834)
2020-09-01T21:12:09.3057347Z 
2020-09-01T21:12:09.3057582Z Driver stacktrace:
2020-09-01T21:12:09.3057852Z 20/09/01 21:12:09 INFO DAGScheduler: Job 1 failed: parquet at SparkParquetWriter.java:103, took 0.508723 s
2020-09-01T21:12:09.3058138Z 20/09/01 21:12:09 ERROR FileFormatWriter: Aborting job 47a52c2c-61b3-40b0-b72f-8f765c3aeb45.
2020-09-01T21:12:09.3058582Z org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 1, fv-az177.cgzjruzv4kiepne5fmoyuu1a1d.cx.internal.cloudapp.net, executor driver): java.io.IOException: (null) entry in command string: null chmod 0644 C:\Users\runneradmin\AppData\Local\Temp\SparkParquetWriterTest8099458157446433389\_temporary\0\_temporary\attempt_20200901211208_0001_m_000000_1\part-00000-0702d29e-c14e-44ca-a3cc-d260a352527f-c000.snappy.parquet

Expected behavior
The build should succeed.

Additional context
Discovered by @kmbarton423

@prb112 prb112 added the bug Something isn't working label Sep 2, 2020
prb112 added a commit that referenced this issue Sep 2, 2020
- Disables the Unit Tests on Windows Build and Update windows.yml to
catch early Windows Build Errors
- Update the automation to not skipTests

Signed-off-by: Paul Bastide <pbastide@us.ibm.com>
@prb112 prb112 self-assigned this Sep 2, 2020
@prb112 prb112 linked a pull request Sep 2, 2020 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant