Skip to content

Conversation

@alamb
Copy link
Contributor

@alamb alamb commented Aug 4, 2021

Which issue does this PR close?

re #821

Rationale for this change

https://github.com/apache/arrow-datafusion/pull/812/files fixed #821 but did not have a specific reproducer

What changes are included in this PR?

  1. Add a test for Internal error : Unsupported data type in hasher #821
  2. Clean up test setup

Are there any user-facing changes?

No

@alamb alamb merged commit 3908b7b into apache:master Aug 5, 2021
@alamb alamb deleted the alamb/tests_for_dict branch August 8, 2023 20:12
unkloud pushed a commit to unkloud/datafusion that referenced this pull request Mar 23, 2025
When using jvm 17+ spark needs extra jvm args to avoid getting errors
like
```
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.2.0:java (default-cli) on project comet-spark-spark3.4_2.12: An exception occurred while executing the Java class. class org.apache.spark.storage.StorageUtils$ (in unnamed module @0x35b75242) cannot access class sun.nio.ch.DirectBuffer (in module java.base) because module java.base does not export sun.nio.ch to unnamed module @0x35b75242 -> [Help 1]
```

These args are already present inside the main pom.xml. To avoid
duplicating the args we using maven to extract them. In order avoid
slowing down the Makefile the args are defined as a function and
therefore only evaluated when they are needed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Internal error : Unsupported data type in hasher

2 participants