Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix the data output exception when accessing Hive using Spark JDBC So… #2085

Merged
merged 5 commits into from
Jul 6, 2022
Merged

Conversation

Bingz2
Copy link
Contributor

@Bingz2 Bingz2 commented Jun 29, 2022

#2084

The data read from hive is the same as the column names, not the real data
image.png
If the queryed field type is numeric, the following exception is reported
image.png
By looking at the Spark source code, it is found that double quotation marks and column names are used when reading data through Jdbc to stitch column names, so it will result in the correct data not being returned
image.png
image.png
The solution is to re-implement the Hive dialect

Purpose of this pull request

Check list

@ruanwenjun ruanwenjun added First-time contributor First-time contributor connectors-v1 SeaTunnel connectors, include sink, source Spark labels Jul 1, 2022
@Hisoka-X Hisoka-X merged commit 67613d1 into apache:dev Jul 6, 2022
@CalvinKirs CalvinKirs added this to the 2.1.3 milestone Jul 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
connectors-v1 SeaTunnel connectors, include sink, source First-time contributor First-time contributor Spark
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants