-
Notifications
You must be signed in to change notification settings - Fork 28.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-22291][SQL] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL #19604
Conversation
… types of uuid, inet and cidr to StingType in PostgreSQL
cc @cloud-fan, the PR for 2.2, thanks! |
@@ -440,8 +440,9 @@ object JdbcUtils extends Logging { | |||
|
|||
case StringType => | |||
(array: Object) => | |||
array.asInstanceOf[Array[java.lang.String]] | |||
.map(UTF8String.fromString) | |||
// some underling types are not String such as uuid, inet, cidr, etc. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
underlying?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oops, a typo occurred, thanks @viirya !!
I found in this branch the Docker-based integration test suites will fail due to it can not pull the image
|
Ah, let's remove |
Test build #83200 has finished for PR 19604 at commit
|
Test build #83201 has finished for PR 19604 at commit
|
LGTM |
thanks, merging to 2.2! |
…uuid, inet and cidr to StingType in PostgreSQL ## What changes were proposed in this pull request? This PR fixes the conversion error when transforming array types of `uuid`, `inet` and `cidr` to `StingType` in PostgreSQL. ## How was this patch tested? Added test in `PostgresIntegrationSuite`. Author: Jen-Ming Chung <jenmingisme@gmail.com> Closes #19604 from jmchung/SPARK-22291-FOLLOWUP.
can you close it? PR merged to non-master branch will not be closed automatically. thanks |
Sure, I'll close it and thank you and @viirya. |
…uuid, inet and cidr to StingType in PostgreSQL ## What changes were proposed in this pull request? This PR fixes the conversion error when transforming array types of `uuid`, `inet` and `cidr` to `StingType` in PostgreSQL. ## How was this patch tested? Added test in `PostgresIntegrationSuite`. Author: Jen-Ming Chung <jenmingisme@gmail.com> Closes apache#19604 from jmchung/SPARK-22291-FOLLOWUP.
What changes were proposed in this pull request?
This PR fixes the conversion error when transforming array types of
uuid
,inet
andcidr
toStingType
in PostgreSQL.How was this patch tested?
Added test in
PostgresIntegrationSuite
.