Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-22291][SQL] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL #19604

Closed
wants to merge 2 commits into from

Conversation

jmchung
Copy link
Contributor

@jmchung jmchung commented Oct 30, 2017

What changes were proposed in this pull request?

This PR fixes the conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL.

How was this patch tested?

Added test in PostgresIntegrationSuite.

… types of uuid, inet and cidr to StingType in PostgreSQL
@jmchung
Copy link
Contributor Author

jmchung commented Oct 30, 2017

cc @cloud-fan, the PR for 2.2, thanks!

@@ -440,8 +440,9 @@ object JdbcUtils extends Logging {

case StringType =>
(array: Object) =>
array.asInstanceOf[Array[java.lang.String]]
.map(UTF8String.fromString)
// some underling types are not String such as uuid, inet, cidr, etc.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

underlying?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops, a typo occurred, thanks @viirya !!

@jmchung
Copy link
Contributor Author

jmchung commented Oct 30, 2017

I found in this branch the Docker-based integration test suites will fail due to it can not pull the image wnameless/oracle-xe-11g:14.04.4, should we move on to wnameless/oracle-xe-11g?

Error response from daemon: manifest for wnameless/oracle-xe-11g:14.04.4 not found

@HyukjinKwon
Copy link
Member

Ah, let's remove [FOLLOWUP] or replace it to something like [BRANCH-2.2] in the PR title.

@jmchung jmchung changed the title [SPARK-22291][SQL][FOLLOWUP] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL [SPARK-22291][SQL][BRANCH-2.2] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL Oct 30, 2017
@jmchung jmchung changed the title [SPARK-22291][SQL][BRANCH-2.2] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL [SPARK-22291][SQL] Conversion error when transforming array types of uuid, inet and cidr to StingType in PostgreSQL Oct 30, 2017
@SparkQA
Copy link

SparkQA commented Oct 30, 2017

Test build #83200 has finished for PR 19604 at commit 549cb81.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 30, 2017

Test build #83201 has finished for PR 19604 at commit 995e38e.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya
Copy link
Member

viirya commented Oct 30, 2017

LGTM

@cloud-fan
Copy link
Contributor

thanks, merging to 2.2!

asfgit pushed a commit that referenced this pull request Oct 30, 2017
…uuid, inet and cidr to StingType in PostgreSQL

## What changes were proposed in this pull request?

This PR fixes the conversion error when transforming array types of `uuid`, `inet` and `cidr` to `StingType` in PostgreSQL.

## How was this patch tested?

Added test in `PostgresIntegrationSuite`.

Author: Jen-Ming Chung <jenmingisme@gmail.com>

Closes #19604 from jmchung/SPARK-22291-FOLLOWUP.
@cloud-fan
Copy link
Contributor

can you close it? PR merged to non-master branch will not be closed automatically. thanks

@jmchung
Copy link
Contributor Author

jmchung commented Oct 30, 2017

Sure, I'll close it and thank you and @viirya.

@jmchung jmchung closed this Oct 30, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…uuid, inet and cidr to StingType in PostgreSQL

## What changes were proposed in this pull request?

This PR fixes the conversion error when transforming array types of `uuid`, `inet` and `cidr` to `StingType` in PostgreSQL.

## How was this patch tested?

Added test in `PostgresIntegrationSuite`.

Author: Jen-Ming Chung <jenmingisme@gmail.com>

Closes apache#19604 from jmchung/SPARK-22291-FOLLOWUP.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants