-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-12581][SQL] Support case-sensitive table names in postgresql #10523
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
retest this please |
|
Test build #48482 has finished for PR 10523 at commit
|
|
Test build #48703 has finished for PR 10523 at commit
|
9d2f3ed to
ba0e434
Compare
|
retest this please |
|
Test build #48725 has finished for PR 10523 at commit
|
|
Test build #48723 has finished for PR 10523 at commit
|
3b0654c to
f5537e9
Compare
|
Test build #48730 has finished for PR 10523 at commit
|
f5537e9 to
a6e3a73
Compare
|
Test build #48734 has finished for PR 10523 at commit
|
|
@liancheng @yhuai Could you review this? |
|
@maropu Thank you for the PR. So, when you quote a table name in postgres, the name is case-sensitive, right? Looks like we are always quoting the table name? If so, seems we are changing the semantic because if I use a table name |
|
@yhuai Yes, quoted tables in postgres are always case-sensitive. We need to support case-insensitive table names? Table names in sparksql ( |
|
@maropu Let me explain. The case sensitivity in spark sql is actually configurable. For HiveContext, we use case insensitive resolution. |
|
@yhuai Ah..., I misunderstood. Okay and how about turning on/off case sensitivity in configurations, e.g., |
|
Is it a postgresql specific thing? Maybe it is better to allow users to set a conf in the data source optionsS (a conf that can be set by doing |
|
@yhuai yes and it's a pg-specific thing. I agree that we add it as a data source option instead of sql conf. If the fix is acceptable, I'll fix this pr to add a data source option like |
a6e3a73 to
98c7af9
Compare
|
Test build #48927 has finished for PR 10523 at commit
|
|
Close this for now and, if needed, I'll reopen this. |
Table names in postgresql is originally case-insensitive.
To support case-sensitive table names, we need to wrap names in double quotes.