Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snowflake Describe queries to show columns in a table #2260

Closed
brittianwarner opened this issue Mar 28, 2020 · 3 comments · Fixed by #2324
Closed

Snowflake Describe queries to show columns in a table #2260

brittianwarner opened this issue Mar 28, 2020 · 3 comments · Fixed by #2324
Labels
enhancement New feature or request snowflake

Comments

@brittianwarner
Copy link

Describe the feature

The information_schema is extremely slow in Snowflake and it would be nice to use the describe functionality described here:https://docs.snowflake.com/en/sql-reference/sql/desc-table.html

I noticed that 0.16.0 implemented "show schema" but this only solved part of the problem.

I am running many models in parallel and I am seeing issues around the information schema where queries can take around a minute to return table information.

Describe alternatives you've considered

I don't know of any alternatives since this is built into DBT.

Additional context

This feature is database specific.

Who will this benefit?

Anyone using Snowflake.

@brittianwarner brittianwarner added enhancement New feature or request triage labels Mar 28, 2020
@brittianwarner
Copy link
Author

I am also getting these errors quite a bit: 090030 (22000): Information schema query returned too much data. Please repeat query with more selective predicates. compiled SQL at dbt/target/compiled

@drewbanin
Copy link
Contributor

Hey @brittianwarner - thanks for opening this issue! We had a good thread on this topic which is worth checking out if you haven't seen it already: #1877

Let's make this happen. desc table sounds like it will work great, and we've implemented a lot of the things we needed to implement to make this particular change tractable.

@drewbanin drewbanin added this to the Octavius Catto milestone Mar 30, 2020
@brittianwarner
Copy link
Author

Sounds great! Let me know if I can help in any way.

@drewbanin drewbanin changed the title Snowflake Describe queries Snowflake Describe queries to show columns in a table Apr 1, 2020
beckjake added a commit that referenced this issue Apr 16, 2020
…columns-in-table

Use "describe table" to get the columns in a relation on snowflake (#2260)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request snowflake
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants