Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parse output of DESCRIBE FORMATTED and create a TableInfo class #738

Closed
wesm opened this issue Nov 18, 2015 · 0 comments
Closed

Parse output of DESCRIBE FORMATTED and create a TableInfo class #738

wesm opened this issue Nov 18, 2015 · 0 comments
Labels
feature Features or general enhancements impala The Apache Impala backend
Milestone
0.6

Comments

@wesm
Copy link
Member

wesm commented Nov 18, 2015

Unit testing ALTER TABLE for partitioned and unpartitioned tables is proving difficult because the metadata being modified is embedded in the results of DESCRIBE FORMATTED. I'll parse the output and render a __repr__ display that is useful.

One annoying thing is if the output of DESCRIBE FORMATTED changed in future Impala versions, but we can cross that bridge when we come to it.
@wesm wesm added feature Features or general enhancements impala The Apache Impala backend labels Nov 18, 2015
@wesm wesm added this to the 0.6 milestone Nov 18, 2015
@wesm wesm mentioned this issue Nov 20, 2015
Closed
wesm added a commit that referenced this issue Nov 22, 2015
@wesm
ENH: Partition metadata management APIs and ALTER TABLE support for t…
1c23901 
…able props

See #335, #490, #702, #738

Author: Wes McKinney <wes@cloudera.com>

Closes #739 from wesm/feature/impala-load-data and squashes the following commits:

12bf165 [Wes McKinney] Implement/test alter table properties for unpartitioned tables
ba0eccd [Wes McKinney] Parse storage parameters too
ce605b2 [Wes McKinney] More metadata parsing code
0c13ecc [Wes McKinney] Incomplete describe formatted parser
b24facb [Wes McKinney] Add stub for DESCRIBE FORMATTED metadata parser
4d2dc2d [Wes McKinney] Test stubs
7760eab [Wes McKinney] DDL tests / cleanup for alter table and alter partition
22e9560 [Wes McKinney] Implement add and modify partition, get load_data test running
244a0be [Wes McKinney] Add partition with properties
3860ed3 [Wes McKinney] Move table properties to AlterTable top level DDL
fd688a6 [Wes McKinney] Alter table properties
d541a2a [Wes McKinney] Add API and DDL stubs for add/modify/drop partition functions
fd2dd16 [Wes McKinney] Initial non-working load data test
ebeb86a [Wes McKinney] Slight refactoring to move more code into ImpalaTable class
e89bab9 [Wes McKinney] Add initial DDL generator for LOAD DATA
@wesm wesm closed this as completed Nov 22, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature Features or general enhancements impala The Apache Impala backend
Projects
None yet
Milestone
0.6
Development

No branches or pull requests
1 participant
@wesm