BUG: fix faulty AST -> Select compilation with self-joined filtered t…
…ables Fixes #667 and #668. Technical debt here will need to be addressed in the future Author: Wes McKinney <wes@cloudera.com> Closes #670 from wesm/bug/self-join-analysis-bug and squashes the following commits: d9da6b2 [Wes McKinney] Hack around projection substitution bug. Tests passing again 4d2897b [Wes McKinney] More projection-filter fuse test to sql compiler tests a2a23f2 [Wes McKinney] More expr analysis work. Fix expr formatting memoization of filtered tables per #668 192fce5 [Wes McKinney] Start trying to fix self-join analysis bug
DOC: first draft of "Ibis for SQL Programmers"
Author: Wes McKinney <wes@cloudera.com> Closes #679 from wesm/docs/ibis-for-sql and squashes the following commits: 27e5a15 [Wes McKinney] Some timestamp info f7b0813 [Wes McKinney] Unions 9c49637 [Wes McKinney] Finish subqueries. Add window function overview and topk b5f7465 [Wes McKinney] Not exists example 8544211 [Wes McKinney] Basic EXISTS example 7125d7f [Wes McKinney] More on join predicates 4a152c7 [Wes McKinney] Self joins c98d0a3 [Wes McKinney] Several join examples 5c6a8c8 [Wes McKinney] Join preface bbf362d [Wes McKinney] Constants and is null / is not null 39ed1d6 [Wes McKinney] Case statements and NULL a442157 [Wes McKinney] IN/not in and between 166a5fa [Wes McKinney] Aggregate with subsets. Limit, sort a51eac2 [Wes McKinney] Write more of ibis-for-sql section e494adb [Wes McKinney] Add outline for 'Ibis for SQL developers'
ENH: can specify join on overlapping column name with a string or lis…
…t of strings. Close #686
BUG: do not drop filters in exists subqueries
Close #681 Author: Wes McKinney <wes@cloudera.com> Closes #694 from wesm/bug/filters-in-exists-subquery and squashes the following commits: f1eb2fa [Wes McKinney] Fix correlated reference analysis inside exists/not-exists subqueries f66e122 [Wes McKinney] Progress on handling filters in any-to-exists, but alias missing
ENH: add various Impala DDL wrapper functions
INVALIDATE METADATA, REFRESH, SHOW FILES IN, DESCRIBE FORMATTED. Also added support for COMPUTE INCREMENTAL STATS in existing function with `incremental=True`. Close #713, #710, #709, #708. Author: Wes McKinney <wes@cloudera.com> Closes #714 from wesm/feature/more-ddl and squashes the following commits: 5a1c635 [Wes McKinney] Add SHOW FILES client-level and table-level function d7ee318 [Wes McKinney] Add REFRESH, DESCRIBE FORMATTED, and more for INVALIDATE METADATA e4ab21a [Wes McKinney] Add mock patch tests for invalidate metadata 5741d2a [Wes McKinney] Add compute_stats method to ImpalaClient and add incremental option
ENH: More rigorous pandas integration in create_table / insert
Closes #197 You can now use pandas DataFrame in many cases in `Client.create_table` and `Client.insert`. Note that this PR requires upstream Impyla. Author: Wes McKinney <wes@cloudera.com> Closes #707 from wesm/feature/pandas-insert and squashes the following commits: 8320caa [Wes McKinney] Adopt modified impyla columnar API d8b007d [Wes McKinney] Fix pandas data round trip through impyla columnar HS2 fetching 843e0df [Wes McKinney] Clean up exhaustive test case 08405a8 [Wes McKinney] Make insert work with DataFrame. Embedded new lines are still a problem 9c6f210 [Wes McKinney] Add tests to fix escaping, quoting, and null representation 9358daf [Wes McKinney] Ensure DataFrameWriter.cleanup is a noop 41ef48e [Wes McKinney] Can pass a DataFrame to ImpalaClient.create_table a2aa243 [Wes McKinney] Add iverbose option to help debugging 90b5027 [Wes McKinney] Slightly refactor pandas dataframe write path
BLD: Conda recipe to pull from trunk
Updated conda recipes so that they can be used to build conda packages for the current state of the repo rather than rely on build from pypi Author: mariusvniekerk <marius.v.niekerk@gmail.com> Closes #712 from mariusvniekerk/conda_recipe and squashes the following commits: 934ccf0 [mariusvniekerk] Conda recipe update 6c8faec [mariusvniekerk] Conda recipe update
ENH: Support for inserting into partitioned tables
Support for static partitioning. Close #489 Author: Wes McKinney <wes@cloudera.com> Closes #721 from wesm/feature/partition-support and squashes the following commits: 1931701 [Wes McKinney] Insert with static partition keys 0f9bf5d [Wes McKinney] More partition scaffolding 684a4d4 [Wes McKinney] Unit test stubs
REF: Incorporate type conversion option and other impyla refactoring
requires cloudera/impyla#153 Author: Wes McKinney <wes@cloudera.com> Closes #724 from wesm/refactor/impyla-refactor and squashes the following commits: 688ff0c [Wes McKinney] Bump impyla required version b09545d [Wes McKinney] Conform to impyla upstream changes a302da8 [Wes McKinney] Add convert_types option per cloudera/impyla#151 5cf35bc [Wes McKinney] REF: update for refactored impyla
ENH: implement a replace-values API that accepts dicts
Also renamed StringValue.replace to str_replace. Closes #259.
ENH: Partition metadata management APIs and ALTER TABLE support for t…
…able props See #335, #490, #702, #738 Author: Wes McKinney <wes@cloudera.com> Closes #739 from wesm/feature/impala-load-data and squashes the following commits: 12bf165 [Wes McKinney] Implement/test alter table properties for unpartitioned tables ba0eccd [Wes McKinney] Parse storage parameters too ce605b2 [Wes McKinney] More metadata parsing code 0c13ecc [Wes McKinney] Incomplete describe formatted parser b24facb [Wes McKinney] Add stub for DESCRIBE FORMATTED metadata parser 4d2dc2d [Wes McKinney] Test stubs 7760eab [Wes McKinney] DDL tests / cleanup for alter table and alter partition 22e9560 [Wes McKinney] Implement add and modify partition, get load_data test running 244a0be [Wes McKinney] Add partition with properties 3860ed3 [Wes McKinney] Move table properties to AlterTable top level DDL fd688a6 [Wes McKinney] Alter table properties d541a2a [Wes McKinney] Add API and DDL stubs for add/modify/drop partition functions fd2dd16 [Wes McKinney] Initial non-working load data test ebeb86a [Wes McKinney] Slight refactoring to move more code into ImpalaTable class e89bab9 [Wes McKinney] Add initial DDL generator for LOAD DATA
ENH: Add set/get_options methods to ImpalaClient and set_compression_…
…codec option. Close #733
