Skip to content

Task Executor, UCX, ORC Metadata, Progress Bar and more!

Compare
Choose a tag to compare
@wmalpica wmalpica released this 26 Feb 21:15
· 5 commits to branch-0.18 since this release

New SQL Functions

The following SQL commands are now supported:

  • REGEXP_REPLACE
  • INITCAP

New Features

  • New centralized task executor for all query execution
  • New pinned memory buffer pool for improved performance in communication
  • New host memory buffer pool for improved performance in caching data to system memory
  • Support for UCX communications which enables usage of high performance communication hardware such as using InfiniBand
  • Creating table from ORC files now collects metadata from ORC files and can perform predicate pushdown on metadata
  • Progress bar when executing queries
  • Added ability to try to retry tasks when getting out of memory errors
  • Added ability to get maximum gpu memory used

Improvements

  • Improved support for concurrent queries
  • Improvements to query execution logs
  • Added/improved communication logs
  • Added ability to disable logs
  • Improved storage plugin output messages
  • Improved support for creating tables from JSON files

Bug Fixes

  • Fixed distribution so that its evenly distributes data loading based off of rowgroups
  • Fixed cython exception handling
  • Support FileSystems (GS, S3) when extension of the files are not provided
  • Fixed issue when creating tables from a local dir relative path
  • Misc bug fixes

Codebase improvements

  • Code base clean up, improved code organization and refactoring
  • No longer depending on gtest for runtime
  • Reduced number of compilation warnings