Release notes for 405 #15058

martint · 2022-11-16T15:28:22Z

No description provided.

ebyhr · 2022-11-16T22:52:15Z

# BigQuery
* Add support for retrying to create a BigQuery read session. ({issue}`15013`)

#15013

ebyhr · 2022-11-16T23:09:58Z

# General
* Improve performance of specific queries which compare table columns of type 
  `date` with `timestamp with time zone` literals. ({issue}`5798`)

#14945

ebyhr · 2022-11-17T02:21:12Z

# Google Sheets
* Rename config properties from `credentials-path` to `gsheets.credentials-path`, 
  from `metadata-sheet-id` to `gsheets.metadata-sheet-id`, 
  from `sheets-data-max-cache-size` to `gsheets.max-data-cache-size`, 
  from `sheets-data-expire-after-write` to `gsheets.data-cache-ttl`. ({issue}`15042`)

#15042

hashhar · 2022-11-18T12:28:35Z

# PostgreSQL
* Prevent query failures when a `FULL JOIN` is pushed down to PostgreSQL connector. ({issue}`14841`)

#14841 (maybe #14929 is the better link)

ebyhr · 2022-11-19T12:46:42Z

# Delta Lake
* Improve performance and storage requirements when running the `vacuum` procedure on S3-compatible storage. ({issue}`15072`)

#15072

raunaqmorarka · 2022-11-20T17:23:11Z

# Hive, Iceberg, Delta, Hudi
* Improve performance of reading Parquet files for boolean, tinyint, short, int, long, float, double and short decimal data types. The catalog configuration property `parquet.optimized-reader.enabled` can be set to `false` to disable the optimized implementation. ({issue}`14423`)

#14423 #15308

sopel39 · 2022-11-21T13:09:49Z

General
* Improve performance and resource utilization of inserts into partitioned and bucketed tables. ({issue}`14718`)

#14718

hashhar · 2022-11-21T13:23:38Z

# BigQuery
* Fixed an issue where queries would get executed against the project id specified in the credentials
  instead of the project id specified in `bigquery.project-id` catalog property. ({issue}`14083`)

#14083 #14961

ebyhr · 2022-11-22T07:00:30Z

# Hive
* Fix failure when access denied exceptions happened during listing tables or views in a Glue. ({issue}`14746`)

#14998

huberty89 · 2022-11-22T10:35:38Z

# Security
* Check access to catalog and schema during execution of USE statement. ({issue}`14208`)

#14209

huberty89 · 2022-11-22T10:35:59Z

# Security
* Filter out values from system.metadata tables to which user has no access ({issue}`14000`)

#14197

raunaqmorarka · 2022-11-22T10:38:05Z

# Hive, Iceberg, Delta, Hudi
* Improve performance of reading parquet files for column of type UUID, time, decimal, varchar and char. ({issue}`14667`)

#14667 #15308

raunaqmorarka · 2022-11-23T19:12:23Z

# Delta
* Improve CBO estimates when the nulls fraction statistic is not available for some columns. ({issue}`15132`)

#15132

ebyhr · 2022-11-24T06:46:15Z

# Delta Lake
* Allow registering existing table files in the metastore with the new
  [`register_table` procedure](delta-lake-register-table). ({issue}`13568`)
* Deprecate creating a new table with existing table content.
  This can be enabled using the `delta.legacy-create-table-with-existing-location.enabled`
  config property or `legacy_create_table_with_existing_location_enabled` session property. ({issue}`13568`)

#14779

sopel39 · 2022-11-24T16:12:18Z

Hive:
* Improve performance for queries which write data into multiple existing partitions. ({issue}`15066`)

#15066

ebyhr · 2022-11-24T22:16:04Z

# Hive
* Store query ID when creating a new schema. ({issue}`15174`)
* Fix incorrect `schema already exists` error caused by a client timeout when
  creating a new schema. ({issue}`15174`)

#15177

ebyhr · 2022-11-24T23:55:26Z

# MongoDB
* Upgrade minimum required MongoDB version to 4.2. ({issue}`15062`)
* Add support for [fault-tolerant execution](/admin/fault-tolerant-execution). ({issue}`15062`)

#15062

findepi · 2022-11-25T13:59:29Z

Iceberg
* Fix `REFRESH MATERIALIZED VIEW` failure when the materialized view is based on non-Iceberg tables. ({issue}`13131`)

#13131 #15108

findepi · 2022-11-25T17:17:32Z

* Improve CBO estimates when the nulls fraction statistic is not available for some columns. ({issue}`15132`)

@raunaqmorarka let's phrase it in the view of end-user benefit.
e.g. is it improving query performance?

raunaqmorarka · 2022-11-25T18:22:10Z

* Improve CBO estimates when the nulls fraction statistic is not available for some columns. ({issue}`15132`)
@raunaqmorarka let's phrase it in the view of end-user benefit.
e.g. is it improving query performance?

How about
"Improve query performance when nulls fraction statistic is not available for some columns" ?

sopel39 · 2022-11-28T20:16:56Z

General:
* Fix incorrect query results where unpartitioned `WINDOW` operator is followed by partitioned
  and ordered `WINDOW` operators. {(issue)`15203`)

#15203

ebyhr · 2022-11-29T11:47:18Z

# MongoDB
* Delete a MongoDB field from collections when dropping a column. 
  Previously, the connector deleted only metadata. ({issue}`15226`)

#15227

ebyhr · 2022-11-30T13:24:26Z

# MongoDB
* Rename config properties from `mongodb.ssl.enabled` to `mongodb.tls.enabled`. ({issue}`15240`)
* Add support for setting file path and password for truststore and keystore. ({issue}`15240`)

#15240

findepi · 2022-11-30T14:02:26Z

General
* Provide an optional limit for `query_max_run_time` session property values.
  This can be set using `query.max-run-time.hard-limit` configuration property. ({issue}`15115`)

#15115

findepi · 2022-11-30T15:38:50Z

JDBC
* Return correct values in NULLABLE column of `DatabaseMetaData.getColumns` result. ({issue}`15214`)

#15214

sopel39 · 2022-11-30T18:45:31Z

# Hive, Iceberg, Delta
* Improve performance when reading Parquet files. ({issue}`15257`)

#15257

ebyhr · 2022-12-05T13:44:23Z

# MongoDB
* Fix `NullPointerException` when a column name contains uppercase characters in `query` table function. ({issue}`15294`)

#15294

ebyhr · 2022-12-06T06:06:10Z

# General
* Fix incorrect results when adding or subtracting `interval` from `timestamp with time zone` type. ({issue}`15103`)

#15290

ebyhr · 2022-12-07T07:50:02Z

# Google Sheets
* Add support for setting read timeout using the `gsheets.read-timeout` config property. ({issue}`15322`)

#15322

ebyhr · 2022-12-08T05:42:18Z

# Delta Lake
* Add support for views. ({issue}`11609`)

#11763

sopel39 · 2022-12-08T10:28:19Z

Hive:
* Improve performance for queries which write data into multiple partitions. ({issue}`15241`)

#15241

Merge with previous one with same name

sopel39 · 2022-12-08T10:30:23Z

General:
* Print Trino version in EXPLAIN and EXPLAIN ANALYZE. ({issue}`15317`)

#15317

findepi · 2022-12-09T11:14:11Z

General
* Improve query planning performance of queries with many `GROUP BY` clauses. ({issue}`15292`)

#15292

findepi · 2022-12-09T22:12:23Z

Hive, Iceberg, Delta
* Improve `DROP TABLE` performance for tables stored on AWS S3. ({issue}`13974`)

#13974

Delta
* Fix `DROP TABLE` leaving files behind for managed tables stored on S3 and created by Databricks runtime. ({issue}`13017`)

#13017

raunaqmorarka · 2022-12-12T13:41:53Z

# General
* Fix recording of `Projection CPU time` in EXPLAIN ANALYZE VERBOSE. ({issue}`15364`)

#15364

ebyhr · 2022-12-13T04:41:18Z

# Delta Lake
* Fix failure when the path contains special characters. ({issue}`15183`)

#15201

ebyhr · 2022-12-15T05:52:39Z

# General
* Allow configuring a refresh interval for DB resource group manager with the `resource-groups.refresh-interval` config property. ({issue}`14514`)

#15389

sopel39 · 2022-12-15T12:02:57Z

General
* Improve query performance for large clusters and skewed queries. ({issue}`15369`)

#15369

ebyhr · 2022-12-16T04:09:04Z

# Iceberg
* Fix incorrect results when predicates over `row` column on Parquet files are pushed into the connector. ({issue}`15408`)

#15408

sopel39 · 2022-12-16T09:43:34Z

General:
* Show task input/output size distribution in `EXPLAIN ANALYZE VERBOSE`. ({issue}`15286`)
* Display stage skewness warnings in `EXPLAIN ANALYZE`. ({issue}`15286`)

#15286

raunaqmorarka · 2022-12-17T02:48:17Z

# Hive, Delta, Iceberg, Hudi
* Improve performance of reading parquet files for timestamp and timestamp with timezone data types. ({issue}`15204`)

#15204

ebyhr · 2022-12-19T11:28:08Z

# MongoDB
* Fix potential incorrect results when `objectid` function is used more than once. ({issue}`15426`)

#15426

ebyhr · 2022-12-20T05:56:09Z

# MongoDB
* Support case insensitive name matching in `query` table function. ({issue}`15329`)

#15329

hashhar · 2022-12-21T05:55:19Z

# BigQuery
* Support using Arrow serialization when reading from BigQuery. This is an experimental feature and can be enabled by setting the catalog configuration property `bigquery.experimental.arrow-serialization.enabled` to `true`. ({issue}`14972`)

#14972

sopel39 · 2022-12-21T11:54:12Z

General:
* Improve performance of selective queries, queries that read small number of
  columns and queries that proces tables with large Parquet row groups or Orc stripes.
  Config property `node-scheduler.max-pending-splits-per-task` got renamed to
  `node-scheduler.min-pending-splits-per-task` and new config property
  `node-scheduler.max-adjusted-pending-splits-per-task` is added to control
  behavior of new optimization. ({issue}`15168`)

#15168

ebyhr · 2022-12-21T12:59:34Z

# General
* Reset to the initial time zone of the client session when executing `SET TIME ZONE LOCAL`. ({issue}`15314`)

#15341

ebyhr · 2022-12-22T00:51:30Z

# Google Sheets
* Add support for base64 encoded credentials using the `gsheets.credentials-key` config property. ({issue}`15477`)

#15477

ebyhr · 2022-12-22T07:47:36Z

# Hive
* Fix failure when reading Hive views with `char` types. ({issue}`15470`)

#15470

sopel39 · 2022-12-22T09:30:36Z

# Hive/Iceberg/Delta
* Improve resilience of insert queries. ({issue}`15476`)

#15476

ebyhr · 2022-12-23T00:56:15Z

# General
* Add support for `ALTER COLUMN ... SET DATA TYPE` statement. ({issue}`11608`)

#11608

raunaqmorarka · 2022-12-23T03:23:11Z

# Hive, Delta, Hudi, Iceberg
* Avoid large memory allocations in parquet reader by limiting the maximum size of reads from file. This improves stability and reduces peak memory requirements. The catalog configuration property `parquet.max-buffer-size` can be used to change the maximum size of reads performed by the parquet reader from the default value of 8MB. ({issue}`15374`)
* Fix query failures when reading parquet files with large row groups. ({issue}`5729`)

#15374 #5729

martint added the release-notes label Nov 16, 2022

martint added this to the 404 milestone Nov 16, 2022

martint pinned this issue Nov 16, 2022

colebow mentioned this issue Nov 21, 2022

Add Trino 405 release notes #15139

Merged

findepi mentioned this issue Dec 5, 2022

Add query.max-run-time.hard-limit #15115

Merged

sopel39 mentioned this issue Dec 28, 2022

Always use preferred partitioning for local exchanges #15459

Merged

martint closed this as completed in #15139 Dec 28, 2022

martint changed the title ~~Release notes for 404~~ Release notes for 405 Dec 30, 2022

martint unpinned this issue Dec 30, 2022

Release notes for 405 #15058

Release notes for 405 #15058

Comments

martint commented Nov 16, 2022

ebyhr commented Nov 16, 2022

ebyhr commented Nov 16, 2022

ebyhr commented Nov 17, 2022

hashhar commented Nov 18, 2022

ebyhr commented Nov 19, 2022

raunaqmorarka commented Nov 20, 2022 • edited Loading

sopel39 commented Nov 21, 2022 • edited Loading

hashhar commented Nov 21, 2022 • edited Loading

ebyhr commented Nov 22, 2022

huberty89 commented Nov 22, 2022

huberty89 commented Nov 22, 2022

raunaqmorarka commented Nov 22, 2022 • edited Loading

raunaqmorarka commented Nov 23, 2022

ebyhr commented Nov 24, 2022

sopel39 commented Nov 24, 2022 • edited Loading

ebyhr commented Nov 24, 2022

ebyhr commented Nov 24, 2022

findepi commented Nov 25, 2022

findepi commented Nov 25, 2022

raunaqmorarka commented Nov 25, 2022

sopel39 commented Nov 28, 2022

ebyhr commented Nov 29, 2022

ebyhr commented Nov 30, 2022

findepi commented Nov 30, 2022

findepi commented Nov 30, 2022

sopel39 commented Nov 30, 2022

ebyhr commented Dec 5, 2022

ebyhr commented Dec 6, 2022

ebyhr commented Dec 7, 2022

ebyhr commented Dec 8, 2022

sopel39 commented Dec 8, 2022 • edited Loading

sopel39 commented Dec 8, 2022

findepi commented Dec 9, 2022 • edited Loading

findepi commented Dec 9, 2022

raunaqmorarka commented Dec 12, 2022

ebyhr commented Dec 13, 2022

ebyhr commented Dec 15, 2022

sopel39 commented Dec 15, 2022

ebyhr commented Dec 16, 2022

sopel39 commented Dec 16, 2022

raunaqmorarka commented Dec 17, 2022

ebyhr commented Dec 19, 2022

ebyhr commented Dec 20, 2022

hashhar commented Dec 21, 2022 • edited Loading

sopel39 commented Dec 21, 2022

ebyhr commented Dec 21, 2022

ebyhr commented Dec 22, 2022

ebyhr commented Dec 22, 2022

sopel39 commented Dec 22, 2022

ebyhr commented Dec 23, 2022

raunaqmorarka commented Dec 23, 2022

raunaqmorarka commented Nov 20, 2022 •

edited

Loading

sopel39 commented Nov 21, 2022 •

edited

Loading

hashhar commented Nov 21, 2022 •

edited

Loading

raunaqmorarka commented Nov 22, 2022 •

edited

Loading

sopel39 commented Nov 24, 2022 •

edited

Loading

sopel39 commented Dec 8, 2022 •

edited

Loading

findepi commented Dec 9, 2022 •

edited

Loading

hashhar commented Dec 21, 2022 •

edited

Loading