From 2f2031a0c6f96977a3657ff5e5fa8575a854bef5 Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 12:06:23 +0800 Subject: [PATCH 1/9] releases, toc: add 3.1 GA release notes --- TOC.md | 1 + releases/3.1.0-ga.md | 91 ++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 92 insertions(+) create mode 100644 releases/3.1.0-ga.md diff --git a/TOC.md b/TOC.md index 7c5e92ca34de7..f758552daec13 100644 --- a/TOC.md +++ b/TOC.md @@ -394,6 +394,7 @@ - [4.0.0-beta.1](/releases/4.0.0-beta.1.md) - [4.0.0-beta](/releases/4.0.0-beta.md) + v3.1 + - [3.1.0-GA](/releases/3.1.0-ga.md) - [3.1.0-rc](/releases/3.1.0-rc.md) - [3.1.0-beta.2](/releases/3.1.0-beta.2.md) - [3.1.0-beta.1](/releases/3.1.0-beta.1.md) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md new file mode 100644 index 0000000000000..2b21f77d53bfe --- /dev/null +++ b/releases/3.1.0-ga.md @@ -0,0 +1,91 @@ +--- +title: TiDB 3.1.0 GA Release Notes +category: Releases +--- + +# TiDB 3.1.0 GA Release Notes + +Release date: April 16, 2020 + +TiDB version: 3.1.0 GA + +TiDB Ansible version: 3.1.0 GA + +## Compatibility Changes + ++ TiDB + + - Support directly stopping the start of TiDB if the HTTP listening port is unavailable, when the `report-status` configuration item is enabled [#16291](https://github.com/pingcap/tidb/pull/16291) + ++ Tools + + - Backup & Restore (BR) + + * BR of the 3.1 GA version does not support restoring data from the TiKV cluster earlier than 3.1 GA [#233](https://github.com/pingcap/br/pull/233) + +## New Features + ++ TiDB + + - Support displaying the information of Coprocessor tasks in `explain format = “dot”`[#16125](https://github.com/pingcap/tidb/pull/16125) + - Reduce the redundant stack information of log using the `disable-error-stack` configuration item [#16182](https://github.com/pingcap/tidb/pull/16182) + ++ Placement Driver (PD) + + - Optimize the hot Region scheduling [#2342](https://github.com/pingcap/pd/pull/2342) + ++ TiFlash + + - Add the metrics report related to the read and write workload of DeltaTree engine + - Support pushing down the `fromUnixTime` and `dateFormat` functions + ++ TiDB Ansible + + - Add TiFlash monitor [#1253](https://github.com/pingcap/tidb-ansible/pull/1253) [#1257](https://github.com/pingcap/tidb-ansible/pull/1257) + - Optimize the configuration parameters of TiFlash [#1262](https://github.com/pingcap/tidb-ansible/pull/1262) [#1265](https://github.com/pingcap/tidb-ansible/pull/1265) [#1271](https://github.com/pingcap/tidb-ansible/pull/1271) + - Optimize the TiDB starting script [#1268](https://github.com/pingcap/tidb-ansible/pull/1268) + +## Bug Fixes + ++ TiDB + + - Fix the panic issue caused by the merge join operation in some scenarios [#15920](https://github.com/pingcap/tidb/pull/15920) + - Fix the issue that some expressions are repeatedly calculated in selectivity [#16052](https://github.com/pingcap/tidb/pull/16052) + - Fix the panic issue when the statistics information is loaded in extreme cases [#15710](https://github.com/pingcap/tidb/pull/15710) + - Fix the issue that an error is returned in some cases when equivalent expressions cannot be recognized in SQL query [#16015](https://github.com/pingcap/tidb/pull/16015) + - Fix the issue that an error is returned when users query the view of one database from another database [#15867](https://github.com/pingcap/tidb/pull/15867) + - Fix the panic issue that occurs when the column is handled using `fast analyze` [#16080](https://github.com/pingcap/tidb/pull/16080) + - Fix the incorrect character set of the `current_role` print result [#16084](https://github.com/pingcap/tidb/pull/16084) + - Refine the log of MySQL connection handshake error [#15799](https://github.com/pingcap/tidb/pull/15799) + - Fix the panic issue caused by port probing after the audit plugin is loaded [#16065](https://github.com/pingcap/tidb/pull/16065) + - Fix the panic issue of the sort operator on left join because the TypeNull class is mistaken as a variable-length type [#15739](https://github.com/pingcap/tidb/pull/15739) + - Fix the issue of inaccurate count of monitoring session retry errors [#16120](https://github.com/pingcap/tidb/pull/16120) + - Fix the issue of wrong results of `weekday` in the `ALLOW_INVALID_DATES` mode [#16171](https://github.com/pingcap/tidb/pull/16171) + - Fix the issue that garbage collection (GC) might not work normally when the cluster has TiFlash nodes [#15761](https://github.com/pingcap/tidb/pull/15761) + - Fix the issue that TiDB goes out of memory (OOM) when users set a large partition count when creating the hash partition table [#16219](https://github.com/pingcap/tidb/pull/16219) + - Fix the issue that warnings are mistaken as errors, and make the `UNION` statement have the same behavior as the `SELECT` statement [#16138](https://github.com/pingcap/tidb/pull/16138) + - Fix the execution error when TopN is pushed down to mocktikv [#16200](https://github.com/pingcap/tidb/pull/16200) + - Increase the initial length of `chunk.column.nullBitMap` to avoid unnecessary cost of `runtime.growslice` [#16142](https://github.com/pingcap/tidb/pull/16142) + ++ TiKV + + - Fix the panic issue caused by replica read [#7418](https://github.com/tikv/tikv/pull/7418) [#7369](https://github.com/tikv/tikv/pull/7369) + - Fix the issue that the restoration process creates empty regions [#7419](https://github.com/tikv/tikv/pull/7419) + - Fix the issue that repeated resolve lock requests might harm the atomicity of pessimistic transactions [#7389](https://github.com/tikv/tikv/pull/7389) + ++ TiFlash + + - Fix the potential problem of the `rename table` operation when replicating schema from TiDB + - Disable the coarse-grained index filter by default + - Fix the issue of data loss caused by the `rename table` operation under multiple data path configurations + - Fix the issue that TiFlash reports incorrect storage space in some scenarios + - Fix the potential problem caused by reading from TiFlash when region merge is enabled + ++ Tools + + - TiDB Binlog + + * Fix the issue that TiFlash-related DDL jobs might interrupt the replication of Drainer [#948](https://github.com/pingcap/tidb-binlog/pull/948) [#942](https://github.com/pingcap/tidb-binlog/pull/942) + - BR + * Fix the issue that the `checksum` operation is still executed when it is disabled [#223](https://github.com/pingcap/br/pull/223) + * Fix the issue that incremental backup fails when TiDB enables `auto-random` or `alter-pk` [#230](https://github.com/pingcap/br/pull/230) [#231](https://github.com/pingcap/br/pull/231) From 5c766e35f3d8c253bce06f43fc05f6a1c606fc6e Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 13:36:56 +0800 Subject: [PATCH 2/9] Apply suggestions from code review Co-Authored-By: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/3.1.0-ga.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index 2b21f77d53bfe..96bd397f5ac83 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -15,7 +15,7 @@ TiDB Ansible version: 3.1.0 GA + TiDB - - Support directly stopping the start of TiDB if the HTTP listening port is unavailable, when the `report-status` configuration item is enabled [#16291](https://github.com/pingcap/tidb/pull/16291) + - Support directly stopping starting TiDB if the HTTP listening port is unavailable when the `report-status` configuration item is enabled [#16291](https://github.com/pingcap/tidb/pull/16291) + Tools From 1b39161264db6af6b4b8d439919f70ddb7d1d3c3 Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 14:13:40 +0800 Subject: [PATCH 3/9] Apply suggestions from code review Co-Authored-By: TomShawn <41534398+TomShawn@users.noreply.github.com> --- TOC.md | 2 +- releases/3.1.0-ga.md | 26 +++++++++++++------------- 2 files changed, 14 insertions(+), 14 deletions(-) diff --git a/TOC.md b/TOC.md index f758552daec13..a4f4eaca54ddf 100644 --- a/TOC.md +++ b/TOC.md @@ -394,7 +394,7 @@ - [4.0.0-beta.1](/releases/4.0.0-beta.1.md) - [4.0.0-beta](/releases/4.0.0-beta.md) + v3.1 - - [3.1.0-GA](/releases/3.1.0-ga.md) + - [3.1.0 GA](/releases/3.1.0-ga.md) - [3.1.0-rc](/releases/3.1.0-rc.md) - [3.1.0-beta.2](/releases/3.1.0-beta.2.md) - [3.1.0-beta.1](/releases/3.1.0-beta.1.md) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index 96bd397f5ac83..e0cba3d80c038 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -27,7 +27,7 @@ TiDB Ansible version: 3.1.0 GA + TiDB - - Support displaying the information of Coprocessor tasks in `explain format = “dot”`[#16125](https://github.com/pingcap/tidb/pull/16125) + - Support displaying the information of Coprocessor tasks in `explain format = "dot"` [#16125](https://github.com/pingcap/tidb/pull/16125) - Reduce the redundant stack information of log using the `disable-error-stack` configuration item [#16182](https://github.com/pingcap/tidb/pull/16182) + Placement Driver (PD) @@ -36,7 +36,7 @@ TiDB Ansible version: 3.1.0 GA + TiFlash - - Add the metrics report related to the read and write workload of DeltaTree engine + - Add the metrics report related to the read and write workloads of DeltaTree engine - Support pushing down the `fromUnixTime` and `dateFormat` functions + TiDB Ansible @@ -51,35 +51,35 @@ TiDB Ansible version: 3.1.0 GA - Fix the panic issue caused by the merge join operation in some scenarios [#15920](https://github.com/pingcap/tidb/pull/15920) - Fix the issue that some expressions are repeatedly calculated in selectivity [#16052](https://github.com/pingcap/tidb/pull/16052) - - Fix the panic issue when the statistics information is loaded in extreme cases [#15710](https://github.com/pingcap/tidb/pull/15710) + - Fix the panic issue occurred when loading the statistics information in extreme cases [#15710](https://github.com/pingcap/tidb/pull/15710) - Fix the issue that an error is returned in some cases when equivalent expressions cannot be recognized in SQL query [#16015](https://github.com/pingcap/tidb/pull/16015) - - Fix the issue that an error is returned when users query the view of one database from another database [#15867](https://github.com/pingcap/tidb/pull/15867) + - Fix the issue that an error is returned when querying the `view` of one database from another database [#15867](https://github.com/pingcap/tidb/pull/15867) - Fix the panic issue that occurs when the column is handled using `fast analyze` [#16080](https://github.com/pingcap/tidb/pull/16080) - Fix the incorrect character set of the `current_role` print result [#16084](https://github.com/pingcap/tidb/pull/16084) - Refine the log of MySQL connection handshake error [#15799](https://github.com/pingcap/tidb/pull/15799) - Fix the panic issue caused by port probing after the audit plugin is loaded [#16065](https://github.com/pingcap/tidb/pull/16065) - - Fix the panic issue of the sort operator on left join because the TypeNull class is mistaken as a variable-length type [#15739](https://github.com/pingcap/tidb/pull/15739) + - Fix the panic issue of the `sort` operator on left join because the `TypeNull` class is mistaken as a variable-length type [#15739](https://github.com/pingcap/tidb/pull/15739) - Fix the issue of inaccurate count of monitoring session retry errors [#16120](https://github.com/pingcap/tidb/pull/16120) - Fix the issue of wrong results of `weekday` in the `ALLOW_INVALID_DATES` mode [#16171](https://github.com/pingcap/tidb/pull/16171) - - Fix the issue that garbage collection (GC) might not work normally when the cluster has TiFlash nodes [#15761](https://github.com/pingcap/tidb/pull/15761) - - Fix the issue that TiDB goes out of memory (OOM) when users set a large partition count when creating the hash partition table [#16219](https://github.com/pingcap/tidb/pull/16219) + - Fix the issue that Garbage Collection (GC) might not work normally when the cluster has TiFlash nodes [#15761](https://github.com/pingcap/tidb/pull/15761) + - Fix the issue that TiDB goes out of memory (OOM) when users set a large partition count when creating the hash partitioned table [#16219](https://github.com/pingcap/tidb/pull/16219) - Fix the issue that warnings are mistaken as errors, and make the `UNION` statement have the same behavior as the `SELECT` statement [#16138](https://github.com/pingcap/tidb/pull/16138) - - Fix the execution error when TopN is pushed down to mocktikv [#16200](https://github.com/pingcap/tidb/pull/16200) - - Increase the initial length of `chunk.column.nullBitMap` to avoid unnecessary cost of `runtime.growslice` [#16142](https://github.com/pingcap/tidb/pull/16142) + - Fix the execution error when `TopN` is pushed down to mocktikv [#16200](https://github.com/pingcap/tidb/pull/16200) + - Increase the initial length of `chunk.column.nullBitMap` to avoid unnecessary overhead of `runtime.growslice` [#16142](https://github.com/pingcap/tidb/pull/16142) + TiKV - Fix the panic issue caused by replica read [#7418](https://github.com/tikv/tikv/pull/7418) [#7369](https://github.com/tikv/tikv/pull/7369) - - Fix the issue that the restoration process creates empty regions [#7419](https://github.com/tikv/tikv/pull/7419) + - Fix the issue that the restoration process creates empty Regions [#7419](https://github.com/tikv/tikv/pull/7419) - Fix the issue that repeated resolve lock requests might harm the atomicity of pessimistic transactions [#7389](https://github.com/tikv/tikv/pull/7389) + TiFlash - - Fix the potential problem of the `rename table` operation when replicating schema from TiDB + - Fix the potential issue of the `rename table` operation when replicating schema from TiDB - Disable the coarse-grained index filter by default - Fix the issue of data loss caused by the `rename table` operation under multiple data path configurations - - Fix the issue that TiFlash reports incorrect storage space in some scenarios - - Fix the potential problem caused by reading from TiFlash when region merge is enabled + - Fix the issue that TiFlash reports incorrect storage space in some scenarios + - Fix the potential issue caused by reading from TiFlash when Region Merge is enabled + Tools From f7983d8512d43bdb35ab8a43fef85bf74f7f079b Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 14:16:54 +0800 Subject: [PATCH 4/9] Update releases/3.1.0-ga.md Co-Authored-By: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/3.1.0-ga.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index e0cba3d80c038..f4ed6967eda99 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -50,7 +50,7 @@ TiDB Ansible version: 3.1.0 GA + TiDB - Fix the panic issue caused by the merge join operation in some scenarios [#15920](https://github.com/pingcap/tidb/pull/15920) - - Fix the issue that some expressions are repeatedly calculated in selectivity [#16052](https://github.com/pingcap/tidb/pull/16052) + - Fix the issue that some expressions are repeatedly counted in selectivity calculation [#16052](https://github.com/pingcap/tidb/pull/16052) - Fix the panic issue occurred when loading the statistics information in extreme cases [#15710](https://github.com/pingcap/tidb/pull/15710) - Fix the issue that an error is returned in some cases when equivalent expressions cannot be recognized in SQL query [#16015](https://github.com/pingcap/tidb/pull/16015) - Fix the issue that an error is returned when querying the `view` of one database from another database [#15867](https://github.com/pingcap/tidb/pull/15867) From bcbf2c1b158aa746515e85cb79a751b95de93b7a Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 14:21:07 +0800 Subject: [PATCH 5/9] Update rn.md --- releases/rn.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/rn.md b/releases/rn.md index ad1bc78ef3af7..15afd9ed901b7 100644 --- a/releases/rn.md +++ b/releases/rn.md @@ -14,6 +14,7 @@ category: release ## 3.1 +- [3.1.0 GA](/releases/3.1.0-ga.md) - [3.1.0-rc](/releases/3.1.0-rc.md) - [3.1.0-beta.2](/releases/3.1.0-beta.2.md) - [3.1.0-beta.1](/releases/3.1.0-beta.1.md) From aeceaf24e0c3f648681a43b49d4388b4a0e4c385 Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 16:23:54 +0800 Subject: [PATCH 6/9] update to align with the Chinese version --- releases/3.1.0-ga.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index f4ed6967eda99..200270c435d79 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -21,7 +21,7 @@ TiDB Ansible version: 3.1.0 GA - Backup & Restore (BR) - * BR of the 3.1 GA version does not support restoring data from the TiKV cluster earlier than 3.1 GA [#233](https://github.com/pingcap/br/pull/233) + * BR does not support restoring data from the TiKV cluster earlier than 3.1 GA [#233](https://github.com/pingcap/br/pull/233) ## New Features @@ -38,6 +38,7 @@ TiDB Ansible version: 3.1.0 GA - Add the metrics report related to the read and write workloads of DeltaTree engine - Support pushing down the `fromUnixTime` and `dateFormat` functions + - Disable the coarse-grained index filter by default + TiDB Ansible @@ -76,7 +77,6 @@ TiDB Ansible version: 3.1.0 GA + TiFlash - Fix the potential issue of the `rename table` operation when replicating schema from TiDB - - Disable the coarse-grained index filter by default - Fix the issue of data loss caused by the `rename table` operation under multiple data path configurations - Fix the issue that TiFlash reports incorrect storage space in some scenarios - Fix the potential issue caused by reading from TiFlash when Region Merge is enabled From bf8378e0c8a119d954b301142ffde88471a632fd Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 16 Apr 2020 16:28:17 +0800 Subject: [PATCH 7/9] Update a term --- releases/3.1.0-ga.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index 200270c435d79..43c5c70ae4e4c 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -38,7 +38,7 @@ TiDB Ansible version: 3.1.0 GA - Add the metrics report related to the read and write workloads of DeltaTree engine - Support pushing down the `fromUnixTime` and `dateFormat` functions - - Disable the coarse-grained index filter by default + - Disable the rough set filter by default + TiDB Ansible From 134740d69f21ebed5739d6a599702fc49b51ff5b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 16 Apr 2020 19:43:16 +0800 Subject: [PATCH 8/9] Update releases/3.1.0-ga.md Co-Authored-By: Lilian Lee --- releases/3.1.0-ga.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index 43c5c70ae4e4c..643d73f5a79bc 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -86,6 +86,8 @@ TiDB Ansible version: 3.1.0 GA - TiDB Binlog * Fix the issue that TiFlash-related DDL jobs might interrupt the replication of Drainer [#948](https://github.com/pingcap/tidb-binlog/pull/948) [#942](https://github.com/pingcap/tidb-binlog/pull/942) + - BR + * Fix the issue that the `checksum` operation is still executed when it is disabled [#223](https://github.com/pingcap/br/pull/223) * Fix the issue that incremental backup fails when TiDB enables `auto-random` or `alter-pk` [#230](https://github.com/pingcap/br/pull/230) [#231](https://github.com/pingcap/br/pull/231) From 2288ef77660238a4410afda63db29ae46f760499 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 16 Apr 2020 19:59:45 +0800 Subject: [PATCH 9/9] trigger CI --- releases/3.1.0-ga.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/3.1.0-ga.md b/releases/3.1.0-ga.md index 643d73f5a79bc..ffce3c9e4b197 100644 --- a/releases/3.1.0-ga.md +++ b/releases/3.1.0-ga.md @@ -76,7 +76,7 @@ TiDB Ansible version: 3.1.0 GA + TiFlash - - Fix the potential issue of the `rename table` operation when replicating schema from TiDB + - Fix the potential issue of the `rename table` operation when replicating the schema from TiDB - Fix the issue of data loss caused by the `rename table` operation under multiple data path configurations - Fix the issue that TiFlash reports incorrect storage space in some scenarios - Fix the potential issue caused by reading from TiFlash when Region Merge is enabled