Fix a possible error while flushing the COPY data #4671
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Apparently, pqFlush can report a success status, but the underlying socket can become invalid at the same time. Check for this. In passing, also change to the proper error reporting functions that use the connection error information, where needed.
svenklemm
approved these changes
Sep 5, 2022
Codecov Report
@@ Coverage Diff @@
## main #4671 +/- ##
=======================================
Coverage 90.84% 90.84%
=======================================
Files 224 224
Lines 42273 42297 +24
=======================================
+ Hits 38403 38425 +22
- Misses 3870 3872 +2
Continue to review full report at Codecov.
|
jnidzwetzki
approved these changes
Sep 5, 2022
Merged
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
to jnidzwetzki/timescaledb
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * timescale#4454 Keep locks after reading job status * timescale#4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * timescale#4671 Fix a possible error while flushing the COPY data * timescale#4675 Fix bad TupleTableSlot drop * timescale#4676 Fix a deadlock when decompressing chunks and performing SELECTs * timescale#4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * timescale#4694 Change parameter names of cagg_migrate procedure * timescale#4698 Do not use row-by-row fetcher for parameterized plans * timescale#4711 Remove support for procedures as custom checks * timescale#4712 Fix assertion failure in constify_now * timescale#4713 Fix Continuous Aggregate migration policies * timescale#4720 Fix chunk exclusion for prepared statements and dst changes * timescale#4726 Fix gapfill function signature * timescale#4737 Fix join on time column of compressed chunk * timescale#4738 Fix error when waiting for remote COPY to finish * timescale#4739 Fix continuous aggregate migrate check constraint * timescale#4760 Fix segfault when INNER JOINing hypertables * timescale#4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
that referenced
this pull request
Oct 5, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * #4454 Keep locks after reading job status * #4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * #4671 Fix a possible error while flushing the COPY data * #4675 Fix bad TupleTableSlot drop * #4676 Fix a deadlock when decompressing chunks and performing SELECTs * #4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * #4694 Change parameter names of cagg_migrate procedure * #4698 Do not use row-by-row fetcher for parameterized plans * #4711 Remove support for procedures as custom checks * #4712 Fix assertion failure in constify_now * #4713 Fix Continuous Aggregate migration policies * #4720 Fix chunk exclusion for prepared statements and dst changes * #4726 Fix gapfill function signature * #4737 Fix join on time column of compressed chunk * #4738 Fix error when waiting for remote COPY to finish * #4739 Fix continuous aggregate migrate check constraint * #4760 Fix segfault when INNER JOINing hypertables * #4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
jnidzwetzki
added a commit
that referenced
this pull request
Oct 6, 2022
This release is a patch release. We recommend that you upgrade at the next available opportunity. **Bugfixes** * #4454 Keep locks after reading job status * #4658 Fix error when querying a compressed hypertable with compress_segmentby on an enum column * #4671 Fix a possible error while flushing the COPY data * #4675 Fix bad TupleTableSlot drop * #4676 Fix a deadlock when decompressing chunks and performing SELECTs * #4685 Fix chunk exclusion for space partitions in SELECT FOR UPDATE queries * #4694 Change parameter names of cagg_migrate procedure * #4698 Do not use row-by-row fetcher for parameterized plans * #4711 Remove support for procedures as custom checks * #4712 Fix assertion failure in constify_now * #4713 Fix Continuous Aggregate migration policies * #4720 Fix chunk exclusion for prepared statements and dst changes * #4726 Fix gapfill function signature * #4737 Fix join on time column of compressed chunk * #4738 Fix error when waiting for remote COPY to finish * #4739 Fix continuous aggregate migrate check constraint * #4760 Fix segfault when INNER JOINing hypertables * #4767 Fix permission issues on index creation for CAggs **Thanks** * @boxhock and @cocowalla for reporting a segfault when JOINing hypertables * @carobme for reporting constraint error during continuous aggregate migration * @choisnetm, @dustinsorensen, @jayadevanm and @joeyberkovitz for reporting a problem with JOINs on compressed hypertables * @daniel-k for reporting a background worker crash * @justinpryzby for reporting an error when compressing very wide tables * @maxtwardowski for reporting problems with chunk exclusion and space partitions * @yuezhihan for reporting GROUP BY error when having compress_segmentby on an enum column
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Apparently, pqFlush can report a success status, but the underlying
socket can become invalid at the same time. Check for this.
In passing, also change to the proper error reporting functions that
use the connection error information, where needed.