Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Copy job config JSONB structure into current MemoryContext #5807

Merged
merged 1 commit into from Jun 26, 2023

Conversation

svenklemm
Copy link
Member

The job config jsonb can be a nested structure of elements that all need to reside in the same memory context as the other job values. To ensure this we copy the structure on assignment.

@github-actions
Copy link

@jnidzwetzki, @konskov: please review this pull request.

Powered by pull-review

@svenklemm svenklemm added this to the TimescaleDB 2.11.1 milestone Jun 22, 2023
@codecov
Copy link

codecov bot commented Jun 24, 2023

Codecov Report

Merging #5807 (a4892c0) into main (a22e732) will increase coverage by 0.04%.
The diff coverage is 98.36%.

@@            Coverage Diff             @@
##             main    #5807      +/-   ##
==========================================
+ Coverage   87.82%   87.86%   +0.04%     
==========================================
  Files         239      239              
  Lines       55646    55649       +3     
  Branches    12320    12326       +6     
==========================================
+ Hits        48872    48898      +26     
+ Misses       4906     4879      -27     
- Partials     1868     1872       +4     
Impacted Files Coverage Δ
src/chunk_constraint.c 92.38% <ø> (ø)
tsl/src/compression/api.c 93.54% <ø> (-0.13%) ⬇️
tsl/src/compression/compression.h 40.00% <ø> (ø)
src/utils.h 83.33% <88.88%> (-0.54%) ⬇️
src/bgw/job.c 91.29% <100.00%> (ø)
src/chunk.c 89.94% <100.00%> (+0.05%) ⬆️
src/hypertable.c 85.64% <100.00%> (+0.01%) ⬆️
src/hypertable_cache.c 90.10% <100.00%> (+0.22%) ⬆️
src/planner/planner.c 91.49% <100.00%> (-0.02%) ⬇️
src/process_utility.c 92.61% <100.00%> (ø)
... and 8 more

... and 10 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@svenklemm svenklemm force-pushed the job_config branch 2 times, most recently from bd3dabc to 7dd576b Compare June 26, 2023 09:34
The job config jsonb can be a nested structure of elements that
all need to reside in the same memory context as the other job
values. To ensure this we copy the structure on assignment.
@svenklemm svenklemm enabled auto-merge (rebase) June 26, 2023 10:14
@svenklemm svenklemm merged commit da20d07 into timescale:main Jun 26, 2023
45 of 48 checks passed
@jnidzwetzki jnidzwetzki added the force-auto-backport Automatically backport this PR or fix of this issue, even if it's not marked as "bug" label Jun 26, 2023
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Jun 27, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* timescale#5679 Teach loader to load OSM extension

**Bugfixes**
* timescale#5711 Scheduler accidentally getting killed when calling `delete_job`
* timescale#5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* timescale#5750 Ensure tlist is present in decompress chunk plan
* timescale#5754 Fixed handling of NULL values in bookend_sfunc
* timescale#5798 Fixed batch look ahead in compressed sorted merge
* timescale#5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* timescale#5807 Copy job config JSONB structure into current MemoryContext

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
@jnidzwetzki jnidzwetzki mentioned this pull request Jun 27, 2023
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Jun 27, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* timescale#5679 Teach loader to load OSM extension

**Bugfixes**
* timescale#5705 Scheduler accidentally getting killed when calling `delete_job`
* timescale#5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* timescale#5750 Ensure tlist is present in decompress chunk plan
* timescale#5754 Fixed handling of NULL values in bookend_sfunc
* timescale#5798 Fixed batch look ahead in compressed sorted merge
* timescale#5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* timescale#5807 Copy job config JSONB structure into current MemoryContext

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Jun 27, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* timescale#5679 Teach loader to load OSM extension

**Bugfixes**
* timescale#5705 Scheduler accidentally getting killed when calling `delete_job`
* timescale#5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* timescale#5750 Ensure tlist is present in decompress chunk plan
* timescale#5754 Fixed handling of NULL values in bookend_sfunc
* timescale#5798 Fixed batch look ahead in compressed sorted merge
* timescale#5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* timescale#5807 Copy job config JSONB structure into current MemoryContext

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Jun 28, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* timescale#5679 Teach loader to load OSM extension

**Bugfixes**
* timescale#5705 Scheduler accidentally getting killed when calling `delete_job`
* timescale#5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* timescale#5750 Ensure tlist is present in decompress chunk plan
* timescale#5754 Fixed handling of NULL values in bookend_sfunc
* timescale#5798 Fixed batch look ahead in compressed sorted merge
* timescale#5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* timescale#5807 Copy job config JSONB structure into current MemoryContext
* timescale#5824 Improve continuous aggregate query chunk exclusion

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
jnidzwetzki added a commit that referenced this pull request Jun 28, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* #5679 Teach loader to load OSM extension

**Bugfixes**
* #5705 Scheduler accidentally getting killed when calling `delete_job`
* #5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* #5750 Ensure tlist is present in decompress chunk plan
* #5754 Fixed handling of NULL values in bookend_sfunc
* #5798 Fixed batch look ahead in compressed sorted merge
* #5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* #5807 Copy job config JSONB structure into current MemoryContext
* #5824 Improve continuous aggregate query chunk exclusion

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
jnidzwetzki added a commit to jnidzwetzki/timescaledb that referenced this pull request Jun 28, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* timescale#5679 Teach loader to load OSM extension

**Bugfixes**
* timescale#5705 Scheduler accidentally getting killed when calling `delete_job`
* timescale#5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* timescale#5750 Ensure tlist is present in decompress chunk plan
* timescale#5754 Fixed handling of NULL values in bookend_sfunc
* timescale#5798 Fixed batch look ahead in compressed sorted merge
* timescale#5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* timescale#5807 Copy job config JSONB structure into current MemoryContext
* timescale#5824 Improve continuous aggregate query chunk exclusion

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
jnidzwetzki added a commit that referenced this pull request Jun 28, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* #5679 Teach loader to load OSM extension

**Bugfixes**
* #5705 Scheduler accidentally getting killed when calling `delete_job`
* #5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* #5750 Ensure tlist is present in decompress chunk plan
* #5754 Fixed handling of NULL values in bookend_sfunc
* #5798 Fixed batch look ahead in compressed sorted merge
* #5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* #5807 Copy job config JSONB structure into current MemoryContext
* #5824 Improve continuous aggregate query chunk exclusion

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
jnidzwetzki added a commit that referenced this pull request Jun 28, 2023
This release contains bug fixes since the 2.11.0 release. We recommend
that you upgrade at the next available opportunity.

**Features**
* #5679 Teach loader to load OSM extension

**Bugfixes**
* #5705 Scheduler accidentally getting killed when calling `delete_job`
* #5742 Fix Result node handling with ConstraintAwareAppend on
  compressed chunks
* #5750 Ensure tlist is present in decompress chunk plan
* #5754 Fixed handling of NULL values in bookend_sfunc
* #5798 Fixed batch look ahead in compressed sorted merge
* #5804 Mark cagg_watermark function as PARALLEL RESTRICTED
* #5807 Copy job config JSONB structure into current MemoryContext
* #5824 Improve continuous aggregate query chunk exclusion

**Thanks**
* @JamieD9 for reporting an issue with a wrong result ordering
* @xvaara for reporting an issue with Result node handling in
  ConstraintAwareAppend
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backported-2.11.x force-auto-backport Automatically backport this PR or fix of this issue, even if it's not marked as "bug"
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants