Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce additional db for data node bootstrapping #2707

Conversation

niksajakovljevic
Copy link
Contributor

We now try connecting to three databases before giving up:
postgres, template1 and defaultdb.

@niksajakovljevic niksajakovljevic requested a review from a team as a code owner December 2, 2020 15:39
@niksajakovljevic niksajakovljevic requested review from pmwkaa, mkindahl and k-rus and removed request for a team December 2, 2020 15:39
tsl/src/data_node.c Outdated Show resolved Hide resolved
if (conn)
return conn;
}
return conn;
Copy link
Contributor

@pmwkaa pmwkaa Dec 2, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: maybe just return NULL here and possible to move TSConnection *conn to the loop block in such case

@niksajakovljevic niksajakovljevic changed the title Itroduce additional db for data node bootstrapping Introduce additional db for data node bootstrapping Dec 2, 2020
Copy link
Contributor

@erimatnor erimatnor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fix commit title and use lengthof for array.

We now try connecting to three databases before giving up:
postgres, template1 and defaultdb.
@codecov
Copy link

codecov bot commented Dec 2, 2020

Codecov Report

Merging #2707 (2e46e99) into master (c311b44) will increase coverage by 0.17%.
The diff coverage is 94.01%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2707      +/-   ##
==========================================
+ Coverage   90.02%   90.19%   +0.17%     
==========================================
  Files         212      212              
  Lines       34506    34564      +58     
==========================================
+ Hits        31065    31176     +111     
+ Misses       3441     3388      -53     
Impacted Files Coverage Δ
src/bgw/job.c 91.44% <ø> (-0.89%) ⬇️
src/catalog.h 100.00% <ø> (ø)
src/cross_module_fn.c 68.54% <0.00%> (-0.56%) ⬇️
tsl/src/data_node.c 96.23% <87.50%> (+0.20%) ⬆️
tsl/src/remote/dist_copy.c 89.92% <88.23%> (-1.45%) ⬇️
src/hypertable.c 87.61% <95.45%> (+0.15%) ⬆️
tsl/src/bgw_policy/job_api.c 96.17% <96.87%> (+1.38%) ⬆️
src/chunk.c 95.51% <100.00%> (ø)
src/copy.c 87.91% <100.00%> (+0.05%) ⬆️
src/process_utility.c 93.85% <100.00%> (ø)
... and 12 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2ecb53e...2e46e99. Read the comment docs.

@niksajakovljevic niksajakovljevic merged commit 7f3feb8 into timescale:master Dec 2, 2020
@mkindahl mkindahl mentioned this pull request Dec 2, 2020
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 2, 2020
**Minor Features**
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, and contains improvements to
compression for distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* #2689 Check configuration in alter_job and add_job
* #2696 Support gapfill on distributed hypertable
* #2468 Show more information in get_git_commit
* #2678 Include user actions into job stats view
* #2664 Fix support for complex aggregate expression
* #2672 Add hypertable to continuous aggregates view
* #2662 Save compression metadata settings on access node
* #2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* #2688 Fix crash for concurrent drop and compress chunk
* #2666 Fix timeout handling in async library
* #2683 Fix crash in add_job when given NULL interval
* #2698 Improve memory handling for remote COPY
* #2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit to mkindahl/timescaledb that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* timescale#2689 Check configuration in alter_job and add_job
* timescale#2696 Support gapfill on distributed hypertable
* timescale#2468 Show more information in get_git_commit
* timescale#2678 Include user actions into job stats view
* timescale#2664 Fix support for complex aggregate expression
* timescale#2672 Add hypertable to continuous aggregates view
* timescale#2662 Save compression metadata settings on access node
* timescale#2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* timescale#2688 Fix crash for concurrent drop and compress chunk
* timescale#2666 Fix timeout handling in async library
* timescale#2683 Fix crash in add_job when given NULL interval
* timescale#2698 Improve memory handling for remote COPY
* timescale#2555 Set metadata for chunks compressed before 2.0
mkindahl added a commit that referenced this pull request Dec 3, 2020
This release candidate contains bugfixes since the previous release
candidate, as well as additional minor features. It improves
validation of configuration changes for background jobs, adds support
for gapfill on distributed tables, contains improvements to the memory
handling for large COPY, and contains improvements to compression for
distributed hypertables.

**Minor Features**
* #2689 Check configuration in alter_job and add_job
* #2696 Support gapfill on distributed hypertable
* #2468 Show more information in get_git_commit
* #2678 Include user actions into job stats view
* #2664 Fix support for complex aggregate expression
* #2672 Add hypertable to continuous aggregates view
* #2662 Save compression metadata settings on access node
* #2707 Introduce additional db for data node bootstrapping

**Bugfixes**
* #2688 Fix crash for concurrent drop and compress chunk
* #2666 Fix timeout handling in async library
* #2683 Fix crash in add_job when given NULL interval
* #2698 Improve memory handling for remote COPY
* #2555 Set metadata for chunks compressed before 2.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants