Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump org.questdb:questdb from 7.1.3 to 7.2 in /modules/questdb #7265

Merged

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Jul 1, 2023

Bumps org.questdb:questdb from 7.1.3 to 7.2.

Release notes

Sourced from org.questdb:questdb's releases.

7.2

Overview

In QuestDB 7.2, we address a key issue faced by our users regarding write amplification and performance under heavy loads.

Previously, QuestDB utilized fixed-size time partitions to store data in ascending chronological order. However, this approach resulted in write amplification, particularly towards the end of each time interval. To tackle this problem, we have introduced implicit variable-size time partitions in this release.

Before

image

After

image

The new feature intelligently splits partitions at strategic points, ensuring smaller partition sizes and reducing the surface area for copy-on-write operations. This minimizes write amplification and maintains high write performance, even during heavy load scenarios.

To further optimize the system, we have implemented a sophisticated statistical model to balance the split and squash logic. As a result, partitions statistically unlikely to be modified again are asynchronously squashed, reducing the number of files on disk and alleviating stress on the OS metadata catalog.

Write amplification is reduced by orders of magnitude. Users can now experience sustained write performance, even in demanding environments.

Gotchas

This is a breaking change. If you decide to downgrade from this release, partitions, created by 7.2 may not be understood by earlier versions. To proceed with the downgrade you may need to "squash" partitions on each table. To do that, run the following SQL before the downgrade:

ALTER TABLE <tab> SQUASH PARTITIONS

What is new

SQL

ILP

UI

What is fixed

... (truncated)

Commits
  • da47b26 [maven-release-plugin] prepare release 7.2
  • ebbf999 [maven-release-plugin] prepare for next development iteration
  • 17ed98d [maven-release-plugin] prepare release 7.1.4
  • be643ad chore(ui): web console version bump to 0.2.2 (#3463)
  • 601f395 fix(sql): fix disconnect on sql case statement with one condition and no else...
  • 4dde39b feat(sql): support squashing partitions using SQL (#3328)
  • 72d4762 feat(sql): add string comparison operator (#3458)
  • 4edc34d fix(sql): allow bind variables in "string IN" values list (#3448)
  • 5a682b0 fix(core): fix wal apply error (#3460)
  • f130cd1 fix(ilp): fix ILP errors when column deleted in middle of line processing (#3...
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [org.questdb:questdb](https://github.com/questdb/questdb) from 7.1.3 to 7.2.
- [Release notes](https://github.com/questdb/questdb/releases)
- [Commits](questdb/questdb@7.1.3...7.2)

---
updated-dependencies:
- dependency-name: org.questdb:questdb
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot requested a review from a team as a code owner July 1, 2023 22:20
@dependabot dependabot bot added dependencies Pull requests that update a dependency file java labels Jul 1, 2023
@github-actions github-actions bot mentioned this pull request Jul 2, 2023
@eddumelendez eddumelendez merged commit e8bf1b2 into main Jul 2, 2023
85 checks passed
@eddumelendez eddumelendez deleted the dependabot/gradle/modules/questdb/org.questdb-questdb-7.2 branch July 2, 2023 16:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file modules/questdb
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant