Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: prevent Dispatch fiber to be launched during migration #3123

Merged
merged 4 commits into from
Jun 4, 2024
Merged

Conversation

romange
Copy link
Collaborator

@romange romange commented Jun 4, 2024

No description provided.

@romange romange requested a review from adiholden June 4, 2024 07:43
@romange romange changed the title chore: prevent Dispatch fiber to be launched during the connection mi… chore: prevent Dispatch fiber to be launched during migration Jun 4, 2024
@@ -1530,7 +1532,7 @@ void Connection::SendInvalidationMessageAsync(InvalidationMessage msg) {
}

void Connection::LaunchDispatchFiberIfNeeded() {
if (!dispatch_fb_.IsJoinable()) {
if (!dispatch_fb_.IsJoinable() && !migration_in_process_) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should break SendAsync

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in what sense?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What I had in mind is that because we don't wake the dispatch fiber it would miss the evc.notify and when the fiber was launched again it would not consume the items that were pushed back on the dispatch queue. I am wrong, I double checked the flow and we guard against this case in the dispatch fiber's main loop:

  1340     evc_.await(
  1341         [this] { return cc_->conn_closing || (!dispatch_q_.empty() && !cc_->sync_dispatch); });
  1342     if (cc_->conn_closing)                                                                        
  1343       break;

Also a corner case that came into my mind, if after a migration the connection for some reason is closing are there any cases where we need to drain the dispatch queue ?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ClearPipelinedMessages is called at the end and it drains the queue

@adiholden
Copy link
Collaborator

We still fail in replication_test.py::test_replicaof_reject_on_load
I20240604 12:10:57.323175 2092379 accept_server.cc:202] AcceptServer::BreakListeners finished
I20240604 12:10:57.323591 2092382 listener_interface.cc:339] Migrating 0x342394b0a00 from 2092382(2) 0x7f530bf77e40 to 2092401
I20240604 12:10:57.323897 2092401 listener_interface.cc:372] Migrated 0x342394b0a00 from 2 to 7 0x7f530bdb9e40
F20240604 12:10:57.323930 2092401 dragonfly_connection.cc:576] Check failed: !dispatch_fb_.IsJoinable()

kostasrim
kostasrim previously approved these changes Jun 4, 2024
@romange romange requested a review from kostasrim June 4, 2024 13:51
@romange romange enabled auto-merge (squash) June 4, 2024 13:56
@romange romange merged commit b02521c into main Jun 4, 2024
15 checks passed
@romange romange deleted the Pr1 branch June 4, 2024 14:13
szinn pushed a commit to szinn/k8s-homelab that referenced this pull request Jun 5, 2024
…nfly ( v1.18.1 → v1.19.0 ) (#3784)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
|
[docker.dragonflydb.io/dragonflydb/dragonfly](https://togithub.com/dragonflydb/dragonfly)
| minor | `v1.18.1` -> `v1.19.0` |

---

### Release Notes

<details>
<summary>dragonflydb/dragonfly
(docker.dragonflydb.io/dragonflydb/dragonfly)</summary>

###
[`v1.19.0`](https://togithub.com/dragonflydb/dragonfly/releases/tag/v1.19.0)

[Compare
Source](https://togithub.com/dragonflydb/dragonfly/compare/v1.18.1...v1.19.0)

##### Dragonfly v1.19.0

Some prominent changes include:

- SPOP and SRANDMEMBER return truly randomized results
([#&#8203;3022](https://togithub.com/dragonflydb/dragonfly/issues/3022))
- Fix memory blowup in some cases during replication
([#&#8203;3084](https://togithub.com/dragonflydb/dragonfly/issues/3084)
[#&#8203;3103](https://togithub.com/dragonflydb/dragonfly/issues/3103))
- Snapshotting works with data tiering
([#&#8203;3073](https://togithub.com/dragonflydb/dragonfly/issues/3073))
- Fix incompatibility issue of RDB snapshot with Redis 6.x
([#&#8203;3121](https://togithub.com/dragonflydb/dragonfly/issues/3121))
- Memory utilization improvements + better introspection of memory usage
via /metrics

##### What's Changed

- chore: update versions and remove caching code by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3030
- chore: fix macos tiering by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3032
- feat: support subrange expressions in jsonpathv2 by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3036
- fix: reduce delay when stop replica
[#&#8203;3020](https://togithub.com/dragonflydb/dragonfly/issues/3020)
by [@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3028
- fix(set): fix random in SRANDMEMBER and SPOP commands by
[@&#8203;BagritsevichStepan](https://togithub.com/BagritsevichStepan) in
[dragonflydb/dragonfly#3022
- chore: prevent updating gcc on macos by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3037
- chore: add half-range indices by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3041
- chore: update helio together with new mimalloc version by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3040
- fix: header for oom_errors_total by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3043
- chore: reset enable_direct_fd to avoid socket leakage in kernel by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3051
- chore: update deprecated actions by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3052
- chore: remove unneeded check-fails by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3054
- chore: Export replication memory stats by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3062
- <chore>!: Update grafana panel by
[@&#8203;MaoMaoCake](https://togithub.com/MaoMaoCake) in
[dragonflydb/dragonfly#3064
- chore: add replication memory stats to the dashboard by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3065
- chore: bpop prints by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3076
- fix(tiering): wait for IO before test teardown by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3079
- chore: small replayer fixes by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3081
- fix: increase lua stack limit to 8KB by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3080
- chore: minor fixes by [@&#8203;romange](https://togithub.com/romange)
in
[dragonflydb/dragonfly#3082
- fix: fix cluster incorrect keys status by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3083
- fix(acl): return -NOPERM instead of response error by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3049
- feat(server): Expose serialization bytes via `INFO` and `/metrics` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3087
- chore(streams): Some refactoring by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3088
- feat(server): remove multi shard sync from replication by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3085
- fix(replication): fullsync phase write to sync on noop by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3084
- fix(tiering): Async delete for small bins by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3068
- fix: prevent crashing if error happened during snapshot moving by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3092
- fix: add timeout for DFLYMIGRATE ACK to prevent deadlock by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3093
- chore: improve Migration() by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3033
- feat(streams): Stream optimizations by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3091
- feat(tiering): Defragmentation by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3021
- fix: bit shift of kTagMask by
[@&#8203;haodongnj](https://togithub.com/haodongnj) in
[dragonflydb/dragonfly#3099
- feat(cluster_mgr): Allow attaching replicas by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3105
- bug(server): fix replication stuck in full sync by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3103
- fix(server): Sync FLUSH with tiering by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3098
- chore: export pipeline related metrics by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3104
- chore: zset error log (from 1.18 branch) by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3109
- New test for cluster migration: connection issue by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3102
- chore: minor fixes + remove redundant DCHECK by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3115
- fix: fix cluster_fuzzy_migration test by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3116
- feat(server): Pipeline and dispatch on `/metrics` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3117
- chore: pull helio add test for tls deadlock by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3111
- feat(cluster_mgr): Improvements to `cluster_mgr.py` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3118
- refactor client tracking, fix atomicity, squashing and multi/exec by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#2970
- fix(server): fix compatibility with rdb snapshot by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3121
- Revert "refactor client tracking, fix atomicity, squashing and multi/…
by [@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3122
- feat(cluster_mgr): Take over command by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3120
- fix: fix RestoreStreamer to prevent buckets skipping
[#&#8203;2830](https://togithub.com/dragonflydb/dragonfly/issues/2830)
by [@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3119
- feat(cluster_mgr): Fix migration action by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3124
- chore: prevent Dispatch fiber to be launched during migration by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3123
- feat(tiering): Simple snapshotting by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3073
- fix: upload action in version release by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3127

##### New Contributors

- [@&#8203;MaoMaoCake](https://togithub.com/MaoMaoCake) made their first
contribution in
[dragonflydb/dragonfly#3064
- [@&#8203;haodongnj](https://togithub.com/haodongnj) made their first
contribution in
[dragonflydb/dragonfly#3099

##### Huge thanks to all the contributors! ❤️

**Full Changelog**:
dragonflydb/dragonfly@v1.18.0...v1.19.0

</details>

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4zOTEuMCIsInVwZGF0ZWRJblZlciI6IjM3LjM5MS4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJyZW5vdmF0ZS9jb250YWluZXIiLCJ0eXBlL21pbm9yIl19-->

Co-authored-by: repo-jeeves[bot] <106431701+repo-jeeves[bot]@users.noreply.github.com>
kireque pushed a commit to kireque/home-ops that referenced this pull request Jun 6, 2024
…nfly ( v1.18.1 → v1.19.0 ) (#629)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
|
[docker.dragonflydb.io/dragonflydb/dragonfly](https://togithub.com/dragonflydb/dragonfly)
| minor | `v1.18.1` -> `v1.19.0` |

---

### Release Notes

<details>
<summary>dragonflydb/dragonfly
(docker.dragonflydb.io/dragonflydb/dragonfly)</summary>

###
[`v1.19.0`](https://togithub.com/dragonflydb/dragonfly/releases/tag/v1.19.0)

[Compare
Source](https://togithub.com/dragonflydb/dragonfly/compare/v1.18.1...v1.19.0)

##### Dragonfly v1.19.0

Some prominent changes include:

- SPOP and SRANDMEMBER return truly randomized results
([#&#8203;3022](https://togithub.com/dragonflydb/dragonfly/issues/3022))
- Fix memory blowup in some cases during replication
([#&#8203;3084](https://togithub.com/dragonflydb/dragonfly/issues/3084)
[#&#8203;3103](https://togithub.com/dragonflydb/dragonfly/issues/3103))
- Snapshotting works with data tiering
([#&#8203;3073](https://togithub.com/dragonflydb/dragonfly/issues/3073))
- Fix incompatibility issue of RDB snapshot with Redis 6.x
([#&#8203;3121](https://togithub.com/dragonflydb/dragonfly/issues/3121))
- Memory utilization improvements + better introspection of memory usage
via /metrics

##### What's Changed

- chore: update versions and remove caching code by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3030
- chore: fix macos tiering by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3032
- feat: support subrange expressions in jsonpathv2 by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3036
- fix: reduce delay when stop replica
[#&#8203;3020](https://togithub.com/dragonflydb/dragonfly/issues/3020)
by [@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3028
- fix(set): fix random in SRANDMEMBER and SPOP commands by
[@&#8203;BagritsevichStepan](https://togithub.com/BagritsevichStepan) in
[dragonflydb/dragonfly#3022
- chore: prevent updating gcc on macos by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3037
- chore: add half-range indices by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3041
- chore: update helio together with new mimalloc version by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3040
- fix: header for oom_errors_total by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3043
- chore: reset enable_direct_fd to avoid socket leakage in kernel by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3051
- chore: update deprecated actions by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3052
- chore: remove unneeded check-fails by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3054
- chore: Export replication memory stats by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3062
- <chore>!: Update grafana panel by
[@&#8203;MaoMaoCake](https://togithub.com/MaoMaoCake) in
[dragonflydb/dragonfly#3064
- chore: add replication memory stats to the dashboard by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3065
- chore: bpop prints by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3076
- fix(tiering): wait for IO before test teardown by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3079
- chore: small replayer fixes by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3081
- fix: increase lua stack limit to 8KB by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3080
- chore: minor fixes by [@&#8203;romange](https://togithub.com/romange)
in
[dragonflydb/dragonfly#3082
- fix: fix cluster incorrect keys status by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3083
- fix(acl): return -NOPERM instead of response error by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3049
- feat(server): Expose serialization bytes via `INFO` and `/metrics` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3087
- chore(streams): Some refactoring by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3088
- feat(server): remove multi shard sync from replication by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3085
- fix(replication): fullsync phase write to sync on noop by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3084
- fix(tiering): Async delete for small bins by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3068
- fix: prevent crashing if error happened during snapshot moving by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3092
- fix: add timeout for DFLYMIGRATE ACK to prevent deadlock by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3093
- chore: improve Migration() by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3033
- feat(streams): Stream optimizations by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3091
- feat(tiering): Defragmentation by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3021
- fix: bit shift of kTagMask by
[@&#8203;haodongnj](https://togithub.com/haodongnj) in
[dragonflydb/dragonfly#3099
- feat(cluster_mgr): Allow attaching replicas by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3105
- bug(server): fix replication stuck in full sync by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3103
- fix(server): Sync FLUSH with tiering by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3098
- chore: export pipeline related metrics by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3104
- chore: zset error log (from 1.18 branch) by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3109
- New test for cluster migration: connection issue by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3102
- chore: minor fixes + remove redundant DCHECK by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3115
- fix: fix cluster_fuzzy_migration test by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3116
- feat(server): Pipeline and dispatch on `/metrics` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3117
- chore: pull helio add test for tls deadlock by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3111
- feat(cluster_mgr): Improvements to `cluster_mgr.py` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3118
- refactor client tracking, fix atomicity, squashing and multi/exec by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#2970
- fix(server): fix compatibility with rdb snapshot by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3121
- Revert "refactor client tracking, fix atomicity, squashing and multi/…
by [@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3122
- feat(cluster_mgr): Take over command by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3120
- fix: fix RestoreStreamer to prevent buckets skipping
[#&#8203;2830](https://togithub.com/dragonflydb/dragonfly/issues/2830)
by [@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3119
- feat(cluster_mgr): Fix migration action by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3124
- chore: prevent Dispatch fiber to be launched during migration by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3123
- feat(tiering): Simple snapshotting by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3073
- fix: upload action in version release by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3127

##### New Contributors

- [@&#8203;MaoMaoCake](https://togithub.com/MaoMaoCake) made their first
contribution in
[dragonflydb/dragonfly#3064
- [@&#8203;haodongnj](https://togithub.com/haodongnj) made their first
contribution in
[dragonflydb/dragonfly#3099

##### Huge thanks to all the contributors! ❤️

**Full Changelog**:
dragonflydb/dragonfly@v1.18.0...v1.19.0

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4zOTAuMSIsInVwZGF0ZWRJblZlciI6IjM3LjM5MC4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJyZW5vdmF0ZS9jb250YWluZXIiLCJ0eXBlL21pbm9yIl19-->

Co-authored-by: kireque-bot[bot] <143391978+kireque-bot[bot]@users.noreply.github.com>
lumiere-bot bot added a commit to coolguy1771/home-ops that referenced this pull request Jun 7, 2024
…19.0 ) (#4821)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
|
[ghcr.io/dragonflydb/dragonfly](https://togithub.com/dragonflydb/dragonfly)
| minor | `v1.18.1` -> `v1.19.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>dragonflydb/dragonfly (ghcr.io/dragonflydb/dragonfly)</summary>

###
[`v1.19.0`](https://togithub.com/dragonflydb/dragonfly/releases/tag/v1.19.0)

[Compare
Source](https://togithub.com/dragonflydb/dragonfly/compare/v1.18.1...v1.19.0)

##### Dragonfly v1.19.0

Some prominent changes include:

- SPOP and SRANDMEMBER return truly randomized results
([#&#8203;3022](https://togithub.com/dragonflydb/dragonfly/issues/3022))
- Fix memory blowup in some cases during replication
([#&#8203;3084](https://togithub.com/dragonflydb/dragonfly/issues/3084)
[#&#8203;3103](https://togithub.com/dragonflydb/dragonfly/issues/3103))
- Snapshotting works with data tiering
([#&#8203;3073](https://togithub.com/dragonflydb/dragonfly/issues/3073))
- Fix incompatibility issue of RDB snapshot with Redis 6.x
([#&#8203;3121](https://togithub.com/dragonflydb/dragonfly/issues/3121))
- Memory utilization improvements + better introspection of memory usage
via /metrics

##### What's Changed

- chore: update versions and remove caching code by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3030
- chore: fix macos tiering by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3032
- feat: support subrange expressions in jsonpathv2 by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3036
- fix: reduce delay when stop replica
[#&#8203;3020](https://togithub.com/dragonflydb/dragonfly/issues/3020)
by [@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3028
- fix(set): fix random in SRANDMEMBER and SPOP commands by
[@&#8203;BagritsevichStepan](https://togithub.com/BagritsevichStepan) in
[dragonflydb/dragonfly#3022
- chore: prevent updating gcc on macos by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3037
- chore: add half-range indices by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3041
- chore: update helio together with new mimalloc version by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3040
- fix: header for oom_errors_total by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3043
- chore: reset enable_direct_fd to avoid socket leakage in kernel by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3051
- chore: update deprecated actions by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3052
- chore: remove unneeded check-fails by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3054
- chore: Export replication memory stats by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3062
- <chore>!: Update grafana panel by
[@&#8203;MaoMaoCake](https://togithub.com/MaoMaoCake) in
[dragonflydb/dragonfly#3064
- chore: add replication memory stats to the dashboard by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3065
- chore: bpop prints by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3076
- fix(tiering): wait for IO before test teardown by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3079
- chore: small replayer fixes by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3081
- fix: increase lua stack limit to 8KB by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3080
- chore: minor fixes by [@&#8203;romange](https://togithub.com/romange)
in
[dragonflydb/dragonfly#3082
- fix: fix cluster incorrect keys status by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3083
- fix(acl): return -NOPERM instead of response error by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3049
- feat(server): Expose serialization bytes via `INFO` and `/metrics` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3087
- chore(streams): Some refactoring by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3088
- feat(server): remove multi shard sync from replication by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3085
- fix(replication): fullsync phase write to sync on noop by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3084
- fix(tiering): Async delete for small bins by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3068
- fix: prevent crashing if error happened during snapshot moving by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3092
- fix: add timeout for DFLYMIGRATE ACK to prevent deadlock by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3093
- chore: improve Migration() by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3033
- feat(streams): Stream optimizations by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3091
- feat(tiering): Defragmentation by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3021
- fix: bit shift of kTagMask by
[@&#8203;haodongnj](https://togithub.com/haodongnj) in
[dragonflydb/dragonfly#3099
- feat(cluster_mgr): Allow attaching replicas by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3105
- bug(server): fix replication stuck in full sync by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3103
- fix(server): Sync FLUSH with tiering by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3098
- chore: export pipeline related metrics by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3104
- chore: zset error log (from 1.18 branch) by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3109
- New test for cluster migration: connection issue by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3102
- chore: minor fixes + remove redundant DCHECK by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3115
- fix: fix cluster_fuzzy_migration test by
[@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3116
- feat(server): Pipeline and dispatch on `/metrics` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3117
- chore: pull helio add test for tls deadlock by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#3111
- feat(cluster_mgr): Improvements to `cluster_mgr.py` by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3118
- refactor client tracking, fix atomicity, squashing and multi/exec by
[@&#8203;kostasrim](https://togithub.com/kostasrim) in
[dragonflydb/dragonfly#2970
- fix(server): fix compatibility with rdb snapshot by
[@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3121
- Revert "refactor client tracking, fix atomicity, squashing and multi/…
by [@&#8203;adiholden](https://togithub.com/adiholden) in
[dragonflydb/dragonfly#3122
- feat(cluster_mgr): Take over command by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3120
- fix: fix RestoreStreamer to prevent buckets skipping
[#&#8203;2830](https://togithub.com/dragonflydb/dragonfly/issues/2830)
by [@&#8203;BorysTheDev](https://togithub.com/BorysTheDev) in
[dragonflydb/dragonfly#3119
- feat(cluster_mgr): Fix migration action by
[@&#8203;chakaz](https://togithub.com/chakaz) in
[dragonflydb/dragonfly#3124
- chore: prevent Dispatch fiber to be launched during migration by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3123
- feat(tiering): Simple snapshotting by
[@&#8203;dranikpg](https://togithub.com/dranikpg) in
[dragonflydb/dragonfly#3073
- fix: upload action in version release by
[@&#8203;romange](https://togithub.com/romange) in
[dragonflydb/dragonfly#3127

##### New Contributors

- [@&#8203;MaoMaoCake](https://togithub.com/MaoMaoCake) made their first
contribution in
[dragonflydb/dragonfly#3064
- [@&#8203;haodongnj](https://togithub.com/haodongnj) made their first
contribution in
[dragonflydb/dragonfly#3099

##### Huge thanks to all the contributors! ❤️

**Full Changelog**:
dragonflydb/dragonfly@v1.18.0...v1.19.0

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4zOTAuMSIsInVwZGF0ZWRJblZlciI6IjM3LjM5MC4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6WyJyZW5vdmF0ZS9jb250YWluZXIiLCJ0eXBlL21pbm9yIl19-->

Co-authored-by: lumiere-bot[bot] <98047013+lumiere-bot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants