Skip to content

Comments

[improve][misc] Sync commits from apache into 3.1_ds#23089

Closed
nikhil-ctds wants to merge 631 commits intoapache:masterfrom
datastax:cherry-picks-into-3.1
Closed

[improve][misc] Sync commits from apache into 3.1_ds#23089
nikhil-ctds wants to merge 631 commits intoapache:masterfrom
datastax:cherry-picks-into-3.1

Conversation

@nikhil-ctds
Copy link

Motivation

This PR sync all commits from apache/branch-3.0 into 3.1_ds which are not present till 30th June.

Modifications

  • Cherry-picked commits from branch-3.0 which are not present on 3.1_ds till 30th June.

Verifying this change

  • Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API: (no)
  • The schema: (no)
  • The default values of configurations: (no)
  • The wire protocol: (no)
  • The rest endpoints: (no)
  • The admin cli options: (no)
  • Anything that affects deployment: (no)

Documentation

Check the box below or label this PR directly (if you have committer privilege).

Need to update docs?

  • doc-required

    (If you need help on updating docs, create a doc issue)

  • no-need-doc

    (Please explain why)

  • doc

    (If this PR contains doc changes)

lhotari and others added 30 commits April 23, 2024 15:43
… reads (apache#22295)

(cherry picked from commit 2803ba2)

(cherry picked from commit fde7c49)
…o same topics (apache#22255)

(cherry picked from commit c616b35)
(cherry picked from commit 5ab0e93)
…cher.consumerList and dispatcher.consumerSet (apache#22270)

(cherry picked from commit cba1600)
(cherry picked from commit 94edfe4)
…tcher.consumerSet (apache#22283)

(cherry picked from commit a52945b)
(cherry picked from commit bec3be2)
…ar-function-go (apache#21444)

(cherry picked from commit 2d57624)
(cherry picked from commit 3ed5ea2)
(cherry picked from commit 073bb37)
(cherry picked from commit 53306b6)
…orrectly (apache#22311)

(cherry picked from commit 5cabcac)
(cherry picked from commit d4c0543)
…ccessing multiple clusters in the same process (apache#22306)

Co-authored-by: atomchchen <atomchchen@tencent.com>
(cherry picked from commit 71598c1)
(cherry picked from commit bff6ea2)
(cherry picked from commit cd49def)
(cherry picked from commit 5e95828)
…nStorage (apache#22344)

(cherry picked from commit fc066d7)
(cherry picked from commit 100a53b)
…nError (apache#22368)

(cherry picked from commit c184209)
(cherry picked from commit fe09a69)
…owledge with batch message (apache#22353)

Co-authored-by: Yunze Xu <xyzinfernity@163.com>
Co-authored-by: 汪苏诚 <sucheng.wang@zhaopin.com.cn>
(cherry picked from commit 3fa2ae8)
(cherry picked from commit 9c50d18)
(cherry picked from commit 43f9d2a)
(cherry picked from commit 6e0ebcb)
…ssages by ledger closure time (apache#22335)

(cherry picked from commit f77fe5f)
(cherry picked from commit 20be6ca)
(cherry picked from commit edd0076)
(cherry picked from commit 31c9f44)
(cherry picked from commit ee91edc)
(cherry picked from commit 9ea7f60)
…seeking to latest (apache#22201)

(cherry picked from commit 95a53f3)
(cherry picked from commit 318ff33)
…erTask in dispatcher (apache#22279)

(cherry picked from commit 4e0c145)
(cherry picked from commit e2070a8)
…e is deleted (apache#22268)

(cherry picked from commit 96d77f7)
(cherry picked from commit d4610a0)
…fter seeking by timestamp (apache#22363)

Co-authored-by: Lari Hotari <lhotari@users.noreply.github.com>
(cherry picked from commit 149deaa)
(cherry picked from commit 1045f8b)
…ors` (apache#22191)

(cherry picked from commit b702d44)
(cherry picked from commit ba8ff27)
…#22329)

Co-authored-by: Lari Hotari <lhotari@apache.org>
(cherry picked from commit cce0b05)
(cherry picked from commit 1b9ae2e)
…ntriesInStorage

- change apache#22034 is missing from branch-3.0

(cherry picked from commit e3531e8)
(cherry picked from commit b777136)
(cherry picked from commit d3f0a4b)
…EntriesInStorage

- improve the test case based on suggestion from @poorbarcode

(cherry picked from commit 8f17446)
…red mode (apache#22245)

(cherry picked from commit e34ea62)
(cherry picked from commit 5b37e84)
…n keys (apache#22421)

(cherry picked from commit a1970ae)
(cherry picked from commit 4a79a26)
(cherry picked from commit f423558)
(cherry picked from commit 5b14144)
lhotari and others added 24 commits July 15, 2024 16:47
… check (apache#22974)

(cherry picked from commit 4c84788)
(cherry picked from commit bbb37b3)
…client tls (apache#22991)

(cherry picked from commit deb26f7)
(cherry picked from commit 998bd90)
…ding stuck (apache#23004)

Co-authored-by: fanjianye <fanjianye@bigo.sg>
(cherry picked from commit 41ef3f6)
(cherry picked from commit 0252671)
…duce memory usage (apache#23006)

(cherry picked from commit ed39c4d)

(cherry picked from commit 278d679)
…ns of a topic have been deleted (apache#22854)

(cherry picked from commit 9626e7e)
(cherry picked from commit 98d4a53)
…ith a quote pattern (apache#23014)

(cherry picked from commit 7c0e827)
(cherry picked from commit c0029d7)
(cherry picked from commit bd4c57d)
(cherry picked from commit 3ccc213)
… API (apache#23002)

(cherry picked from commit 1f34497)
(cherry picked from commit 0fab9ed)
… remote admin fails (apache#23028)

(cherry picked from commit 88ebe78)
(cherry picked from commit 16da5f7)
…sters is not the same (apache#22983)

(cherry picked from commit a8ce990)
(cherry picked from commit 25542d8)
…ache#23052)

Co-authored-by: Zixuan Liu <nodeces@gmail.com>
(cherry picked from commit 81aed6c)
(cherry picked from commit 5a83958)
(cherry picked from commit 1897068)
…ce (apache#23049)

(cherry picked from commit 3e4f338)
(cherry picked from commit 3f7206c)
…tive source brokers (ExtensibleLoadManagerImpl only) (apache#23064) (apache#23077)

(cherry picked from commit 55d32f2)
…apache#23050)

### Motivation

GetPartitionMetadata fail also can produce messages

- 'autoUpdatePartitionsInterval' will get partition metadata and will regularly detect partition changes

- if GetPartitionMetadata will return ServiceNotReady, client receive ServiceNotReady will close cnx

- if close the current cnx, all producers and consumers witch use this cnx will close and reconnect

(https://github.com/apache/pulsar/blob/5c6602cbb3660a696bf960f2847aac1a2ae037d2/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ClientCnx.java#L323-L345)
- this will influence a lot of producers and consumers and if current time the zk not available and bundle cache not exist the topic's bundle metadata, the client can't send messages to broker because the producer lookup will fail

### Modifications

GetPartitionMetadata return MetadataError when throw MetadataStoreException

(cherry picked from commit 6fa3bcf)
(cherry picked from commit 3b3e90b)
@nikhil-ctds nikhil-ctds marked this pull request as draft July 29, 2024 05:56
@github-actions
Copy link

@nikhil-ctds Please add the following content to your PR description and select a checkbox:

- [ ] `doc` <!-- Your PR contains doc changes -->
- [ ] `doc-required` <!-- Your PR changes impact docs and you will update later -->
- [ ] `doc-not-needed` <!-- Your PR changes do not impact docs -->
- [ ] `doc-complete` <!-- Docs have been already added -->

@nikhil-ctds nikhil-ctds deleted the cherry-picks-into-3.1 branch July 29, 2024 05:56
@nikhil-ctds nikhil-ctds restored the cherry-picks-into-3.1 branch July 29, 2024 05:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.