Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lh jetty 12 #189

Closed
wants to merge 34 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
7e88463
[fix] Fix Reader can be stuck from transaction aborted messages. (#22…
dao-jun May 7, 2024
8167554
[improve][test] Clear fields in AuthZTest classes at cleanup (#22661)
lhotari May 7, 2024
09364a9
[improve] Upgrade to Oxia client 0.2.0 (#22663)
merlimat May 7, 2024
788b5ae
[feat][broker] PIP-264: Add Java runtime metrics (#22616)
dragosvictor May 7, 2024
83b86ab
[improve] Retry re-validating ResourceLock with backoff after errors …
merlimat May 7, 2024
519d8e2
[fix][broker] Add the missed opentelemetry-sdk-testing dependency to …
BewareMyPower May 7, 2024
5ff0fb9
[fix][broker] Disable system topic message deduplication (#22582)
mattisonchao May 8, 2024
e2feec8
[improve][broker] Disable JFR metric reporting in OpenTelemetry (#22669)
dragosvictor May 8, 2024
80d4675
[improve][ws] Add memory limit configuration for Pulsar client used i…
lhotari May 8, 2024
3114199
[fix][broker] avoid offload system topic (#22497)
mattisonchao May 8, 2024
188355b
[fix][admin] Fix deprecated check (#22653)
nodece May 8, 2024
ca44b9b
Revert "[fix][sec] Upgrade Debezium oracle connector version to avoid…
lhotari May 8, 2024
5ab0512
[fix] [broker] rename to changeMaxReadPositionCount (#22656)
thetumbled May 8, 2024
ada31a9
[fix] [broker] Fix nothing changed after removing dynamic configs (#2…
poorbarcode May 8, 2024
ad75e3f
[improve][broker] Remove unused method CompactionRecord.reset (#22670)
dragosvictor May 8, 2024
88feb87
[fix][ml] Remove duplicated field initialization of ML (#22676)
dao-jun May 9, 2024
8f015d8
[fix][broker] usedLocallySinceLastReport should always be reset (#22672)
nodece May 9, 2024
bd4c57d
[fix][broker] Fix geo-replication admin client url (#22584)
Demogorgon314 May 9, 2024
566330c
[fix][offload] Fix OOM in tiered storage, caused by unbounded offsets…
lhotari May 9, 2024
03a4995
[improve][offload] Replace usage of shaded class in OffsetsCache (#22…
lhotari May 9, 2024
0fd223d
[improve] [pip] PIP-349: Add additionalSystemCursorNames ignore list …
hangc0276 May 9, 2024
bed032e
[improve] [broker] Add additionalSystemCursorNames ignore list for TT…
hangc0276 May 9, 2024
253e650
[fix][broker] Fix ProducerBusy issue due to incorrect userCreatedProd…
hrzzzz May 9, 2024
ff4853e
[fix] [broker] Fix configurationMetadataSyncEventTopic is marked supp…
poorbarcode May 10, 2024
774a5d4
[fix][broker] Fix cursor should use latest ledger config (#22644)
nodece May 10, 2024
b7ec89a
[fix] [doc] fix the class name of transaction exception. (#22687)
thetumbled May 10, 2024
b56f238
[fix][client] Fix ReaderBuilder doest not give illegalArgument on con…
rdhabalia May 10, 2024
2cfd959
[fix][sec] Upgrade postgresql version to avoid CVE-2024-1597 (#22635)
nikhilerigila09 May 10, 2024
d77c5de
[improve] [log] Print source client addr when enabled haProxyProtocol…
poorbarcode May 10, 2024
e558cfe
[feat][broker] PIP-264: Add OpenTelemetry consumer metrics (#22693)
dragosvictor May 10, 2024
3b24b6e
[fix][misc] Correct the description of patternAutoDiscoveryPeriod (#2…
jitokim May 13, 2024
16556fa
[improve] [pip] PIP-348: Trigger offload on topic load stage (#22650)
hangc0276 May 13, 2024
936afec
[improve][broker]Ensure namespace deletion doesn't fail (#22627)
eolivelli May 13, 2024
d6d2209
[improve][misc] Upgrade to Jetty 12
lhotari May 8, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions build/run_unit_group.sh
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,8 @@ function test_group_broker_group_2() {

function test_group_broker_group_3() {
mvn_test -pl pulsar-broker -Dgroups='broker-admin'
# run AdminApiTransactionMultiBrokerTest independently with a larger heap size
mvn_test -pl pulsar-broker -DtestMaxHeapSize=1500M -Dtest=org.apache.pulsar.broker.admin.v3.AdminApiTransactionMultiBrokerTest -DtestForkCount=1 -DtestReuseFork=false
}

function test_group_broker_group_4() {
Expand Down
7 changes: 7 additions & 0 deletions conf/broker.conf
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,10 @@ backlogQuotaDefaultRetentionPolicy=producer_request_hold
# Default ttl for namespaces if ttl is not already configured at namespace policies. (disable default-ttl with value 0)
ttlDurationDefaultInSeconds=0

# Additional system subscriptions that will be ignored by ttl check. The cursor names are comma separated.
# Default is empty.
# additionalSystemCursorNames=

# Enable topic auto creation if new producer or consumer connected (disable auto creation with value false)
allowAutoTopicCreation=true

Expand Down Expand Up @@ -1544,6 +1548,9 @@ webSocketNumServiceThreads=
# Number of connections per Broker in Pulsar Client used in WebSocket proxy
webSocketConnectionsPerBroker=

# Memory limit in MBs for direct memory in Pulsar Client used in WebSocket proxy
webSocketPulsarClientMemoryLimitInMB=0

# Time in milliseconds that idle WebSocket session times out
webSocketSessionIdleTimeoutMillis=300000

Expand Down
4 changes: 4 additions & 0 deletions conf/pulsar_env.sh
Original file line number Diff line number Diff line change
Expand Up @@ -94,3 +94,7 @@ PULSAR_EXTRA_OPTS="${PULSAR_EXTRA_OPTS:-" -Dpulsar.allocator.exit_on_oom=true -D
#Wait time before forcefully kill the pulsar server instance, if the stop is not successful
#PULSAR_STOP_TIMEOUT=

# Enable semantically stable telemetry for JVM metrics, unless otherwise overridden by the user.
if [ -z "$OTEL_SEMCONV_STABILITY_OPT_IN" ]; then
export OTEL_SEMCONV_STABILITY_OPT_IN=jvm
fi
7 changes: 7 additions & 0 deletions conf/standalone.conf
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,10 @@ backlogQuotaDefaultLimitSecond=-1
# Default ttl for namespaces if ttl is not already configured at namespace policies. (disable default-ttl with value 0)
ttlDurationDefaultInSeconds=0

# Additional system subscriptions that will be ignored by ttl check. The cursor names are comma separated.
# Default is empty.
# additionalSystemCursorNames=

# Enable the deletion of inactive topics. This parameter need to cooperate with the allowAutoTopicCreation parameter.
# If brokerDeleteInactiveTopicsEnabled is set to true, we should ensure that allowAutoTopicCreation is also set to true.
brokerDeleteInactiveTopicsEnabled=true
Expand Down Expand Up @@ -967,6 +971,9 @@ webSocketNumIoThreads=8
# Number of connections per Broker in Pulsar Client used in WebSocket proxy
webSocketConnectionsPerBroker=8

# Memory limit in MBs for direct memory in Pulsar Client used in WebSocket proxy
webSocketPulsarClientMemoryLimitInMB=0

# Time in milliseconds that idle WebSocket session times out
webSocketSessionIdleTimeoutMillis=300000

Expand Down
3 changes: 3 additions & 0 deletions conf/websocket.conf
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,9 @@ numHttpServerThreads=
# Number of connections per Broker in Pulsar Client used in WebSocket proxy
webSocketConnectionsPerBroker=

# Memory limit in MBs for direct memory in Pulsar Client used in WebSocket proxy
webSocketPulsarClientMemoryLimitInMB=0

# Time in milliseconds that idle WebSocket session times out
webSocketSessionIdleTimeoutMillis=300000

Expand Down
28 changes: 28 additions & 0 deletions distribution/licenses/LICENSE-ASM.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@

ASM: a very small and fast Java bytecode manipulation framework
Copyright (c) 2000-2011 INRIA, France Telecom
All rights reserved.

Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
1. Redistributions of source code must retain the above copyright
notice, this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright
notice, this list of conditions and the following disclaimer in the
documentation and/or other materials provided with the distribution.
3. Neither the name of the copyright holders nor the names of its
contributors may be used to endorse or promote products derived from
this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE
LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGE.
29 changes: 0 additions & 29 deletions distribution/licenses/LICENSE-Reactive-gRPC.txt

This file was deleted.

77 changes: 47 additions & 30 deletions distribution/server/src/assemble/LICENSE.bin.txt
Original file line number Diff line number Diff line change
Expand Up @@ -330,7 +330,6 @@ The Apache Software License, Version 2.0
- io.prometheus-simpleclient_common-0.16.0.jar
- io.prometheus-simpleclient_hotspot-0.16.0.jar
- io.prometheus-simpleclient_httpserver-0.16.0.jar
- io.prometheus-simpleclient_jetty-0.16.0.jar
- io.prometheus-simpleclient_log4j2-0.16.0.jar
- io.prometheus-simpleclient_servlet-0.16.0.jar
- io.prometheus-simpleclient_servlet_common-0.16.0.jar
Expand All @@ -353,8 +352,8 @@ The Apache Software License, Version 2.0
- org.apache.logging.log4j-log4j-slf4j2-impl-2.23.1.jar
- org.apache.logging.log4j-log4j-web-2.23.1.jar
* Java Native Access JNA
- net.java.dev.jna-jna-jpms-5.12.1.jar
- net.java.dev.jna-jna-platform-jpms-5.12.1.jar
- net.java.dev.jna-jna-jpms-5.14.0.jar
- net.java.dev.jna-jna-platform-jpms-5.14.0.jar
* BookKeeper
- org.apache.bookkeeper-bookkeeper-common-4.17.0.jar
- org.apache.bookkeeper-bookkeeper-common-allocator-4.17.0.jar
Expand Down Expand Up @@ -393,25 +392,42 @@ The Apache Software License, Version 2.0
- org.asynchttpclient-async-http-client-2.12.1.jar
- org.asynchttpclient-async-http-client-netty-utils-2.12.1.jar
* Jetty
- org.eclipse.jetty-jetty-client-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-continuation-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-http-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-io-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-proxy-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-security-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-server-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-servlet-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-servlets-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-util-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-util-ajax-9.4.54.v20240208.jar
- org.eclipse.jetty.websocket-javax-websocket-client-impl-9.4.54.v20240208.jar
- org.eclipse.jetty.websocket-websocket-api-9.4.54.v20240208.jar
- org.eclipse.jetty.websocket-websocket-client-9.4.54.v20240208.jar
- org.eclipse.jetty.websocket-websocket-common-9.4.54.v20240208.jar
- org.eclipse.jetty.websocket-websocket-server-9.4.54.v20240208.jar
- org.eclipse.jetty.websocket-websocket-servlet-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-alpn-conscrypt-server-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-alpn-server-9.4.54.v20240208.jar
- org.eclipse.jetty-jetty-alpn-client-12.0.9.jar
- org.eclipse.jetty-jetty-alpn-conscrypt-server-12.0.9.jar
- org.eclipse.jetty-jetty-alpn-server-12.0.9.jar
- org.eclipse.jetty-jetty-client-12.0.9.jar
- org.eclipse.jetty-jetty-ee-12.0.9.jar
- org.eclipse.jetty-jetty-http-12.0.9.jar
- org.eclipse.jetty-jetty-io-12.0.9.jar
- org.eclipse.jetty-jetty-jndi-12.0.9.jar
- org.eclipse.jetty-jetty-plus-12.0.9.jar
- org.eclipse.jetty-jetty-security-12.0.9.jar
- org.eclipse.jetty-jetty-server-12.0.9.jar
- org.eclipse.jetty-jetty-session-12.0.9.jar
- org.eclipse.jetty-jetty-util-12.0.9.jar
- org.eclipse.jetty-jetty-xml-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-annotations-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-nested-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-plus-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-proxy-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-security-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-servlet-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-servlets-12.0.9.jar
- org.eclipse.jetty.ee8-jetty-ee8-webapp-12.0.9.jar
- org.eclipse.jetty.ee8.websocket-jetty-ee8-websocket-javax-client-12.0.9.jar
- org.eclipse.jetty.ee8.websocket-jetty-ee8-websocket-javax-common-12.0.9.jar
- org.eclipse.jetty.ee8.websocket-jetty-ee8-websocket-jetty-api-12.0.9.jar
- org.eclipse.jetty.ee8.websocket-jetty-ee8-websocket-jetty-common-12.0.9.jar
- org.eclipse.jetty.ee8.websocket-jetty-ee8-websocket-jetty-server-12.0.9.jar
- org.eclipse.jetty.ee8.websocket-jetty-ee8-websocket-servlet-12.0.9.jar
- org.eclipse.jetty.toolchain-jetty-javax-websocket-api-1.1.2.jar
- org.eclipse.jetty.toolchain-jetty-servlet-api-4.0.6.jar
- org.eclipse.jetty.websocket-jetty-websocket-core-client-12.0.9.jar
- org.eclipse.jetty.websocket-jetty-websocket-core-common-12.0.9.jar
- org.eclipse.jetty.websocket-jetty-websocket-core-server-12.0.9.jar
- org.eclipse.jetty.websocket-jetty-websocket-jetty-api-12.0.9.jar
- org.eclipse.jetty.websocket-jetty-websocket-jetty-client-12.0.9.jar
- org.eclipse.jetty.websocket-jetty-websocket-jetty-common-12.0.9.jar
* SnakeYaml -- org.yaml-snakeyaml-2.0.jar
* RocksDB - org.rocksdb-rocksdbjni-7.9.2.jar
* Google Error Prone Annotations - com.google.errorprone-error_prone_annotations-2.24.0.jar
Expand Down Expand Up @@ -481,12 +497,10 @@ The Apache Software License, Version 2.0
* Prometheus
- io.prometheus-simpleclient_httpserver-0.16.0.jar
* Oxia
- io.streamnative.oxia-oxia-client-0.1.6.jar
- io.streamnative.oxia-oxia-client-metrics-api-0.1.6.jar
- io.streamnative.oxia-oxia-client-api-0.2.0.jar
- io.streamnative.oxia-oxia-client-0.2.0.jar
* OpenHFT
- net.openhft-zero-allocation-hashing-0.16.jar
* Project reactor
- io.projectreactor-reactor-core-3.5.2.jar
* Java JSON WebTokens
- io.jsonwebtoken-jjwt-api-0.11.1.jar
- io.jsonwebtoken-jjwt-impl-0.11.1.jar
Expand Down Expand Up @@ -542,6 +556,8 @@ The Apache Software License, Version 2.0
- io.opentelemetry.instrumentation-opentelemetry-instrumentation-api-1.33.2.jar
- io.opentelemetry.instrumentation-opentelemetry-instrumentation-api-semconv-1.33.2-alpha.jar
- io.opentelemetry.instrumentation-opentelemetry-resources-1.33.2-alpha.jar
- io.opentelemetry.instrumentation-opentelemetry-runtime-telemetry-java17-1.33.2-alpha.jar
- io.opentelemetry.instrumentation-opentelemetry-runtime-telemetry-java8-1.33.2-alpha.jar
- io.opentelemetry.semconv-opentelemetry-semconv-1.25.0-alpha.jar

BSD 3-clause "New" or "Revised" License
Expand All @@ -552,9 +568,10 @@ BSD 3-clause "New" or "Revised" License
* JSR305 -- com.google.code.findbugs-jsr305-3.0.2.jar -- ../licenses/LICENSE-JSR305.txt
* JLine -- jline-jline-2.14.6.jar -- ../licenses/LICENSE-JLine.txt
* JLine3 -- org.jline-jline-3.21.0.jar -- ../licenses/LICENSE-JLine.txt
* Reactive gRPC
- com.salesforce.servicelibs-reactive-grpc-common-1.2.4.jar -- ../licenses/LICENSE-Reactive-gRPC.txt
- com.salesforce.servicelibs-reactor-grpc-stub-1.2.4.jar -- ../licenses/LICENSE-Reactive-gRPC.txt
* OW2 ASM
- org.ow2.asm-asm-9.7.jar -- ../licenses/LICENSE-ASM.txt
- org.ow2.asm-asm-commons-9.7.jar -- ../licenses/LICENSE-ASM.txt
- org.ow2.asm-asm-tree-9.7.jar -- ../licenses/LICENSE-ASM.txt

BSD 2-Clause License
* HdrHistogram -- org.hdrhistogram-HdrHistogram-2.1.9.jar -- ../licenses/LICENSE-HdrHistogram.txt
Expand All @@ -581,7 +598,6 @@ CDDL-1.1 -- ../licenses/LICENSE-CDDL-1.1.txt
- com.sun.activation-javax.activation-1.2.0.jar
- javax.xml.bind-jaxb-api-2.3.1.jar
* Java Servlet API -- javax.servlet-javax.servlet-api-3.1.0.jar
* WebSocket Server API -- javax.websocket-javax.websocket-client-api-1.0.jar
* Java Web Service REST API -- javax.ws.rs-javax.ws.rs-api-2.1.jar
* HK2 - Dependency Injection Kernel
- org.glassfish.hk2-hk2-api-2.6.1.jar
Expand Down Expand Up @@ -610,6 +626,7 @@ Eclipse Public License - v2.0 -- ../licenses/LICENSE-EPL-2.0.txt
* Jakarta Annotations API -- jakarta.annotation-jakarta.annotation-api-1.3.5.jar
* Jakarta RESTful Web Services -- jakarta.ws.rs-jakarta.ws.rs-api-2.1.6.jar
* Jakarta Injection -- org.glassfish.hk2.external-jakarta.inject-2.6.1.jar
* Jakarta Transactions API -- jakarta.transaction-jakarta.transaction-api-1.3.3.jar

Public Domain (CC0) -- ../licenses/LICENSE-CC0.txt
* Reactive Streams -- org.reactivestreams-reactive-streams-1.0.3.jar
Expand Down
23 changes: 14 additions & 9 deletions distribution/shell/src/assemble/LICENSE.bin.txt
Original file line number Diff line number Diff line change
Expand Up @@ -403,14 +403,20 @@ The Apache Software License, Version 2.0
- async-http-client-2.12.1.jar
- async-http-client-netty-utils-2.12.1.jar
* Jetty
- jetty-client-9.4.54.v20240208.jar
- jetty-http-9.4.54.v20240208.jar
- jetty-io-9.4.54.v20240208.jar
- jetty-util-9.4.54.v20240208.jar
- javax-websocket-client-impl-9.4.54.v20240208.jar
- websocket-api-9.4.54.v20240208.jar
- websocket-client-9.4.54.v20240208.jar
- websocket-common-9.4.54.v20240208.jar
- jetty-alpn-client-12.0.9.jar
- jetty-client-12.0.9.jar
- jetty-ee8-websocket-javax-client-12.0.9.jar
- jetty-ee8-websocket-javax-common-12.0.9.jar
- jetty-ee8-websocket-jetty-api-12.0.9.jar
- jetty-http-12.0.9.jar
- jetty-io-12.0.9.jar
- jetty-javax-websocket-api-1.1.2.jar
- jetty-util-12.0.9.jar
- jetty-websocket-core-client-12.0.9.jar
- jetty-websocket-core-common-12.0.9.jar
- jetty-websocket-jetty-api-12.0.9.jar
- jetty-websocket-jetty-client-12.0.9.jar
- jetty-websocket-jetty-common-12.0.9.jar
* SnakeYaml -- snakeyaml-2.0.jar
* Google Error Prone Annotations - error_prone_annotations-2.24.0.jar
* Javassist -- javassist-3.25.0-GA.jar
Expand All @@ -437,7 +443,6 @@ CDDL-1.1 -- ../licenses/LICENSE-CDDL-1.1.txt
- javax.annotation-api-1.3.2.jar
- javax.activation-1.2.0.jar
- jaxb-api-2.3.1.jar
* WebSocket Server API -- javax.websocket-client-api-1.0.jar
* Java Web Service REST API -- javax.ws.rs-api-2.1.jar
* HK2 - Dependency Injection Kernel
- hk2-api-2.6.1.jar
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@
*/
@LimitedPrivate
@Evolving
public interface LedgerOffloaderFactory<T extends LedgerOffloader> {
public interface LedgerOffloaderFactory<T extends LedgerOffloader> extends AutoCloseable {

/**
* Check whether the provided driver <tt>driverName</tt> is supported.
Expand Down Expand Up @@ -111,4 +111,9 @@ default T create(OffloadPoliciesImpl offloadPolicies,
throws IOException {
return create(offloadPolicies, userMetadata, scheduler, offloaderStats);
}

@Override
default void close() throws Exception {
// no-op
}
}
Loading
Loading