Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
95 commits
Select commit Hold shift + click to select a range
4f92cc5
a temporary submit..
Jul 27, 2021
5bdf918
temporary commit for refactor thrift rpc
Aug 3, 2021
19c9456
Merge remote-tracking branch 'origin/master' into cluster-
Aug 3, 2021
bba25de
temporary commit
Aug 7, 2021
ae1e677
Merge remote-tracking branch 'origin/master' into cluster-
Aug 7, 2021
4246406
almost pass
Aug 10, 2021
aae37ad
Merge remote-tracking branch 'origin/master' into cluster-
Aug 10, 2021
0625334
pass manually test
Aug 10, 2021
9790e83
add cluster/server/raft packet
Aug 10, 2021
2fbbdc9
add lost codes..
Aug 10, 2021
e0ac0c0
add threadpool implementataion
Aug 10, 2021
248ce36
modify thread pool
Aug 11, 2021
c2f0cb6
continue for threadpool
Aug 11, 2021
936c9eb
merge with master
Aug 11, 2021
9f71122
try to fix tests
Aug 11, 2021
0c13adf
contine to fix tests
Aug 12, 2021
75b4fa3
make sure close connections before stop the server in all tests
Aug 12, 2021
f3240f8
Merge commit '75b4fa329db5f3f5a6f0aa6879f44a9f834333c1' into cluster-
Aug 12, 2021
8fff2eb
continue to refactor
Aug 14, 2021
184d3d1
Merge remote-tracking branch 'origin/master' into cluster-
Aug 14, 2021
d5c9e7c
simplify dataclientfactory
Aug 14, 2021
9b10199
Merge remote-tracking branch 'origin/master' into cluster-
Aug 17, 2021
f22376b
fix bug for TestUtils.serializedpartitionTable
Aug 18, 2021
e47afa9
fix jmx for threadpool step 1
Aug 18, 2021
a2519c6
merge with master
Aug 18, 2021
9090519
fix error in DataLogApplierTest.java
Aug 19, 2021
81867e2
extract closing thread pool
Aug 19, 2021
dcf9a00
Merge branch 'cluster-' of github.com:apache/iotdb into cluster-
Aug 19, 2021
9e2a556
add log
Aug 22, 2021
4699d83
merge with master
Aug 24, 2021
84d1ee0
apply spotless
Aug 24, 2021
3961446
merge with master
Aug 31, 2021
f3a3f93
apply spotless
Aug 31, 2021
91417c6
temp
cigarl Sep 1, 2021
a1ec9f3
merge with master
Sep 4, 2021
6225362
enable github action for cluster- branch
Sep 17, 2021
9fdbbad
[cluster-refactor] update start class name in shell/bat script and ap…
chengjianyun Sep 18, 2021
06cbe01
merge with master
Sep 23, 2021
299345a
fix incorrect modification in IoTDB's shutdown function
Sep 24, 2021
d23062c
apply spotless
Sep 24, 2021
4c08775
fix error if pool is null in FlushManager
Sep 26, 2021
0e9b730
add 800 error code for incorrect configuration. remove some System.ex…
Sep 26, 2021
2bcf2cf
remove mockito-all dependency
Sep 27, 2021
5eb6987
remove mockito-all dependency
Sep 27, 2021
6cc3add
[cluster-refactor] add mockito dependency for cli and flink connector…
chengjianyun Sep 27, 2021
4a5a29d
[cluster-refactor] fix the bug that data heartbeat handler is null (#…
chengjianyun Sep 29, 2021
19d2f70
[cluster-refactor] refactor client pool (#3886)
chengjianyun Sep 30, 2021
12ad291
[cluster-refactor]split DataGroupServiceImpls into engine and impls …
cigarl Oct 5, 2021
5f98024
merge with master
Oct 5, 2021
22e7743
fix merge conflict
Oct 5, 2021
cc4cb83
fix clientManager tests
OneSizeFitsQuorum Oct 6, 2021
5282fb9
fix applier tests
OneSizeFitsQuorum Oct 7, 2021
e5000ee
fix pullSnapshotTaskTest
OneSizeFitsQuorum Oct 7, 2021
f227b27
fix ClusterAggregateExecutorTest
OneSizeFitsQuorum Oct 7, 2021
b99c266
init test client with category
OneSizeFitsQuorum Oct 7, 2021
326f43e
Merge branch 'master' into cluster-
OneSizeFitsQuorum Oct 12, 2021
186a38b
Merge remote-tracking branch 'origin/master' into cluster-
Oct 14, 2021
2f15139
fix some UT cases: DataGroupMemberTest, RemoteMultSeriesTest, MetaGro…
chengjianyun Oct 14, 2021
50fb186
[cluster-refactor] fix UT cases in: DataGroupMemberTest, MetaGroupMem…
chengjianyun Oct 19, 2021
0d399ce
Merge branch 'master' into cluster-
OneSizeFitsQuorum Oct 19, 2021
9bda5b3
fix metaMemberTest NPE
OneSizeFitsQuorum Oct 19, 2021
e62e097
fix singleNodeTest (#4185)
cigarl Oct 20, 2021
72e0c37
fix teardown NPE
OneSizeFitsQuorum Oct 20, 2021
15cd94c
fix snapshot OOM
OneSizeFitsQuorum Oct 20, 2021
5b19d94
fix double return
OneSizeFitsQuorum Oct 21, 2021
638eb9d
Merge branch 'master' of github.com:Apache/incubator-iotdb into cluster-
OneSizeFitsQuorum Oct 21, 2021
9bb1b2e
fix sonarcloud detected bugs (#4202)
chengjianyun Oct 21, 2021
f4b9e99
Merge branch 'master' of github.com:Apache/incubator-iotdb into cluster-
OneSizeFitsQuorum Oct 21, 2021
642ea80
fix code smell
OneSizeFitsQuorum Oct 21, 2021
3574f9f
remove unused dependency
OneSizeFitsQuorum Oct 21, 2021
c184107
fix code smell
OneSizeFitsQuorum Oct 21, 2021
d14bdeb
fix SlotStrategy
OneSizeFitsQuorum Oct 22, 2021
48614f1
Merge branch 'master' of github.com:Apache/incubator-iotdb into cluster-
OneSizeFitsQuorum Oct 25, 2021
6541b80
init taskExecutionPool with WrappedScheduledExecutorService in Compac…
OneSizeFitsQuorum Oct 25, 2021
c76201c
Update cluster/src/main/java/org/apache/iotdb/cluster/ClusterIoTDB.java
OneSizeFitsQuorum Oct 26, 2021
c0f9046
fix ClusterIoTDB related comments (#4239)
chengjianyun Oct 27, 2021
abe9ef1
fix some reviews
OneSizeFitsQuorum Oct 27, 2021
57a73f2
mvn spotless:apply
OneSizeFitsQuorum Oct 27, 2021
31947d8
[cluster refactor] comments resolve: remove useless config of check o…
chengjianyun Oct 27, 2021
e52b6d7
[cluster-refactor] fix client test related comments (#4247)
chengjianyun Oct 27, 2021
3ebdf92
[Cluster refactor] comments resolve (#4250)
chengjianyun Oct 28, 2021
78ad5eb
[cluster refactor] remove code checked in by mistake (#4251)
chengjianyun Oct 28, 2021
ceecd32
mvn spotless:apply
OneSizeFitsQuorum Oct 28, 2021
99c1da3
[cluster refactor] let borrowClient throw IOException instead of Exce…
chengjianyun Oct 28, 2021
8724db9
[Refactor cluster] fix comments (#4258)
chengjianyun Oct 28, 2021
c3ee7b6
[cluster refactor] fix code style of single line in if block
chengjianyun Oct 29, 2021
ea399f5
fix code smell step 1
OneSizeFitsQuorum Nov 1, 2021
de70ac0
fix code smell finish
OneSizeFitsQuorum Nov 1, 2021
59ce4d4
change name
OneSizeFitsQuorum Nov 2, 2021
886d06b
Merge branch 'master' of github.com:Apache/incubator-iotdb into cluster-
OneSizeFitsQuorum Nov 2, 2021
67d8875
Merge branch 'master' of github.com:Apache/incubator-iotdb into cluster-
OneSizeFitsQuorum Nov 3, 2021
42ee3a3
Merge branch 'master' of github.com:Apache/incubator-iotdb into cluster-
OneSizeFitsQuorum Nov 4, 2021
9d8f695
remove useless code
OneSizeFitsQuorum Nov 6, 2021
25571b8
fix code smell 2
OneSizeFitsQuorum Nov 8, 2021
a3aa279
fix code smell 2
OneSizeFitsQuorum Nov 8, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,6 @@
**/logs/*
**/lib/**
**/data/**
**/raft/**

# Python runtime file
**/__pycache__/**
Expand Down
5 changes: 5 additions & 0 deletions cli/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,11 @@
<artifactId>commons-csv</artifactId>
<version>1.9.0</version>
</dependency>
<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-core</artifactId>
<scope>test</scope>
</dependency>
</dependencies>
<build>
<plugins>
Expand Down
4 changes: 4 additions & 0 deletions cluster/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -125,6 +125,10 @@
<artifactId>powermock-api-mockito2</artifactId>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-pool2</artifactId>
</dependency>
</dependencies>
<profiles>
<profile>
Expand Down
5 changes: 0 additions & 5 deletions cluster/src/assembly/resources/conf/iotdb-cluster.properties
Original file line number Diff line number Diff line change
Expand Up @@ -64,11 +64,6 @@ seed_nodes=127.0.0.1:9003
# WARNING: this must be consistent across all nodes in the cluster
# rpc_thrift_compression_enable=false

# max client connections created by thrift
# this configuration applies separately to data/meta/client connections and thus does not control
# the number of global connections
# max_concurrent_client_num=10000

# number of replications for one partition
default_replica_num=1

Expand Down
2 changes: 1 addition & 1 deletion cluster/src/assembly/resources/sbin/add-node.bat
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ IF EXIST "%IOTDB_CONF%\iotdb-env.bat" (

@setlocal ENABLEDELAYEDEXPANSION ENABLEEXTENSIONS
set CONF_PARAMS=-a
if NOT DEFINED MAIN_CLASS set MAIN_CLASS=org.apache.iotdb.cluster.ClusterMain
if NOT DEFINED MAIN_CLASS set MAIN_CLASS=org.apache.iotdb.cluster.ClusterIoTDB
if NOT DEFINED JAVA_HOME goto :err

@REM -----------------------------------------------------------------------------
Expand Down
2 changes: 1 addition & 1 deletion cluster/src/assembly/resources/sbin/add-node.sh
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ CLASSPATH=""
for f in ${IOTDB_HOME}/lib/*.jar; do
CLASSPATH=${CLASSPATH}":"$f
done
classname=org.apache.iotdb.cluster.ClusterMain
classname=org.apache.iotdb.cluster.ClusterIoTDB

launch_service()
{
Expand Down
4 changes: 2 additions & 2 deletions cluster/src/assembly/resources/sbin/remove-node.bat
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ for %%i in (%*) do (
set CONF_PARAMS=!CONF_PARAMS! %%i
)

if NOT DEFINED MAIN_CLASS set MAIN_CLASS=org.apache.iotdb.cluster.ClusterMain
if NOT DEFINED MAIN_CLASS set MAIN_CLASS=org.apache.iotdb.cluster.ClusterIoTDB
if NOT DEFINED JAVA_HOME goto :err

@REM -----------------------------------------------------------------------------
Expand All @@ -82,7 +82,7 @@ set CLASSPATH="%IOTDB_HOME%\lib"

@REM For each jar in the IOTDB_HOME lib directory call append to build the CLASSPATH variable.
set CLASSPATH=%CLASSPATH%;"%IOTDB_HOME%\lib\*"
set CLASSPATH=%CLASSPATH%;iotdb.ClusterMain
set CLASSPATH=%CLASSPATH%;iotdb.ClusterIoTDB
goto okClasspath

:append
Expand Down
2 changes: 1 addition & 1 deletion cluster/src/assembly/resources/sbin/remove-node.sh
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ CLASSPATH=""
for f in ${IOTDB_HOME}/lib/*.jar; do
CLASSPATH=${CLASSPATH}":"$f
done
classname=org.apache.iotdb.cluster.ClusterMain
classname=org.apache.iotdb.cluster.ClusterIoTDB

launch_service()
{
Expand Down
4 changes: 2 additions & 2 deletions cluster/src/assembly/resources/sbin/start-node.bat
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ IF EXIST "%IOTDB_CONF%\iotdb-env.bat" (

@setlocal ENABLEDELAYEDEXPANSION ENABLEEXTENSIONS
set CONF_PARAMS=-s
if NOT DEFINED MAIN_CLASS set MAIN_CLASS=org.apache.iotdb.cluster.ClusterMain
if NOT DEFINED MAIN_CLASS set MAIN_CLASS=org.apache.iotdb.cluster.ClusterIoTDB
if NOT DEFINED JAVA_HOME goto :err

@REM -----------------------------------------------------------------------------
Expand All @@ -105,7 +105,7 @@ set CLASSPATH="%IOTDB_HOME%\lib"

@REM For each jar in the IOTDB_HOME lib directory call append to build the CLASSPATH variable.
set CLASSPATH=%CLASSPATH%;"%IOTDB_HOME%\lib\*"
set CLASSPATH=%CLASSPATH%;iotdb.ClusterMain
set CLASSPATH=%CLASSPATH%;iotdb.ClusterIoTDB
goto okClasspath

:append
Expand Down
2 changes: 1 addition & 1 deletion cluster/src/assembly/resources/sbin/start-node.sh
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ CLASSPATH=""
for f in ${IOTDB_HOME}/lib/*.jar; do
CLASSPATH=${CLASSPATH}":"$f
done
classname=org.apache.iotdb.cluster.ClusterMain
classname=org.apache.iotdb.cluster.ClusterIoTDB

launch_service()
{
Expand Down
2 changes: 1 addition & 1 deletion cluster/src/assembly/resources/sbin/stop-node.bat
Original file line number Diff line number Diff line change
Expand Up @@ -23,5 +23,5 @@ pushd..
set exec_dir=%cd%
popd
set exec_dir=%exec_dir:\=\\%
wmic process where (commandline like "%%iotdb.ClusterMain%%" and not name="wmic.exe" and commandline like "%%%exec_dir%%%") delete
wmic process where (commandline like "%%iotdb.ClusterIoTDB%%" and not name="wmic.exe" and commandline like "%%%exec_dir%%%") delete

2 changes: 1 addition & 1 deletion cluster/src/assembly/resources/sbin/stop-node.sh
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@
#


PIDS=$(ps ax | grep -i 'ClusterMain' | grep java | grep -v grep | awk '{print $1}')
PIDS=$(ps ax | grep -i 'ClusterIoTDB' | grep java | grep -v grep | awk '{print $1}')
sig=0
for every_pid in ${PIDS}
do
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,6 @@
import org.apache.thrift.protocol.TBinaryProtocol;
import org.apache.thrift.protocol.TCompactProtocol;
import org.apache.thrift.protocol.TProtocol;
import org.apache.thrift.transport.TSocket;
import org.apache.thrift.transport.TTransport;
import org.apache.thrift.transport.TTransportException;
import org.slf4j.Logger;
Expand Down Expand Up @@ -277,7 +276,7 @@ private static long connectClient(Client client) throws TException {
@SuppressWarnings({"java:S2095"}) // the transport is used later
private static Client getClient(String ip, int port) throws TTransportException {
TSIService.Client.Factory factory = new Factory();
TTransport transport = RpcTransportFactory.INSTANCE.getTransport(new TSocket(ip, port));
TTransport transport = RpcTransportFactory.INSTANCE.getTransportWithNoTimeout(ip, port);
transport.open();
TProtocol protocol =
IoTDBDescriptor.getInstance().getConfig().isRpcThriftCompressionEnable()
Expand Down
Loading