Skip to content
This repository has been archived by the owner on Oct 29, 2019. It is now read-only.

Merge 3.0 and add new DB management and REST V2 #292

Merged
merged 63 commits into from Jul 15, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
927c756
Stop reading file when the transfer is stopped or canceled
Jan 22, 2019
5fe8a49
Move URL decoding and file:// protocol handling to AbstractDir
Jul 23, 2018
2e4d57d
upgrade dependencies
Feb 6, 2019
35d3d3b
fix the command run on windows in exec tasks
Feb 13, 2019
4dfb4b6
Modify NetworkServerInitializer to have only one TrafficShapingHandler
marakiis Feb 4, 2019
1b6f14d
Add Limit field to Request Packet
marakiis Feb 4, 2019
a24a15d
Add transfer speed negociation based on RequestPacket limit field
marakiis Feb 4, 2019
65e0015
Correct RequestPacket constructor with limit
marakiis Feb 6, 2019
e1d71bf
version upgrade deps
Feb 8, 2019
1bfba63
add debug
Feb 8, 2019
78f144e
Rmove the bloquing loop in case there is no Local channel anymore
Feb 14, 2019
713dc16
Correct NPE for limit initialization through database
Feb 7, 2019
25b1345
Check for Null handler at Channel Initialization
marakiis Feb 18, 2019
fe4c705
fix log calls
Feb 18, 2019
f491ce8
upgrade WaarpCodec
Feb 18, 2019
d732b17
add missing imports
Feb 18, 2019
e83faec
Add POJOs and DAOs
marakiis Jul 1, 2019
a2605b1
Use testContainers for integration tests
marakiis Jul 1, 2019
2029ff9
Fix dao initialization
marakiis Mar 5, 2019
c55e198
Add runseq querry to fetch runner primarykey
marakiis Mar 5, 2019
058fd86
Add enum to Transfer pojo
marakiis Apr 9, 2019
5d82fe3
mend
marakiis Jul 1, 2019
82bc411
Integration of Pojo/DAO
marakiis Apr 9, 2019
239f58b
Correct PreparedStatement population on TransferDAO insert & update
marakiis Apr 23, 2019
3fcaf35
Integration of Pojo/DAO
marakiis Apr 9, 2019
73c9964
Update DAO integration tests
marakiis May 7, 2019
aa0e823
add maven profiles in pom
marakiis May 9, 2019
75dcd7d
Add Oracle Tests
marakiis May 13, 2019
7ceb44c
Fix data connection leak
marakiis May 23, 2019
43a5404
change messages keys for error code
marakiis May 28, 2019
df992bb
add xml dao
marakiis May 28, 2019
dc1cfc1
Add Rest v2 base transfer control.
ppantellini Jul 9, 2018
76f0b83
Added PATCH method to relevant handlers.
ppantellini Jul 17, 2018
c769945
Generify the convertion of query parameters to filters.
ppantellini Jul 20, 2018
1fecb65
Improve error handling.
ppantellini Jul 23, 2018
92da627
Add partial server commands handling.
ppantellini Jul 26, 2018
0cc9ebd
Improve query parameters deserialization.
ppantellini Jul 30, 2018
c238988
Remove data utils classes (for code clarity).
ppantellini Aug 6, 2018
0689bc7
Add support for real database.
ppantellini Aug 23, 2018
20f9831
Add input data control.
ppantellini Aug 24, 2018
fda5a69
Add access control.
ppantellini Aug 27, 2018
cee9998
Redone the response message system.
ppantellini Aug 28, 2018
690853c
Add Hmac authentication.
ppantellini Aug 30, 2018
1d1a47f
Fix StackOverflowError when adding a new host
ppantellini Mar 5, 2019
abaad7b
{Rest} Added server configuration export
ppantellini Mar 6, 2019
670a563
{Rest} Replaced RestTransfer with ObjectNode
ppantellini Apr 16, 2019
b438787
{Rest} Added JavaDoc
Apr 26, 2019
d08bec1
Correct some database access
marakiis Mar 19, 2019
26456cf
bump version to 3.0.12
May 10, 2019
c61868f
Change db.dbcheck to db.auto-upgrade, correct auto-upgrade with initd…
marakiis May 14, 2019
55b8484
Prevent ssl hostids to be used on clear channel and vice versa
marakiis May 14, 2019
ea69e4d
trim whitespaces before looking for errorcode in cancel-restart
marakiis May 15, 2019
a1f91c3
Fix configuration for noDb Client due to admin.isActive return true
marakiis May 29, 2019
f1bfc34
Reorganise and cleanup database init messages and exit codes
marakiis May 17, 2019
00da023
Print connection error reason more clearly
marakiis May 21, 2019
3f3ac9c
Correct missing try catch for updateDb
marakiis Jun 4, 2019
8a833ec
fix data parsing for admin interface
marakiis Jun 14, 2019
4ea704b
Use empty constructor for AbstractDbData and remove some DbSession use
marakiis Jun 17, 2019
c1bfd0c
reorganise test ressources and correct oracle tests
marakiis Jun 25, 2019
c14eb8e
Correct some messages, simplify maven-version-rules and revert some w…
marakiis Jun 26, 2019
33cde6c
Fixes after merges
marakiis Jul 1, 2019
af2b682
Fix small issues
fredericBregier Jul 2, 2019
d6cba6d
Merge pull request #1 from fredericBregier/wNetty41
marakiis Jul 2, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
12 changes: 12 additions & 0 deletions .gitignore
Expand Up @@ -17,6 +17,11 @@ local.properties
.loadpath
.pmd

############
## Intellij
############
.idea

# External tool builders
.externalToolBuilders/

Expand All @@ -29,6 +34,13 @@ local.properties
# PDT-specific
.buildpath


#################
# Intellij
#################
.idea
src/main/java/resources/

#################
## Java
#################
Expand Down
1 change: 1 addition & 0 deletions maven-version-rules.xml
Expand Up @@ -35,6 +35,7 @@
<ignoreVersion type="regex">1\.4\..+</ignoreVersion>
<ignoreVersion type="regex">1\.5\..+</ignoreVersion>
<ignoreVersion type="regex">1\.6\..+</ignoreVersion>
<ignoreVersion type="regex">1\.8\..+</ignoreVersion>
<ignoreVersion type="regex">2\..+</ignoreVersion>
bcarlin marked this conversation as resolved.
Show resolved Hide resolved
bcarlin marked this conversation as resolved.
Show resolved Hide resolved
</ignoreVersions>
</rule>
Expand Down
86 changes: 68 additions & 18 deletions pom.xml
Expand Up @@ -2,7 +2,7 @@
<modelVersion>4.0.0</modelVersion>
<artifactId>WaarpR66</artifactId>
<name>Waarp OpenR66</name>
<version>3.0.10</version>
<version>3.0.12</version>
<description>
OpenR66 is a File Transfer Monitor to be used in real production to transfer files between servers.
It allows to start/restart a transfer, check the remote MD5, check status, make pre or post
Expand Down Expand Up @@ -45,11 +45,37 @@
</snapshots>
</repository>
</repositories>

<properties>
<skipITs>true</skipITs>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<attach-distribution>false</attach-distribution>
<filtermodule>**</filtermodule>
<!-- Dependencies versions-->
<test-containers>1.11.2</test-containers>
</properties>

<profiles>
<profile>
<id>development</id>
<properties>
<skipITs>true</skipITs>
</properties>
</profile>
<profile>
<id>integration-tests</id>
<properties>
<skipITs>false</skipITs>
</properties>
</profile>
</profiles>


<dependencies>
<dependency>
<groupId>Waarp</groupId>
<artifactId>WaarpCommon</artifactId>
<version>3.0.10</version>
<version>3.0.12</version>
<exclusions>
<exclusion>
<artifactId>xml-apis</artifactId>
Expand Down Expand Up @@ -84,7 +110,7 @@
<dependency>
<groupId>commons-codec</groupId>
<artifactId>commons-codec</artifactId>
<version>1.11</version>
<version>1.12</version>
</dependency>
<dependency>
<groupId>Waarp</groupId>
Expand All @@ -95,7 +121,7 @@
<dependency>
<groupId>Waarp</groupId>
<artifactId>WaarpSnmp</artifactId>
<version>3.0.5</version>
<version>3.0.6</version>
<optional>true</optional>
</dependency>
<dependency>
Expand All @@ -111,7 +137,7 @@
<dependency>
<groupId>Waarp</groupId>
<artifactId>WaarpThrift</artifactId>
<version>3.0.5</version>
<version>3.0.6</version>
<optional>true</optional>
</dependency>
<dependency>
Expand Down Expand Up @@ -141,12 +167,12 @@
<dependency>
<groupId>Waarp</groupId>
<artifactId>WaarpGatewayKernel</artifactId>
<version>3.0.9</version>
<version>3.0.10</version>
</dependency>
<dependency>
<groupId>Waarp</groupId>
<artifactId>WaarpFtpClient</artifactId>
<version>3.0.5</version>
<version>3.0.6</version>
</dependency>
<dependency>
<groupId>junit</groupId>
Expand All @@ -163,25 +189,49 @@
<dependency>
<groupId>org.testcontainers</groupId>
<artifactId>mariadb</artifactId>
<version>1.10.6</version>
<version>${test-containers}</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.testcontainers</groupId>
<artifactId>mysql</artifactId>
<version>1.10.6</version>
<version>${test-containers}</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.testcontainers</groupId>
<artifactId>oracle-xe</artifactId>
<version>${test-containers}</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.testcontainers</groupId>
<artifactId>postgresql</artifactId>
<version>1.10.6</version>
<version>${test-containers}</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>javax.ws.rs</groupId>
<artifactId>javax.ws.rs-api</artifactId>
<version>2.1.1</version>
</dependency>
<dependency>
<groupId>commons-beanutils</groupId>
<artifactId>commons-beanutils-core</artifactId>
<version>1.8.3</version>
</dependency>
<dependency>
<groupId>org.glassfish.jersey.core</groupId>
<artifactId>jersey-common</artifactId>
<version>2.28</version>
</dependency>
<dependency>
<groupId>io.cdap.http</groupId>
<artifactId>netty-http</artifactId>
<version>1.2.0</version>
</dependency>
</dependencies>
<properties>
<skipITs>true</skipITs>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<attach-distribution>false</attach-distribution>
<filtermodule>**</filtermodule>
</properties>

<build>
<plugins>
<plugin>
Expand Down Expand Up @@ -219,7 +269,7 @@
<goals>
<goal>integration-test</goal>
<goal>verify</goal>
</goals>
</goals>
</execution>
</executions>
</plugin>
Expand Down Expand Up @@ -313,7 +363,7 @@
<version>2.3</version>
<inherited>false</inherited>
<configuration>
<rulesUri>file:///${session.executionRootDirectory}/maven-version-rules.xml</rulesUri>
<rulesUri>file:///${session.executionRootDirectory}/maven-version-restRules.xml</rulesUri>
</configuration>
</plugin>
</plugins>
Expand Down
2 changes: 1 addition & 1 deletion src/main/httpadmin/admin-bootstrap/CancelRestart.html
Expand Up @@ -113,7 +113,7 @@
return TASKSTEP[data];
case 12:
case 14:
return ErrorCode[data];
return ErrorCode[data.trim()];
case 15:
return UpdatedInfo[data];
case 21:
Expand Down
Expand Up @@ -641,9 +641,9 @@ <h4>TRANSFER</h4>
<div class="collapse" id="RESCHEDULE">
<div class="well">
<h4>RESCHEDULE</h4>
<p>Reschedule Transfer task to a time delayed by the specified number of milliseconds, if the error code is one of the specified codes and the optional intervals of date are compatible with the new time schedule.</p><p>Result of arguments will be as following options (the two first are mandatory):</p>
<p>Reschedule Transfer task to a time delayed by the specified number of milliseconds, if the error code is one of the specified code and the optional intervals of date are compatible with the new time schedule.</p><p>Result of arguments will be as following options (the two first are mandatory):</p>
<ul><li><code>"-delay ms"</code> where ms is the added number of ms on current time before retry on schedule</li>
<li><code>"-case errorCode,errorCode,..."</code> where errorCode is one of the following error of the current transfer (either literal or code in 1 character):
<li><code>"-case code,code,..."</code> where code is one of the following error of the current transfer (either literal or code in 1 character):
<code>ConnectionImpossible(C), ServerOverloaded(l), BadAuthent(A), ExternalOp(E), TransferError(T),</code> <code>MD5Error(M), Disconnection(D), RemoteShutdown(r), FinalOp(F), Unimplemented(U), Shutdown(S),</code> <code>RemoteError(R), Internal(I), StoppedTransfer(H), CanceledTransfer(K), Warning(W), Unknown(-),</code> <code>QueryAlreadyFinished(Q), QueryStillRunning(s), NotKnownHost(N), QueryRemotelyUnknown(u),</code> <code>FileNotFound(f), CommandNotFound(c), PassThroughMode(p)</code></li>
<li><code>"-between start;end"</code> and/or <code>"-notbetween start;end"</code> (multiple times are allowed, start or end can be not set) and where start and stop are in the following format:
<code>Yn:Mn:Dn:Hn:mn:Sn</code> where n is a number for each time specification, each specification is optional, as <code>Y=Year, M=Month, D=Day, H=Hour, m=minute, s=second</code>.
Expand Down
4 changes: 2 additions & 2 deletions src/main/httpadmin/i18n/res/OpenR66TaskOptions.html
Expand Up @@ -301,12 +301,12 @@ <h1 class="h1">Waarp R66-TaskOptions</h1>
<li>
<div style="text-align:justify;"><span style="font-size:11pt;"><strong>RESCHEDULE</strong></span></div></li></ul>
<blockquote>
<p style="text-align:justify;"><span style="font-size:11pt;">Reschedule Transfer task to a time delayed by the specified number of milliseconds, if the error code is one of the specified codes and the optional intervals of date are compatible with the new time schedule<br /><br />Result of arguments will be as following options (the two first are mandatory):</span></p></blockquote>
<p style="text-align:justify;"><span style="font-size:11pt;">Reschedule Transfer task to a time delayed by the specified number of milliseconds, if the error code is one of the specified code and the optional intervals of date are compatible with the new time schedule<br /><br />Result of arguments will be as following options (the two first are mandatory):</span></p></blockquote>
<ul>
<ul>
<li><div style="text-align:justify;"><span style="font-size:11pt;">"-delay ms" where ms is the added number of ms on current time before retry on schedule </span></div></li>

<li><div style="text-align:justify;"><span style="font-size:11pt;">"-case errorCode,errorCode,..." where errorCode is one of the following error of the current transfer (either literal or code in 1 character):<br />ConnectionImpossible(C), ServerOverloaded(l), BadAuthent(A), ExternalOp(E), TransferError(T), MD5Error(M), Disconnection(D), RemoteShutdown(r), FinalOp(F), Unimplemented(U), Shutdown(S), RemoteError(R), Internal(I), StoppedTransfer(H), CanceledTransfer(K), Warning(W), Unknown(-), QueryAlreadyFinished(Q), QueryStillRunning(s), NotKnownHost(N), QueryRemotelyUnknown(u), FileNotFound(f), CommandNotFound(c), PassThroughMode(p) </span></div></li>
<li><div style="text-align:justify;"><span style="font-size:11pt;">"-case code,code,..." where code is one of the following error of the current transfer (either literal or code in 1 character):<br />ConnectionImpossible(C), ServerOverloaded(l), BadAuthent(A), ExternalOp(E), TransferError(T), MD5Error(M), Disconnection(D), RemoteShutdown(r), FinalOp(F), Unimplemented(U), Shutdown(S), RemoteError(R), Internal(I), StoppedTransfer(H), CanceledTransfer(K), Warning(W), Unknown(-), QueryAlreadyFinished(Q), QueryStillRunning(s), NotKnownHost(N), QueryRemotelyUnknown(u), FileNotFound(f), CommandNotFound(c), PassThroughMode(p) </span></div></li>

<li><div style="text-align:justify;"><span style="font-size:11pt;">"-between start;end" and/or "-notbetween start;end" (multiple times are allowed, start or end can be not set) and where start and stop are in the following format:<br />Yn:Mn:Dn:Hn:mn:Sn where n is a number for each time specification, each specification is optional, as Y=Year, M=Month, D=Day, H=Hour, m=minute, s=second.<br />Format can be X+n, X-n, X=n or Xn where X+-n means adding/subtracting n to current date value, while X=n or Xn means setting exact value<br />If one time specification is not set, it is based on the current date.<br /><br />If "-notbetween" is specified, the planned date must not be in the area.<br />If "-between" is specified, the planned date must be found in any such specified areas (could be in any of the occurrence). If not specified, it only depends on "-notbetween".<br />If none is specified, the planned date is always valid.</span></div></li>

Expand Down