Support Rsync to transfer clickhouse data file #2074
Conversation
|
@Hisoka-X Please have a look, and give me some advice.Thank you! |
| <dependency> | ||
| <groupId>com.github.fracpete</groupId> | ||
| <artifactId>rsync4j-all</artifactId> | ||
| <version>3.2.3-10</version> | ||
| </dependency> |
There was a problem hiding this comment.
https://mvnrepository.com/artifact/com.github.fracpete/rsync4j-all
The Apache License and GPL are not compatible and we cannot use this dependency
There was a problem hiding this comment.
Thank you. I will try to use the buildin package scala.sys.process to build rsync shell command to realize this feature. And recommit it.
There was a problem hiding this comment.
Thank you. I will try to use the buildin package scala.sys.process to build rsync shell command to realize this feature. And recommit it.
After you change, ping me. thx
There was a problem hiding this comment.
@Hisoka-X i have changed and passed the simple test in spark-local mode , please check it.
|
Can you submit this feature to our new seatunnel api connector? If so, it's very wonderful. |
Sure, I'm happy to do it. |
Purpose of this pull request
#2073
Support Rsync to transfer clickhouse data file.