[Feature][Connector] add IT for Assert Sink in e2e module

[lhyundeadsoul]

Purpose of this pull request

add IT to test Assert Sink plugin
#2034

Check list

• Code changed are covered with tests, or it does not need tests for reason:
• If any new Jar binary package adding in your PR, please add License Notice according
  New License Guide
• If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs

[lhyundeadsoul]

PTAL @ruanwenjun Thx!

[ruanwenjun]

@lhyundeadsoul Is there any count rule? e.g. I want to assert the batch row count is 4.

[lhyundeadsoul]

@lhyundeadsoul Is there any count rule? e.g. I want to assert the batch row count is 4.
Thanks for your idea.
I support five assert rule now: min/max/min_length/max_length/not null , and will consider count rule in another PR.

[ruanwenjun]

+1

[ruanwenjun]

The IT failed.

[ruanwenjun]

Could you please make the ci pass.

[lhyundeadsoul]

Both console and assert e2e IT failed.
org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

[Hisoka-X]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

In your local?

[lhyundeadsoul]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

In your local?

Maybe it's in my local.

I find the root cause : There is no org.apache.seatunnel.core.flink.FlinkEnvParameterParser in my target jar but it source code does exists.
an error often occur while execute 'mvn install', I think this is the root cause.

Failure to find org.apache.seatunnel:seatunnel:pom:${revision} in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

Have you ever had this?

[Hisoka-X]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

In your local?
Maybe it's in my local.

I find the root cause : There is no org.apache.seatunnel.core.flink.FlinkEnvParameterParser in my target jar. and an error often occur while execute 'mvn install'

Failure to find org.apache.seatunnel:seatunnel:pom:${revision} in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

Have you ever had this?

Yes, also confusion me😭

[lhyundeadsoul]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

In your local?
Maybe it's in my local.

I find the root cause : There is no org.apache.seatunnel.core.flink.FlinkEnvParameterParser in my target jar. and an error often occur while execute 'mvn install'

Failure to find org.apache.seatunnel:seatunnel:pom:${revision} in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

Have you ever had this?

Yes, also confusion me😭

Wow~ I am not the only one~
HELP! @ruanwenjun Have you ever had this error?

[Hisoka-X]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

In your local?
Maybe it's in my local.

I find the root cause : There is no org.apache.seatunnel.core.flink.FlinkEnvParameterParser in my target jar. and an error often occur while execute 'mvn install'

Failure to find org.apache.seatunnel:seatunnel:pom:${revision} in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

Have you ever had this?

Yes, also confusion me😭

Wow~ I am not the only one~ HELP! @ruanwenjun Have you ever had this error?

I doubt it is caused by flatten-maven-plugin. But I don't have test.

[lhyundeadsoul]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

In your local?
Maybe it's in my local.

I find the root cause : There is no org.apache.seatunnel.core.flink.FlinkEnvParameterParser in my target jar. and an error often occur while execute 'mvn install'

Failure to find org.apache.seatunnel:seatunnel:pom:${revision} in https://repo.maven.apache.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced

Have you ever had this?

Yes, also confusion me😭

Wow~ I am not the only one~ HELP! @ruanwenjun Have you ever had this error?

I doubt it is caused by flatten-maven-plugin. But I don't have test.

Maybe. Sometimes it work, sometimes it fail. Occur randomly.

[Hisoka-X]

Maybe. Sometimes it work, sometimes it fail. Occur randomly.

if you package success local, everything will be fine.

[Hisoka-X]

Both console and assert e2e IT failed. org.apache.seatunnel.e2e.flink.fake.FakeSourceToConsoleIT

22/06/30 17:18:28 ERROR FlinkContainer: Error: Could not find or load main class org.apache.seatunnel.core.flink.FlinkEnvParameterParser


java.lang.AssertionError: 
Expected :0
Actual   :1
<Click to see difference>

So this error have any progress?

[lhyundeadsoul]

a new error occur after package successfully.

Caused by: java.lang.RuntimeException: No data sinks have been created yet. A program needs at least one sink that consumes data. Examples are writing the data set or printing it.
	at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:1170)
	at org.apache.flink.api.java.ExecutionEnvironment.getExecutionPlan(ExecutionEnvironment.java:1076)
	at org.apache.seatunnel.flink.batch.FlinkBatchExecution.start(FlinkBatchExecution.java:76)
	at org.apache.seatunnel.core.flink.command.FlinkTaskExecuteCommand.execute(FlinkTaskExecuteCommand.java:81)
	... 15 more

I working on it

[ruanwenjun]

LGTM

[lhyundeadsoul]

@Hisoka-X PTAL