Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Spark] Support flow control in Spark #5510

Merged
merged 16 commits into from
Oct 24, 2023

Conversation

zhilinli123
Copy link
Contributor

Purpose of this pull request

Check list

SubTask:#5504

@zhilinli123
Copy link
Contributor Author

zhilinli123 commented Sep 17, 2023

Spark 2

image

Spark 3

image

@zhilinli123 zhilinli123 reopened this Sep 20, 2023
# Conflicts:
#	seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/task/SourceSeaTunnelTask.java
@zhilinli123 zhilinli123 closed this Oct 7, 2023
@zhilinli123 zhilinli123 reopened this Oct 7, 2023
# Conflicts:
#	docs/en/concept/speed-limit.md
@zhilinli123 zhilinli123 reopened this Oct 10, 2023

<dependency>
<groupId>org.apache.seatunnel</groupId>
<artifactId>seatunnel-core-starter</artifactId>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why add this dependency?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry, my prolem

Copy link
Member

@hailin0 hailin0 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhilinli123 zhilinli123 reopened this Oct 12, 2023
@zhilinli123
Copy link
Contributor Author

PTAL: @Hisoka-X @hailin0

# Conflicts:
#	seatunnel-core/seatunnel-spark-starter/seatunnel-spark-starter-common/src/main/java/org/apache/seatunnel/core/starter/spark/execution/SourceExecuteProcessor.java
@Hisoka-X
Copy link
Member

Thanks @zhilinli123 and @hailin0 for review.

@Hisoka-X Hisoka-X merged commit eeff242 into apache:dev Oct 24, 2023
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants