Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Task]: Deprecate runner for Spark v2 #22094

Closed
mosche opened this issue Jun 29, 2022 · 0 comments
Closed

[Task]: Deprecate runner for Spark v2 #22094

mosche opened this issue Jun 29, 2022 · 0 comments
Assignees
@mosche
Labels
P2 runners spark task

Comments

@mosche
Copy link
Member

mosche commented Jun 29, 2022

What needs to happen?

It is time to deprecate the Spark 2 runner in Beam, see this discussion. Databricks is also dropping support for runtimes using Spark 2 by the end of June 2022.

With that the Spark 3 runner will become the default and only Spark runner.

Issue Priority

Priority: 2

Issue Component

Component: runner-spark
@mosche mosche self-assigned this Jun 29, 2022
@github-actions github-actions bot added the P2 label Jun 29, 2022
echauchot added a commit that referenced this issue Jul 1, 2022
@echauchot
Merge pull request #22097 from mosche/22094-DeprecateSpark2
680ed5b 
Deprecate runner support for Spark 2.4 (closes #22094)
lostluck pushed a commit to lostluck/beam that referenced this issue Aug 26, 2022
@lostluck
Deprecate runner support for Spark 2.4 (closes apache#22094)
3540c19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mosche mosche

Labels
P2 runners spark task
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mosche