Skip to content

SAMZA-2589: Consolidate Beam and High/Low Samza Apps launch workflow#1428

Merged
mynameborat merged 3 commits intoapache:masterfrom
kw2542:SAMZA-2589
Sep 11, 2020
Merged

SAMZA-2589: Consolidate Beam and High/Low Samza Apps launch workflow#1428
mynameborat merged 3 commits intoapache:masterfrom
kw2542:SAMZA-2589

Conversation

@kw2542
Copy link
Contributor

@kw2542 kw2542 commented Sep 8, 2020

Issues: app.main.class is only set for Beam apps which causes different workflow on AM when launching a job.
Changes:

  1. Introduce DefaultApplicationMain to capture launch workflow for High/Low level jobs so on AM, all jobs are launched in the same way: ClusterBasedJobCoordinatorRunner#main -> app.main.class -> JobCoordinatorLaunchUtil
  2. Update ApplicationConfig#getAppMainClass to default to DefaultApplicationMain

Tests:

  1. Unit Tests
  2. Deployed hello samza job successfully with the change following instructions on http://samza.apache.org/startup/hello-samza/latest/

API Changes: None
Upgrade Instructions: None
Usage Instructions: None

Issues: app.main.class is only set for Beam apps which causes different workflow on AM when launching a job.
Changes:
1. Introduce DefaultApplicationMain to capture launch workflow for High/Low level jobs so on AM, all jobs are launched in the same way: ClusterBasedJobCoordinatorRunner#main -> app.main.class -> JobCoordinatorLaunchUtil
2. Update ApplicationConfig#getAppMainClass to default to DefaultApplicationMain

Tests:
1. Unit Tests
2. Deployed hello samza job successfully with the change following instructions on http://samza.apache.org/startup/hello-samza/latest/

API Changes: None
Upgrade Instructions: None
Usage Instructions: None
Copy link
Contributor

@mynameborat mynameborat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! Mostly questions, looks good to me otherwise

@mynameborat mynameborat merged commit 764f09c into apache:master Sep 11, 2020
MabelYC pushed a commit to MabelYC/samza that referenced this pull request Sep 14, 2020
…pache#1428)

Issues: app.main.class is only set for Beam apps which causes different workflow on AM when launching a job.
Changes:
1. Introduce DefaultApplicationMain to capture launch workflow for High/Low level jobs so on AM, all jobs are launched in the same way: ClusterBasedJobCoordinatorRunner#main -> app.main.class -> JobCoordinatorLaunchUtil
2. Update ApplicationConfig#getAppMainClass to default to DefaultApplicationMain

Tests:
1. Unit Tests
2. Deployed hello samza job successfully with the change following instructions on http://samza.apache.org/startup/hello-samza/latest/

API Changes: None
Upgrade Instructions: None
Usage Instructions: None
lakshmi-manasa-g pushed a commit to lakshmi-manasa-g/samza that referenced this pull request Feb 9, 2021
…pache#1428)

Issues: app.main.class is only set for Beam apps which causes different workflow on AM when launching a job.
Changes:
1. Introduce DefaultApplicationMain to capture launch workflow for High/Low level jobs so on AM, all jobs are launched in the same way: ClusterBasedJobCoordinatorRunner#main -> app.main.class -> JobCoordinatorLaunchUtil
2. Update ApplicationConfig#getAppMainClass to default to DefaultApplicationMain

Tests:
1. Unit Tests
2. Deployed hello samza job successfully with the change following instructions on http://samza.apache.org/startup/hello-samza/latest/

API Changes: None
Upgrade Instructions: None
Usage Instructions: None
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants