Skip to content

Fix typo#1312

Closed
kw2542 wants to merge 18 commits into
apache:masterfrom
kw2542:master
Closed

Fix typo#1312
kw2542 wants to merge 18 commits into
apache:masterfrom
kw2542:master

Conversation

@kw2542
Copy link
Copy Markdown
Contributor

@kw2542 kw2542 commented Mar 11, 2020

getAppMainArgs & getAppMainClass are reversed.

Ke Wu and others added 18 commits February 25, 2020 13:47
Design:
https://cwiki.apache.org/confluence/display/SAMZA/SEP-23%3A+Simplify+Job+Runner

Changes:
1. Simplify CommandLine by removing unnecessary arguments.

API Changes:
1. config-loader-factory removed in CommandLine
2. config-loader-properties removed in CommandLine

Upgrade Instruction:
1. Usage of --config-factory and --config-loader-factory will be switched to --config job.config.loader.factory
2. Usage of --config-path and --config-loader-properties will be switched to --config job.config.loader.properties

Usage Instruction

--config-factory=org.apache.samza.config.factories.PropertiesConfigFactory --config-path=file:///location/file.txt
and
--config-loader-factory=org.apache.samza.config.loaders.PropertiesConfigLoaderFactory --config-loader-properties path=file:///location/file.txt
will be updated to
--config job.config.loader.factory=org.apache.samza.config.loaders.PropertiesConfigLoaderFactory --config job.config.loader.properties.path=file:///location/file.txt

Tests

1. Unit tests
2. Test against Hello Samza example with
deploy/samza/bin/run-app.sh --config job.config.loader.factory=org.apache.samza.config.loaders.PropertiesConfigLoaderFactory --config job.loader.properties.path=$PWD/deploy/samza/config/wikipedia-feed.properties
Design:
https://cwiki.apache.org/confluence/display/SAMZA/SEP-23%3A+Simplify+Job+Runner

Changes:
1. Add app.main.class to ApplicationConfig
2. Add app.main.args to ApplicationConfig

API Changes:

N/A. This is part of a series PRs, detailed information will be provided in the last/main PR.
Upgrade Instructions:
N/A. This is part of a series PRs, detailed information will be provided in the last/main PR.
Usage Instructions:
N/A. This is part of a series PRs, detailed information will be provided in the last/main PR.

Tests:
N/A.
Design:
https://cwiki.apache.org/confluence/display/SAMZA/SEP-23%3A+Simplify+Job+Runner

Changes:

1. Invoke app.main.class with app.main.args when present instead of invoking ClusterBasedJobCoordinator#run

API Changes:

N/A

Upgrade Instructions:

For beam jobs, beam's main class and pipeline options need to passed with app.main.class and app.main.args configs.

Usage Instructions:

Take https://github.com/apache/samza-beam-examples as an example:

1. run-beam-yarn.sh#line 36 will be updated to

exec $(dirname $0)/run-class.sh $1 --config app.main.class=$1 --config app.main.args="--runner=org.apache.beam.runners.samza.SamzaRunner --configOverride=\"$override\" \"${@:2}\""

Tests:
N/A.
getAppMainArgs & getAppMainClass are reversed.
@kw2542 kw2542 closed this Mar 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant