Skip to content
This repository was archived by the owner on Dec 15, 2025. It is now read-only.

Add webUI port auto probe & refactor the example jars auto probe #319

Merged
carsonwang merged 2 commits intoIntel-bigdata:6.0from
gcz2022:probe_examples_uiport
Oct 10, 2016
Merged

Add webUI port auto probe & refactor the example jars auto probe #319
carsonwang merged 2 commits intoIntel-bigdata:6.0from
gcz2022:probe_examples_uiport

Conversation

@gcz2022
Copy link
Copy Markdown
Contributor

@gcz2022 gcz2022 commented Sep 26, 2016

Refactor the functions to auto probe example(test) jars, add the function to auto probe Spark master/worker webUI

Comment thread bin/functions/load-config.py Outdated
if result != "":
return result
assert 0, "The pattern " + filename_pattern + \
" matches no files, please set `hibench.hadoop.examples.jar` manually"
Copy link
Copy Markdown
Collaborator

@carsonwang carsonwang Oct 9, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a common method used by multiple callers. Can you correct the error message or show the error message by the caller?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Comment thread bin/functions/load-config.py Outdated
assert spark_home, "`hibench.spark.home` undefined, please fix it and retry"
join = os.path.join
spark_env_file = join(spark_home, "conf/spark-env.sh")
master_port = default_port
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a common method and also used to probe slave's port. Can you rename master_port to a common name like port?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also done in the next commit

@gcz2022 gcz2022 force-pushed the probe_examples_uiport branch from 868d4a8 to b3af352 Compare October 9, 2016 06:39
@carsonwang
Copy link
Copy Markdown
Collaborator

Thanks @gczsjdy !

@carsonwang carsonwang merged commit c1373cb into Intel-bigdata:6.0 Oct 10, 2016
carsonwang pushed a commit to carsonwang/HiBench that referenced this pull request Nov 7, 2016
…el-bigdata#319)

* Refactor the functions to auto probe example(test) jars, add the function to auto probe webUI port number

* Change the variable name to serve more general cases
carsonwang pushed a commit that referenced this pull request Nov 8, 2016
* Refactor the functions to auto probe example(test) jars, add the function to auto probe webUI port number

* Change the variable name to serve more general cases
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants