Skip to content
This repository was archived by the owner on Dec 15, 2025. It is now read-only.

supporting multi benchmarks and modules flexible build&&add sort test case#313

Merged
carsonwang merged 10 commits intoIntel-bigdata:6.0from
zybing:6.0
Sep 23, 2016
Merged

supporting multi benchmarks and modules flexible build&&add sort test case#313
carsonwang merged 10 commits intoIntel-bigdata:6.0from
zybing:6.0

Conversation

@zybing
Copy link
Copy Markdown
Contributor

@zybing zybing commented Sep 21, 2016

support multi benchmarks and modules flexible build

  1. For example: mvn clean package -Dbenchmark=sparkbench -Dmodule=micro will only build sparbench/micro module. and the default spark vesion is 1.6 , mvn clean package will default compile all benchmarks and modules
  2. by -Dspark=version to specify the spark version. the old style "-Dspark1.6" has been abandoned. because it has risk to make multi profile activated.
  3. modify the pom inheritance relationship. for example the basic pom.xml has module sparkbench,. and sparkbench/pom.xml has modules: ml micro graph common sql
  4. add basic pom.xml to flinkbench hadoopbench stormbench samzabench gearpunpbench modules.

@zybing zybing changed the title supporting multi benchmarks and modules flexible build supporting multi benchmarks and modules flexible build&&add sort test case Sep 22, 2016
@zybing
Copy link
Copy Markdown
Contributor Author

zybing commented Sep 22, 2016

add sort test case

@zybing
Copy link
Copy Markdown
Contributor Author

zybing commented Sep 22, 2016

after this commit, we can specify multi benchmarks and modules in one maven line.
like this mvn clean package -Psparkbench,flinkbench -Pmicro,ml -Dspark=1.6
the code mvn clean package will build all benchmarks and modules with spark1.6

@carsonwang
Copy link
Copy Markdown
Collaborator

Looks great! Thanks @zybing !

@carsonwang carsonwang merged commit c925909 into Intel-bigdata:6.0 Sep 23, 2016
carsonwang pushed a commit to carsonwang/HiBench that referenced this pull request Nov 7, 2016
… case (Intel-bigdata#313)

* support multi benchmark/module and more flexible spark version

* sparkbench's pom for multi spark module build

* modify parent and remove mr profiles

* modify parent remove mr profiles

* add basic graph pom file

* add basic pom file

* add basic pom file for other benchmark

* add sort run.sh

* add sort.conf

* flexibl specify benchmark and module
carsonwang pushed a commit that referenced this pull request Nov 8, 2016
… case (#313)

* support multi benchmark/module and more flexible spark version

* sparkbench's pom for multi spark module build

* modify parent and remove mr profiles

* modify parent remove mr profiles

* add basic graph pom file

* add basic pom file

* add basic pom file for other benchmark

* add sort run.sh

* add sort.conf

* flexibl specify benchmark and module
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants