-
Notifications
You must be signed in to change notification settings - Fork 762
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
hivebench #73
Comments
I'm quite confused what's your goal? Run hivebench concurrently or just run workload join or aggregation only once at a time? If you prefer the latter, no metastore service need to be run. Make sure you do the maven download first and clean derby folders if needed, then do the preparing and running. |
Hello thank you for the reply.I want to run both join and aggregation
2.What is the command to clean derby folders. A simple /HiBench/bin 3.Running prepare-concurrent.sh produces "command not found". Am i missing On Sun, Dec 21, 2014 at 9:01 PM, Neo Qian notifications@github.com wrote:
|
|
I don't know why hivebench is getting failure. I re-installed but problem On Mon, Dec 22, 2014 at 10:25 PM, Neo Qian notifications@github.com wrote:
|
Can you display the error info during |
Sir below is the error info during mvm oprocess-sources [INFO][INFO] Reactor Summary: [INFO][INFO] BUILD FAILURE [INFO][INFO] Total time: 14.650s [INFO][ERROR] Failed to execute goal On Tue, Dec 23, 2014 at 7:38 PM, Neo Qian notifications@github.com wrote:
|
Maybe you can change a repo by modifying |
Sir, On Tue, Dec 30, 2014 at 9:20 PM, Neo Qian notifications@github.com wrote:
|
I located to hivebench/bin folder and I did run prepare.sh but i got On Wed, Dec 31, 2014 at 12:42 PM, koffi Dossou kofdossou@gmail.com wrote:
|
I located to hivebench/bin folder and I did run prepare.sh but i got On Wed, Dec 31, 2014 at 12:52 PM, koffi Dossou kofdossou@gmail.com wrote:
|
You should use |
ok I got it after i run ./prepare.sh. looks like am getting a new error On Sun, Jan 4, 2015 at 8:29 PM, Daoyuan Wang notifications@github.com
|
You should set your HADOOP_HOME in hibench-config.sh before run hibench. |
After I set my HADOOP_HOME in hibench-config.sh am still getting error **below is how i set my paths in echo JAVA_HOME=${JAVA_HOME:?/usr/lib/jvm/java-7-oracle} On Mon, Jan 5, 2015 at 3:38 AM, Daoyuan Wang notifications@github.com
|
you are pointing to the wrong HADOOP_EXECUTABLE, this should be at HADOOP_HOME/bin/hadoop |
Sir, Am still getting new error even after pointing HADOOP_EXECUTABLE ubuntu@master: On Tue, Jan 6, 2015 at 8:46 PM, Daoyuan Wang notifications@github.com
|
You have to set HADOOP_HOME first... |
I did set HADOOP_HOME by pointing it to my hadoop location which is export JAVA_HOME=/usr/lib/jvm/java-7-oracle On Wed, Jan 7, 2015 at 7:30 PM, Daoyuan Wang notifications@github.com
|
you are setting all of these wrong... export JAVA_HOME=/usr/lib/jvm/java-7-oracle |
Sir honestly speaking i followed your instruction in your previous e-mail On Wed, Jan 7, 2015 at 8:41 PM, Daoyuan Wang notifications@github.com
|
oh, I missed a slash there, sorry. |
works now but after running ./prepare.sh and then ./run-aggregation.sh.i Warning: $HADOOP_HOME is deprecated. Warning: $HADOOP_HOME is deprecated. JAVA_HOME=/usr/lib/jvm/java-7-oracle Warning: $HADOOP_HOME is deprecated. Warning: $HADOOP_HOME is deprecated. JAVA_HOME=/usr/lib/jvm/java-7-oracle On Thu, Jan 8, 2015 at 11:44 PM, Daoyuan Wang notifications@github.com
|
@qiansl127 Can you take a look? |
Please check if |
I have a working hive on my cluster that I use regularly but locating to . Index of /apache/hiveName Last modified Size Description |
If you want to use your own hive bin, you can modify |
Should my HIVE_RELEASE be set to my Hive path which is /home/ubuntu/hive? On Sun, Jan 11, 2015 at 7:45 PM, Neo Qian notifications@github.com wrote:
|
Am still getting the same error I think am not setting the path to Hive JAVA_HOME=/usr/lib/jvm/java-7-oracle **hivebench.config.sh On Tue, Jan 13, 2015 at 6:09 AM, koffi Dossou kofdossou@gmail.com wrote:
|
@qiansl127 https://github.com/qiansl127 Hello Qian and Wang, On Wed, Jan 14, 2015 at 5:45 AM, koffi Dossou kofdossou@gmail.com wrote:
|
Can you use HIVE_HOME instead of HIVE_PREFIX? |
oh yeah i changed it back to HIVE_HOME and still error exit. i think the On Thu, Jan 15, 2015 at 8:18 PM, Daoyuan Wang notifications@github.com
|
You should set HIVE_HOME in hibench-config.sh, instead of your bashrc. |
This is how I set it in hivebench.config.sh (below). The bashrc i showed On Thu, Jan 15, 2015 at 11:38 PM, Daoyuan Wang notifications@github.com
|
I think you need to remove |
Ok I did that . After I removed export
org.apache.maven.project.DefaultProjectBuilder.build(DefaultProjectBuilder.java:363) gException On Fri, Jan 16, 2015 at 11:27 AM, Daoyuan Wang notifications@github.com
|
This is what I changed in * On Fri, Jan 16, 2015 at 1:44 PM, koffi Dossou kofdossou@gmail.com wrote:
|
If you decide to use your own hive, then leave the mvn command, that is meant to download a hive and some other dependencies for other workloads. |
I run ./run-aggregation.sh and had an output but how do I make sense of ubuntu@master:~/HiBench/hivebench/bin$ ./run-aggregation.sh Warning: $HADOOP_HOME is deprecated. Warning: $HADOOP_HOME is deprecated. JAVA_HOME=/usr/lib/jvm/java-7-oracle rm: cannot remove -r: No such file or directory. ommon-0.9.0.jar!/hive-log4j.properties (standard_in) 1: syntax error rm: cannot remove -r: No such file or directory. Warning: $HADOOP_HOME is deprecated. On Tue, Jan 20, 2015 at 12:36 AM, Daoyuan Wang notifications@github.com
|
did you run prepare before you run aggregation? |
Is there any update? |
Everything is working great. Upon configuring additional nodes of 4 - 16 On Fri, Feb 13, 2015 at 12:04 AM, Daoyuan Wang notifications@github.com
|
If the data set is not so large but you force it to run on a large cluster, there would be too much networking and IO consuming. Since the origin issue is gone, I am going to close this one. |
[INFO] Reactor Summary: How to solve this?? Please give your valuable suggession........ |
@attu-mittu , please open a new issue for any issue you encounter next time. |
okay thank you. :) |
How do I run hivebench to view results according to SIGMOD paaper? I also did run hive --service metastore to establish concurrency as stated.The command /HiBench/hivebench/conf$ configure.sh
configure.sh: command not found
Am benchmarking hivebench for a my Master projects. Please any input as to what am doing wrong is appreciated.
The text was updated successfully, but these errors were encountered: