rhdfs.init() failure #128

Open
centiteo opened this Issue Aug 31, 2012 · 5 comments

Projects

None yet

3 participants

@centiteo

I have successfully installed rhdfs in R over hadoop cluster. But when I invoke hdfs.init(), it complains with:

/usr/lib64/Revo-6.0/R-2.14.2/lib64/R/lib/libExaCore.so.1(_Z21CriticalSignalHandleri+0x1e)[0x7f05695ca75e]
/usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(+0x71158d)[0x7f056d4f158d]
/usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(+0x70e4db)[0x7f056d4ee4db]
/usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(JVM_handle_linux_signal+0x170)[0x7f056d4f2040]
/usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(+0x70e3ee)[0x7f056d4ee3ee]
/lib64/libpthread.so.0(+0xf4a0)[0x7f0577d434a0]
[0x7f04cd05e4d3]

I cannot figure out what was the problem. Could you please help to look at it? Thanks!

@RevolutionAnalytics

Hi,

can you tell me what version of Hadoop you are using? Also, can you tell me what your HADOOP_CMD environment variable value is?

Thanks

David

@RevolutionAnalytics

Can you also check the namenode and/or datanode logs to see if there are any errors or stack traces

@centiteo
@centiteo

Sometimes, when I type the following commands, it will be okay:
"
library(rhdfs)
Loading required package: rJava

HADOOP_CMD=/usr/lib/hadoop/bin/hadoop

Be sure to run hdfs.init()
hdfs.ls()
Error in .jcall("java/lang/Class", "Ljava/lang/Class;", "forName", cl, :
No running JVM detected. Maybe .jinit() would help.
Error in .jfindClass(as.character(class)) :
No running JVM detected. Maybe .jinit() would help.
hdfs.init()
Warning: $HADOOP_HOME is deprecated.

"

I have installed R and rhdfs on all hadoop nodes, set all HADOOP_CMD env. Also I randomly choose a node to run the R console.

@yugi2245

Hi All,

I too face the same issue and resolved by reconfiguring the Java for R by simple command in Linux CentOS 6.2.

$R CMD javareconf

Thanks,
Yugandhar

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment