-
Notifications
You must be signed in to change notification settings - Fork 988
-
Notifications
You must be signed in to change notification settings - Fork 988
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
NPE in HeartBeat.java in development snapshot #148
Comments
in case the task id information is not present, log existing props for better debugging... relates #148
Hi, The error stems due to the lack of a hadoop property that we use to identify the task running. I'm not sure whether Spark sets this or not - it looks like it sets internally when writing to Hadoop but I'm not clear about it being set when reading from Hadoop. The master tries a different property and additionally gives a long error message with all the properties. Can you please post/upload the properties somewhere so I can take a better look at them? Thanks. |
Here is a properties dump from my environment as described in #144
|
Thanks. Either way, please try the latest master and let me know how it goes. Thanks! |
@fedesilva @rbraley guys, if you are available in 2h or so maybe we can connect on IRC to speed things up? Let me know if that works for you guys. |
The last master fixes the NPE. I have succesfully iterated over an RDD. I am now getting this, that does not seem to abort the tasks.
|
Regarding IRC: Ok, I'm online in elasticsearch IRC channel right now as fedesilva and will be available until 23 GMT. |
Can you please try the latest master. This should address the NPE (since the reporting facility seems to be disabled). On 2/24/2014 8:53 PM, federico silva wrote:
|
Cool - see you in a bit (my nick is typically On 2/24/2014 8:57 PM, federico silva wrote:
Costin |
Ok, see you soon. |
As this is fixed, I'm closing the issue. Guys, please continue creating issues if you encounter any problems but do mention the new issue under #151 |
Hi guys #152 is also related to this. I will hang in irc as rbraley for a On Tue, Feb 25, 2014 at 3:25 AM, Costin Leau notifications@github.comwrote:
Ryan Braley | Founder US: +1 (206) 866 5661 |
in case the task id information is not present, log existing props for better debugging... relates #148
Not sure if I am missing something but I thought this error might be upstream. Here is how to repeat.
build.sbt
SimpleApp.scala
Here's the stacktrace
The text was updated successfully, but these errors were encountered: