BasePath not found error when connecting flow from Direct I/O input to WindGate output directly #235

Closed
akirakw opened this Issue Jul 31, 2012 · 0 comments

Comments

Projects
None yet
2 participants
Owner

akirakw commented Jul 31, 2012

When connecting flow from Direct I/O input to WindGate output directly, failed job with following stacktrace.

12/07/31 10:38:40 ERROR security.UserGroupInformation: PriviledgedActionException as:asakusa (auth:SIMPLE) cause:java.io.IOException: A mandatory attribute "basePath" is not defined (path=__DIRECTIO__/ukebarai/bakery/input)
java.io.IOException: A mandatory attribute "basePath" is not defined (path=__DIRECTIO__/ukebarai/bakery/input)
    at com.asakusafw.runtime.stage.input.BridgeInputFormat.extract(BridgeInputFormat.java:237)
    at com.asakusafw.runtime.stage.input.BridgeInputFormat.extractBasePath(BridgeInputFormat.java:175)
    at com.asakusafw.runtime.stage.input.BridgeInputFormat.extractInputList(BridgeInputFormat.java:157)
    at com.asakusafw.runtime.stage.input.BridgeInputFormat.getSplits(BridgeInputFormat.java:95)
    at com.asakusafw.runtime.stage.input.StageInputFormat.computeSplits(StageInputFormat.java:106)
    at com.asakusafw.runtime.stage.input.StageInputFormat.getSplits(StageInputFormat.java:70)
    at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:950)
    at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:967)
    at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:476)
    at com.asakusafw.runtime.stage.AbstractStageClient.submit(AbstractStageClient.java:257)
    at com.asakusafw.runtime.stage.AbstractStageClient.execute(AbstractStageClient.java:220)
    at com.asakusafw.runtime.stage.BaseStageClient.run(BaseStageClient.java:108)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at com.asakusafw.runtime.stage.ToolLauncher.main(ToolLauncher.java:87)
    at com.asakusafw.runtime.stage.ToolLauncher.main(ToolLauncher.java:66)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

ashigeru was assigned Jul 31, 2012

ashigeru closed this in 061696e Jul 31, 2012

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment