Space paths in Hadoop make error

[geisbruch]

Hi,
I am testing Tachyon with CDH4.3. When I try to load a folder with spaces I get the next error (and the folder isn't loaded)

The folder is a hive time partition folder
./bin/tachyon loadufs tachyon://e-00006658.melicloud.com:19998 hdfs://namenode.melidoop.com:8020 /data/dejavu2
Exception in thread "main" java.io.IOException: InvalidPathException(message:Path /data/dejavu2/ds=2011-05-25 03%3A00%3A00 is invalid.)
at tachyon.master.MasterClient.user_getFileId(MasterClient.java:461)
at tachyon.client.TachyonFS.getFileId(TachyonFS.java:647)
at tachyon.client.TachyonFS.exist(TachyonFS.java:419)
at tachyon.util.UnderfsUtil.getInfo(UnderfsUtil.java:82)
at tachyon.util.UnderfsUtil.main(UnderfsUtil.java:109)
Caused by: InvalidPathException(message:Path /data/dejavu2/ds=2011-05-25 03%3A00%3A00 is invalid.)
at tachyon.thrift.MasterService$user_getFileId_result$user_getFileId_resultStandardScheme.read(MasterService.java:20728)
at tachyon.thrift.MasterService$user_getFileId_result$user_getFileId_resultStandardScheme.read(MasterService.java:20706)
at tachyon.thrift.MasterService$user_getFileId_result.read(MasterService.java:20650)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at tachyon.thrift.MasterService$Client.recv_user_getFileId(MasterService.java:739)
at tachyon.thrift.MasterService$Client.user_getFileId(MasterService.java:726)
at tachyon.master.MasterClient.user_getFileId(MasterClient.java:459)
... 4 more

Looging a Little, I trace the error to here: https://github.com/amplab/tachyon/blob/master/main/src/main/java/tachyon/util/CommonUtils.java#L543

Thanks,
Gabriel.

[haoyuan]

Hi Gabriel,

Thanks for reporting this. We are working on this issue. This PR is the
first part to fix it: #227

Thanks,

Haoy

On Tue, Jul 1, 2014 at 7:07 PM, geisbruch notifications@github.com wrote:

Hi,
I am testing Tachyon with CDH4.3. When I try to load a folder with spaces
I get the next error (and the folder isn't loaded)

The folder is a hive time partition folder
./bin/tachyon loadufs tachyon://e-00006658.melicloud.com:19998 hdfs://
namenode.melidoop.com:8020 /data/dejavu2
Exception in thread "main" java.io.IOException:
InvalidPathException(message:Path /data/dejavu2/ds=2011-05-25 03%3A00%3A00
is invalid.)
at tachyon.master.MasterClient.user_getFileId(MasterClient.java:461)
at tachyon.client.TachyonFS.getFileId(TachyonFS.java:647)
at tachyon.client.TachyonFS.exist(TachyonFS.java:419)
at tachyon.util.UnderfsUtil.getInfo(UnderfsUtil.java:82)
at tachyon.util.UnderfsUtil.main(UnderfsUtil.java:109)
Caused by: InvalidPathException(message:Path /data/dejavu2/ds=2011-05-25
03%3A00%3A00 is invalid.)
at
tachyon.thrift.MasterService$user_getFileId_result$user_getFileId_resultStandardScheme.read(MasterService.java:20728)
at
tachyon.thrift.MasterService$user_getFileId_result$user_getFileId_resultStandardScheme.read(MasterService.java:20706)
at
tachyon.thrift.MasterService$user_getFileId_result.read(MasterService.java:20650)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at
tachyon.thrift.MasterService$Client.recv_user_getFileId(MasterService.java:739)
at
tachyon.thrift.MasterService$Client.user_getFileId(MasterService.java:726)
at tachyon.master.MasterClient.user_getFileId(MasterClient.java:459)
... 4 more

Looging a Little, I trace the error to here:
https://github.com/amplab/tachyon/blob/master/main/src/main/java/tachyon/util/CommonUtils.java#L543

Thanks,
Gabriel.

—
Reply to this email directly or view it on GitHub
#229.

[geisbruch]

Haoy,
Thank you for the response, Today I will try to test this PR.

Gabriel.

[geisbruch]

Hi Haoy,
I've checked the problem with your fork/branch and I have the same issue, Looking into your code I found that CommonUtils still checking space as invalid path.

https://github.com/uronce-cc/tachyon/blob/stringToPath/main/src/main/java/tachyon/util/CommonUtils.java#L541

Thanks,
Gabriel.

[haoyuan]

Yea. That's the first step to address the issue. After merging that PR, we
will replace strings in the code to fix the issue.

Haoyuan

On Wed, Jul 2, 2014 at 6:56 AM, geisbruch notifications@github.com wrote:

Hi Haoy,
I've checked the problem with your fork/branch and I have the same issue,
Looking into your code I found that CommonUtils still checking space as
invalid path.

https://github.com/uronce-cc/tachyon/blob/stringToPath/main/src/main/java/tachyon/util/CommonUtils.java#L541

Thanks,
Gabriel.

—
Reply to this email directly or view it on GitHub
#229 (comment).

[haoyuan]

Tracking in JIRA: https://tachyon.atlassian.net/browse/TACHYON-14?jql=project%20%3D%20TACHYON