Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Obscure error messages from the HDFS extension #349

Open
simleo opened this issue Mar 6, 2019 · 1 comment
Open

Obscure error messages from the HDFS extension #349

simleo opened this issue Mar 6, 2019 · 1 comment

Comments

@simleo
Copy link
Member

simleo commented Mar 6, 2019

Some error messages from the HDFS extension are uninformative, e.g.:

>>> hdfs.rm("doesnotexist.txt")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.6/dist-packages/pydoop-2.0a4-py3.6-linux-x86_64.egg/pydoop/hdfs/__init__.py", line 277, in rm
    retval = fs.delete(path_, recursive=recursive)
  File "/usr/local/lib/python3.6/dist-packages/pydoop-2.0a4-py3.6-linux-x86_64.egg/pydoop/hdfs/fs.py", line 346, in delete
    return self.fs.delete(path, recursive)
OSError: [Errno 5] Input/output error
>>> hdfs.rm("foo", recursive=False)
hdfsDelete(path=/user/root/foo, recursive=0): FileSystem#delete error:
(unable to get stack trace for org.apache.hadoop.fs.PathIsNotEmptyDirectoryException exception: ExceptionUtils::getStackTrace error.)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.6/dist-packages/pydoop-2.0a4-py3.6-linux-x86_64.egg/pydoop/hdfs/__init__.py", line 277, in rm
    retval = fs.delete(path_, recursive=recursive)
  File "/usr/local/lib/python3.6/dist-packages/pydoop-2.0a4-py3.6-linux-x86_64.egg/pydoop/hdfs/fs.py", line 346, in delete
    return self.fs.delete(path, recursive)
OSError: [Errno 255] Unknown error 255

Is there anything we can do in the extension code (are we failing to reset errno or something) or is the problem in libhdfs? Needs investigation.

@saveResources-searchSpace

it deletes the file but still throws this error

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants