Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
[repository-hdfs] java.io.IOException: Filesystem closed #174
I am using
The very first time when it runs everything is OK. After I kill the process and run again, I got the exception pasted below. If I delete the
If I use a repository on local filesystem there is no such problem.
Thanks for outstanding project!
@zhangxiao Hi. The error indicates that you're using a Hadoop file-system which has been previously closed. The (HDFS) file system is closed at shutdown by the plugin which typically happens along side elasticsearch itself.
You mention that you are 'killing' elasticsearch - can you verify that the close is graceful? DistributedFileSystem has some files which are closed on process exit - if that doesn't occur (for whatever reason) then HDFS might act out.
I've tried replicating your use case but I couldn't. Also looking at the Hadoop code numbers it seems you are no running Hadoop 1.2.1 or 2.2.x
Can you confirm your Hadoop distribution, your plugin configuration and the basic actions to replicate this error? The smaller it is, the sooner I can replicate it.