New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fscrawler doesn't work on windows #289

Closed
xsallowed opened this Issue Jan 26, 2017 · 22 comments

Comments

Projects
None yet
3 participants
@xsallowed

xsallowed commented Jan 26, 2017

when ever i try to fscralwer in windows it gives an error saying:

"The system cannot find the path specified."

Help needed!!!

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Jan 26, 2017

Can you try the SNAPSHOT version? There is a link in the readme file?

Is this message appears when you try to launch FSCrawler? Or later in logs?

@xsallowed

This comment has been minimized.

xsallowed commented Jan 26, 2017

I am using 2.0.0 but i tried 2.1 as well and both versions gave the same error.

It appears on the screen immediately i run fscrawler. I think i doesnt even invoke java and i get the error

image

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Jan 26, 2017

Can you try 2.2-SNAPSHOT?

Just want to make sure it still appears in recent version.

@xsallowed

This comment has been minimized.

xsallowed commented Jan 26, 2017

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Jan 26, 2017

https://github.com/dadoonet/fscrawler#download-fscrawler (look at the bottom of this section)

@xsallowed

This comment has been minimized.

xsallowed commented Jan 26, 2017

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Jan 26, 2017

Ok thank you!

I now need to start a VM and fix that I guess :)

@dadoonet dadoonet self-assigned this Jan 26, 2017

@dadoonet dadoonet added the bug label Jan 26, 2017

@dadoonet dadoonet added this to the 2.2 milestone Jan 26, 2017

@xsallowed

This comment has been minimized.

xsallowed commented Jan 26, 2017

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Jan 30, 2017

I did not reproduce on a Windows VM.

Can you copy here the result of set in a cmd shell?

@dadoonet dadoonet removed this from the 2.2 milestone Jan 31, 2017

@dadoonet dadoonet added wait for feedback and removed bug labels Jan 31, 2017

@ploncker

This comment has been minimized.

ploncker commented Feb 9, 2017

having the same issue on win10 fscrawler2.2 I can send you the output from set, just cant post in public

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Feb 9, 2017

@ploncker yes please. david at pilato dot fr

@xsallowed

This comment has been minimized.

xsallowed commented Feb 9, 2017

I am sorry david
I did not see your earlier response though i was waiting for a solution. I will send you my set output in sometime, in case if ploncker has already sent please suggest the problem and solution

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Feb 9, 2017

For now I think you didn't set JAVA_HOME.

Did you?

@ploncker

This comment has been minimized.

ploncker commented Feb 9, 2017

after setting the JAVA_HOME for version 2.2 I get nothing, it hangs.
For version 2.1 I'm getting this error:

Exception in thread "main" java.nio.file.NoSuchFileException: C:\Users\usr\.fscrawler\test\_settings.json
at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:79)
at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97)
at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102)
at sun.nio.fs.WindowsFileSystemProvider.newByteChannel(WindowsFileSystemProvider.java:230)
at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
at java.nio.file.Files.newOutputStream(Files.java:216)
at java.nio.file.Files.write(Files.java:3292)
at fr.pilato.elasticsearch.crawler.fs.meta.MetaFileHandler.writeFile(MetaFileHandler.java:80)
at fr.pilato.elasticsearch.crawler.fs.meta.settings.FsSettingsFileHandler.write(FsSettingsFileHandler.java:56)
at fr.pilato.elasticsearch.crawler.fs.FsCrawler.main(FsCrawler.java:181)

@ploncker

This comment has been minimized.

ploncker commented Feb 9, 2017

Okay, I created the directory and that fixed the problem.

@ploncker

This comment has been minimized.

ploncker commented Feb 9, 2017

Okay I have Xpack installed which requires a login to elasticsearch. Is there a way to pass a usr and passwd with fscrawler to access elasticsearch?

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Feb 10, 2017

Yes there is but there is a bug currently reading the password from the CLI.
I need to fix it ASAP.

#312

@dadoonet dadoonet added bug doc and removed wait for feedback labels Feb 10, 2017

@dadoonet dadoonet added this to the 2.3 milestone Feb 10, 2017

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Feb 10, 2017

Thanks for confirming it was JAVA_HOME. I'll try to detect it in the bat script and document it as well.

@ploncker

This comment has been minimized.

ploncker commented Feb 10, 2017

Now getting:

Error while indexing content from [java.io.IOException: no active node found. Start an elasticsearch cluster first! Expecting something running at [127.0.0.1:9200]

But ES is up. I can pass curl commands to it, and it responds appropriately

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Feb 10, 2017

With xpack?

@xsallowed

This comment has been minimized.

xsallowed commented Feb 12, 2017

This solved my problem !!! feeling embarrassed though, i should have seen that at the first place :P

JAVA_HOME

@dadoonet

This comment has been minimized.

Owner

dadoonet commented Feb 12, 2017

I need to detect or document it. That's why I'm leaving this issue opened.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment