New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tornado_fetcher:364: curl error 599: couldn't connect to host #93

Closed
omkar0001 opened this Issue Jan 24, 2015 · 10 comments

Comments

Projects
None yet
2 participants
@omkar0001

omkar0001 commented Jan 24, 2015

This error comes when using phantomjs fetcher.

@binux

This comment has been minimized.

Owner

binux commented Jan 24, 2015

Did phantomjs fetcher start successfully?
Run pyspider phantomjs, you should find logs like Web server running on port 25555

@omkar0001

This comment has been minimized.

omkar0001 commented Jan 24, 2015

Hi, phantomjs fetcher started successfully. Also when i ran pyspider phantomjs its showing web server running on port 25555

@binux

This comment has been minimized.

Owner

binux commented Jan 24, 2015

Can you connect to phantomjs via http://localhost:25555/, i.e. 127.0.0.1 localhost in /ets/hosts

@omkar0001

This comment has been minimized.

omkar0001 commented Jan 24, 2015

Hey hi sorry. Actually, i kept my custom port number for phantomjs proxy, thats the reason its failing. Do you know what are the requirements for custom port number to act like phantomjs proxy?. Also, i need to set xmlrpc to false for it to work. But it was no where mentioned in the doc. Can you please add it to the doc.

@binux

This comment has been minimized.

Owner

binux commented Jan 24, 2015

How do you run pyspider?
Just command pyspider which is all mode or running each components like pyspider fetcher?

Maybe you have to set --phantomjs-proxy TEXT phantomjs proxy ip:port in global config: http://docs.pyspider.org/en/latest/Command-Line/#global-config

@omkar0001

This comment has been minimized.

omkar0001 commented Jan 24, 2015

I run the following command pyspider -c config.json all

@binux

This comment has been minimized.

Owner

binux commented Jan 24, 2015

what's the content of config.json? and the version of pyspider

@omkar0001

This comment has been minimized.

omkar0001 commented Jan 24, 2015

Hi,
This is the content
{
"taskdb": "mysql+taskdb://root:xxxx@localhost:3306/taskdb",
"projectdb": "mysql+projectdb://root:xxxx@localhost:3306/projectdb",
"resultdb": "mysql+resultdb://root:xxxx@localhost:3306/resultdb",
"fetcher": {
"xmlrpc": false
}
}

@binux

This comment has been minimized.

Owner

binux commented Jan 24, 2015

You didn't specify the port of phantomjs.

"phantomjs": {"port": 2333}
@omkar0001

This comment has been minimized.

omkar0001 commented Jan 24, 2015

I thought it will there by default. I mean it will consider by default.

@omkar0001 omkar0001 closed this Jan 29, 2015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment