Skip to content
This repository has been archived by the owner on Jun 10, 2024. It is now read-only.

tornado_fetcher:364: curl error 599: couldn't connect to host #93

Closed
omkar0001 opened this issue Jan 24, 2015 · 10 comments
Closed

tornado_fetcher:364: curl error 599: couldn't connect to host #93

omkar0001 opened this issue Jan 24, 2015 · 10 comments

Comments

@omkar0001
Copy link

This error comes when using phantomjs fetcher.

@binux
Copy link
Owner

binux commented Jan 24, 2015

Did phantomjs fetcher start successfully?
Run pyspider phantomjs, you should find logs like Web server running on port 25555

@omkar0001
Copy link
Author

Hi, phantomjs fetcher started successfully. Also when i ran pyspider phantomjs its showing web server running on port 25555

@binux
Copy link
Owner

binux commented Jan 24, 2015

Can you connect to phantomjs via http://localhost:25555/, i.e. 127.0.0.1 localhost in /ets/hosts

@omkar0001
Copy link
Author

Hey hi sorry. Actually, i kept my custom port number for phantomjs proxy, thats the reason its failing. Do you know what are the requirements for custom port number to act like phantomjs proxy?. Also, i need to set xmlrpc to false for it to work. But it was no where mentioned in the doc. Can you please add it to the doc.

@binux
Copy link
Owner

binux commented Jan 24, 2015

How do you run pyspider?
Just command pyspider which is all mode or running each components like pyspider fetcher?

Maybe you have to set --phantomjs-proxy TEXT phantomjs proxy ip:port in global config: http://docs.pyspider.org/en/latest/Command-Line/#global-config

@omkar0001
Copy link
Author

I run the following command pyspider -c config.json all

@binux
Copy link
Owner

binux commented Jan 24, 2015

what's the content of config.json? and the version of pyspider

@omkar0001
Copy link
Author

Hi,
This is the content
{
"taskdb": "mysql+taskdb://root:xxxx@localhost:3306/taskdb",
"projectdb": "mysql+projectdb://root:xxxx@localhost:3306/projectdb",
"resultdb": "mysql+resultdb://root:xxxx@localhost:3306/resultdb",
"fetcher": {
"xmlrpc": false
}
}

@binux
Copy link
Owner

binux commented Jan 24, 2015

You didn't specify the port of phantomjs.

"phantomjs": {"port": 2333}

@omkar0001
Copy link
Author

I thought it will there by default. I mean it will consider by default.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants