Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ache Crawl Bug #357

Closed
brittainhard opened this issue Feb 25, 2015 · 2 comments
Closed

Ache Crawl Bug #357

brittainhard opened this issue Feb 25, 2015 · 2 comments

Comments

@brittainhard
Copy link
Contributor

Here's the traceback. It looks like ache is having trouble initiating whatever storage it is using.

>>>>>URL:http://www.gaatw.org/index.php?option=com_content&view=article&id=745:isd-promoting-violence-free-lives-for-women&catid=95:member-profile&Itemid=67 REL:2
>>>RELEV:299.0
www
LOG>crawler_group_3_0>selectUrl() linkServer end(2):http://www.gaatw.org/index.php?option=com_content&view=article&id=745:isd-promoting-violence-free-lives-for-women&catid=95:member-profile&Itemid=67
LOG>crawler_group_3_0>update() linkStorage end(1424816150820)
crawler_group_3_0>after request url
crawler_group_3_0>after check url
crawler_group_3_0>after download data
crawler_group_3_0>after process data
crawler_group_3_0>after check data
R>crawler_group_3_0 send page with http://www.gaatw.org/index.php?option=com_content&view=article&id=745:isd-promoting-violence-free-lives-for-women&catid=95:member-profile&Itemid=67 to TargetStorage .
Erro de comunicacao: Connection refused
Dormindo 5 mls
[24/FEB/2015:22:15:51] [SocketAdapterFactory] [produce] [localhost:1987]
Erro de comunicacao: Connection refused
java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:589)
    at java.net.Socket.connect(Socket.java:538)
    at java.net.Socket.<init>(Socket.java:434)
    at java.net.Socket.<init>(Socket.java:211)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.getSocket(StorageRemoteAdapter.java:78)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.defaultMethod(StorageRemoteAdapter.java:180)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.insert(StorageRemoteAdapter.java:272)
    at focusedCrawler.util.storage.distribution.StorageRemoteAdapterReconnect.insert(StorageRemoteAdapterReconnect.java:183)
    at focusedCrawler.crawler.CrawlerImpl.sendData(CrawlerImpl.java:377)
    at focusedCrawler.crawler.Crawler.run(Crawler.java:313)
--
focusedCrawler.util.distribution.CommunicationException: Connection refused
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.defaultMethod(StorageRemoteAdapter.java:240)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.insert(StorageRemoteAdapter.java:272)
    at focusedCrawler.util.storage.distribution.StorageRemoteAdapterReconnect.insert(StorageRemoteAdapterReconnect.java:183)
    at focusedCrawler.crawler.CrawlerImpl.sendData(CrawlerImpl.java:377)
    at focusedCrawler.crawler.Crawler.run(Crawler.java:313)
crawler_group_3_0:Connection refused
focusedCrawler.crawler.CrawlerException: crawler_group_3_0:Connection refused
    at focusedCrawler.crawler.CrawlerImpl.sendData(CrawlerImpl.java:389)
    at focusedCrawler.crawler.Crawler.run(Crawler.java:313)
java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:589)
    at java.net.Socket.connect(Socket.java:538)
    at java.net.Socket.<init>(Socket.java:434)
    at java.net.Socket.<init>(Socket.java:211)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.getSocket(StorageRemoteAdapter.java:78)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.defaultMethod(StorageRemoteAdapter.java:180)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.insert(StorageRemoteAdapter.java:272)
    at focusedCrawler.util.storage.distribution.StorageRemoteAdapterReconnect.insert(StorageRemoteAdapterReconnect.java:183)
    at focusedCrawler.crawler.CrawlerImpl.sendData(CrawlerImpl.java:377)
    at focusedCrawler.crawler.Crawler.run(Crawler.java:313)
--
focusedCrawler.util.distribution.CommunicationException: Connection refused
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.defaultMethod(StorageRemoteAdapter.java:240)
    at focusedCrawler.util.storage.socket.StorageRemoteAdapter.insert(StorageRemoteAdapter.java:272)
    at focusedCrawler.util.storage.distribution.StorageRemoteAdapterReconnect.insert(StorageRemoteAdapterReconnect.java:183)
    at focusedCrawler.crawler.CrawlerImpl.sendData(CrawlerImpl.java:377)
    at focusedCrawler.crawler.Crawler.run(Crawler.java:313)
@gadgetlabs
Copy link

How did you fix this?

@brittainhard
Copy link
Contributor Author

Going to close this. We managed to solve the problem by deploying our application to another server. We were unable to re-create any of the bugs, or figure out where they were coming from.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants