Problem with curl

[FallDi]

Hello!

We are often got some errors
2015-03-14 15:43:39 0.21587300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 15:43:51 0.53412100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 15:44:18 0.27215200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 15:56:33 0.21471500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 15:57:19 0.56658900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 15:57:41 0.40475400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 16:00:12 0.43175000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 16:03:14 0.83226900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 16:04:49 0.08834600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-14 16:06:24 0.59697500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users

Code 60 in curl_d.php define ('CURLE_SSL_CACERT', 60);
And also such errors 2015-03-12 11:13:23 0.80077600 [5822]: Internal error - [curl] 51: SSL: certificate subject name '.nextpoint.com' does not match target host name 'api.intercom.io' [url] https://api.intercom.io/users
2015-03-12 11:14:05 0.65313000 [5822]: Internal error - [curl] 51: SSL: certificate subject name '.nextpoint.com' does not match target host name 'api.intercom.io' [url] https://api.intercom.io/users
2015-03-12 11:16:04 0.51287700 [5822]: Internal error - [curl] 51: SSL: certificate subject name '.nextpoint.com' does not match target host name 'api.intercom.io' [url] https://api.intercom.io/users
2015-03-12 11:16:31 0.15936900 [5822]: Internal error - [curl] 51: SSL: certificate subject name '.nextpoint.com' does not match target host name 'api.intercom.io' [url] https://api.intercom.io/users
2015-03-12 11:16:48 0.96651500 [5822]: Internal error - [curl] 51: SSL: certificate subject name '*.nextpoint.com' does not match target host name 'api.intercom.io' [url] https://api.intercom.io/users

[bscanlan]

Hi,

The error strongly indicates that a non-Intercom endpoint is being attempted to be used here. It looks like curl/SSL is doing the right thing here. There are a few possibilities of why this may be the case.

1. Your servers have badly configured DNS, perhaps with nextpoint.com in the search path, and are ending up at an incorrect endpoint.
2. I noticed that secure.nextpoint.com is an AWS ELB, just like api.intercom.io is. Perhaps stale or inappropriately cached data is being used to determine api.intercom.io's IP.

I think the most likely answer is 2. It'd be interesting to know how frequently this happens and what you do to resolve the problem. I bet it's client side caching of DNS, well beyond the 60 second TTL and that a process restart / re-resolution of the DNS entry sorts things out?

Brian.

[FallDi]

Thanks for reply! I also think that problem in DNS but i don't know how fix in in DNS =(
I temporary fix problem I add into file
Intercom/intercom/vendor/guzzle/guzzle/src/Guzzle/Http/Client.php

in function prepareRequest this line
$this->config->set(self::CURL_OPTIONS, [CURLOPT_SSL_VERIFYPEER => false]);

[bscanlan]

I strongly recommend that you do not disable verification of SSL peers. SSL verification was (correctly) stopping your client from sending data to hosts that are not controlled by Intercom.

If you could supply more information about the frequency and timeline of these problems and your configuration (phpinfo(), information about the environment you're running in) it would help us debug and/or recommend some settings.

At the very least, check that CURLOPT_DNS_CACHE_TIMEOUT is not set to something non-standard, and maybe look at reducing it.

[FallDi]

I see in our logs what error occur during March every day (maybe earlier). It reproduced every two minutes, and in the result we lost about 10% api requests =(

My phpinfo() - we run php as CLI http://zaic101.ru/files/1221/php_info.txt (i remove this file after 20 minutes because i I'm afraid to disclose private information)

2015-03-18 09:29:36 0.88362600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:31:40 0.07634700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:32:17 0.36748700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:34:04 0.69106600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:38:15 0.86820600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:38:31 0.15785100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:38:40 0.43103600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:39:55 0.50253100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:40:01 0.97808500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:40:19 0.64799000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:42:07 0.08431700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:42:51 0.29300500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:45:00 0.45988300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:45:18 0.06863500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:45:27 0.18561700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:47:58 0.08410200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:48:24 0.74818700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:50:09 0.11304300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:50:30 0.52376800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:51:50 0.06909800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:51:57 0.23477200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:54:17 0.86387600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:55:28 0.43113500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 09:59:33 0.89279900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:00:10 0.64374600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:01:57 0.87608900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:05:03 0.20727300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:05:40 0.41543000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:06:59 0.31804600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:07:18 0.91368100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:10:30 0.15320100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:10:53 0.93617600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:11:19 0.39159300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:12:03 0.47300000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:12:12 0.05951800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:13:01 0.39932900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:13:28 0.99611200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:13:44 0.96841400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:14:08 0.42943600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:14:17 0.71596100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:16:00 0.11285800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:18:19 0.09908300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:18:39 0.98252600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:18:42 0.61071400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:19:24 0.70673900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:20:02 0.56238100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:22:32 0.38398700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:24:02 0.43536500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:24:18 0.61512200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:25:37 0.34474300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:26:25 0.67624700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:26:49 0.79172700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:27:53 0.97148000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:27:59 0.77836400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:28:47 0.86462600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:29:15 0.65726600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:29:43 0.60732300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:29:44 0.41352100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:31:51 0.13105400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:32:27 0.82944900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:33:10 0.24607300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:33:18 0.90452400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:33:38 0.38948300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:34:05 0.64132600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:34:15 0.93345700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:34:16 0.34959600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:35:17 0.25541000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:35:51 0.10460100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:36:14 0.44918100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:37:55 0.96467800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:38:11 0.07054600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:38:45 0.38203700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:41:16 0.13664300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:41:38 0.58644400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:42:13 0.99729500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:42:23 0.91152300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:48:42 0.89954700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:51:11 0.85236600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:52:17 0.57137400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:52:50 0.87405000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:53:43 0.80087200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:54:17 0.13482800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:58:11 0.20944600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:58:32 0.20161600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:58:51 0.31494200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 10:58:58 0.97003800 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:00:10 0.69271400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:01:25 0.77510200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:02:32 0.67706500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:02:51 0.14339300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:03:06 0.88249000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:03:23 0.93020700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:03:58 0.79889700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:03:59 0.23312200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:05:04 0.59064600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:05:38 0.88856000 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:09:26 0.11697900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:10:43 0.43056900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:11:56 0.38936600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:12:04 0.97812400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:12:28 0.99130600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:19:15 0.04709500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:19:59 0.44013900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:20:07 0.34090900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:22:49 0.53303100 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:23:18 0.66640700 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:24:24 0.82679300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:26:33 0.06745600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:28:13 0.56762300 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:29:03 0.46797200 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:30:51 0.14756500 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:31:57 0.65017600 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:34:09 0.93592400 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users
2015-03-18 11:35:21 0.16396900 [5822]: Internal error - [curl] 60: [url] https://api.intercom.io/users

[bscanlan]

Feel free to remove the phpinfo(), I got it.

[bscanlan]

Is the problem still occurring?

Could you run the following on the host?

for i in {1..100}; do php -r '$foo = gethostbyname("api.intercom.io"); echo "$foo\n";' ; done | sort | uniq -c

for i in {1..100}; do resolveip api.intercom.io ; done | sort | uniq -c

for i in {1..100}; do host -t A api.intercom.io ; done | sort | uniq -c

dig +trace api.intercom.io

cat /etc/resolv.conf

[FallDi]

I hope it help to understand problem
for i in {1..100}; do php -r '$foo = gethostbyname("api.intercom.io"); echo "$foo\n";' ; done | sort | uniq -c
34 184.72.219.239
32 23.23.143.95
34 23.23.226.185

for i in {1..100}; do resolveip api.intercom.io ; done | sort | uniq -c
100 IP address of api.intercom.io is 184.72.219.239
100 IP address of api.intercom.io is 23.23.143.95
100 IP address of api.intercom.io is 23.23.226.185

for i in {1..100}; do host -t A api.intercom.io ; done | sort | uniq -c
100 api.intercom.io has address 184.72.219.239
100 api.intercom.io has address 23.23.143.95
100 api.intercom.io has address 23.23.226.185

dig +trace api.intercom.io

; <<>> DiG 9.8.2rc1-RedHat-9.8.2-0.17.rc1.el6_4.6 <<>> +trace api.intercom.io
;; global options: +cmd
. 0 IN NS a.root-servers.net.
. 0 IN NS b.root-servers.net.
. 0 IN NS c.root-servers.net.
. 0 IN NS d.root-servers.net.
. 0 IN NS e.root-servers.net.
. 0 IN NS f.root-servers.net.
. 0 IN NS g.root-servers.net.
. 0 IN NS h.root-servers.net.
. 0 IN NS i.root-servers.net.
. 0 IN NS j.root-servers.net.
. 0 IN NS k.root-servers.net.
. 0 IN NS l.root-servers.net.
. 0 IN NS m.root-servers.net.
. 0 IN NS b.root-servers.net.
. 0 IN NS c.root-servers.net.
. 0 IN NS d.root-servers.net.
. 0 IN NS e.root-servers.net.
. 0 IN NS f.root-servers.net.
. 0 IN NS g.root-servers.net.
. 0 IN NS h.root-servers.net.
. 0 IN NS i.root-servers.net.
. 0 IN NS j.root-servers.net.
. 0 IN NS k.root-servers.net.
. 0 IN NS l.root-servers.net.
. 0 IN NS m.root-servers.net.
. 0 IN NS a.root-servers.net.
;; Received 397 bytes from 192.168.100.1#53(192.168.100.1) in 231 ms

io. 172800 IN NS a.nic.io.
io. 172800 IN NS ns3.icb.co.uk.
io. 172800 IN NS ns1.communitydns.net.
io. 172800 IN NS b.ns13.net.
io. 172800 IN NS b.nic.io.
io. 172800 IN NS b.nic.ac.
io. 172800 IN NS a.ns13.net.
;; Received 357 bytes from 198.41.0.4#53(198.41.0.4) in 287 ms

intercom.io. 86400 IN NS ns-1478.awsdns-56.org.
intercom.io. 86400 IN NS ns-661.awsdns-18.net.
intercom.io. 86400 IN NS ns-97.awsdns-12.com.
intercom.io. 86400 IN NS ns-1867.awsdns-41.co.uk.
;; Received 172 bytes from 91.208.95.130#53(91.208.95.130) in 335 ms

api.intercom.io. 60 IN A 23.23.226.185
api.intercom.io. 60 IN A 184.72.219.239
api.intercom.io. 60 IN A 23.23.143.95
intercom.io. 172800 IN NS ns-1478.awsdns-56.org.
intercom.io. 172800 IN NS ns-1867.awsdns-41.co.uk.
intercom.io. 172800 IN NS ns-661.awsdns-18.net.
intercom.io. 172800 IN NS ns-97.awsdns-12.com.
;; Received 220 bytes from 205.251.199.75#53(205.251.199.75) in 3 ms

cat /etc/resolv.conf
; generated by /sbin/dhclient-script
search local
nameserver 192.168.100.1

Then i'm add CURLOPT_SSL_VERIFYPEER => false problem not occur during two days

[bscanlan]

Thanks for the info. The output is all normal. Again, don't turn on CURLOPT_SSL_VERIFYPEER - it could mean you are sending your customer information to random third parties.

Please repeat the commands above if the problem reoccurs.