Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

XML Sitemap Not Found Notification When Sitemap Exists(v151114) #618

Closed
patdumond opened this issue Nov 19, 2015 · 20 comments
Closed

XML Sitemap Not Found Notification When Sitemap Exists(v151114) #618

patdumond opened this issue Nov 19, 2015 · 20 comments

Comments

@patdumond
Copy link

@patdumond patdumond commented Nov 19, 2015

Reference:
https://websharks.zendesk.com/agent/tickets/9511
https://websharks.zendesk.com/agent/tickets/9568
https://websharks.zendesk.com/agent/tickets/9567
https://websharks.zendesk.com/agent/tickets/9573
https://websharks.zendesk.com/agent/tickets/9583

In addition to the five tickets listed above, I've experienced this on four of my sites, including my non-Multisite test site.

After updating ZenCache Pro to v151114, this notification is displayed:

ZenCache says... The Auto-Cache Engine is currently configured with an XML Sitemap location that could not be found. We suggest that you install the Google XML Sitemaps plugin. Or, empty the XML Sitemap field and only use the list of URLs instead. See: Dashboard → ZenCache → Auto-Cache Engine → XML Sitemap URL.

Each of the above users said that they had Google XML Sitemaps installed and I verified that a valid sitemap was found on each site. Same with my four sites except I use Better Google XML Sitemaps. I have been able to get rid of the message on all but 1 of my sites by:

  • deleting the sitemap name
  • saving changes
  • typing the sitemap name back in
  • saving changes

However, I have one site that just refuses to admit that a sitemap exists and a few of the Zendesk users have reported that the above steps did not work for them either.

@raamdev
Copy link
Contributor

@raamdev raamdev commented Nov 19, 2015

@patdumond Thank you very much for documenting this here.

@jaswsinc I have a feeling some of these reports (especially any persistent reports of the XML Sitemap missing when it in fact exists) might be related to misconfigured servers. I've seen a fairly common issue where local DNS is not configured properly which results in the hostname for the site hosted on the server not being accessible from the server. In that scenario, ZenCache would attempt to visit the XML Sitemap and it would timeout/fail, reporting a false error (well, somewhat false; if ZenCache can't load the XML Sitemap, then the Auto-Cache Engine won't be able to find it, which means that not being able to load the XML Sitemap is a problem, no matter the scenario).

We could get more descriptive with why ZenCache failed to locate the XML Sitemap (did it return a 404? was the server unable to resolve the hostname? etc.) and then link to a KB Article that documents explanations for each error (e.g., "contact your web hosting company if your server cannot resolve its own URL"). (There's a GitHub issue open here related to improving that error notice: #616)

@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

@raamdev writes...

We could get more descriptive with why ZenCache failed to locate the XML Sitemap (did it return a 404? was the server unable to resolve the hostname? etc.)

Agree.

@patdumond writes...

However, I have one site that just refuses to admit that a sitemap exists and a few of the Zendesk users have reported that the above steps did not work for them either.

On that site, if you can run the following test it might shed light.

  • Create this PHP test file in the root of your WordPress installation please.
    /xml-sitemap-test.php

    <?php
    require_once dirname(__FILE__).'/wp-load.php';
    header('Content-Type: text/plain; charset=utf-8');
    print_r(wp_remote_request('http://example.com/sitemap.xml'));
  • In the above code snippet, change http://example.com/sitemap.xml to your Sitemap URL.

  • Open http://example.com/xml-sitemap-test.php in a browser and paste the output for us.

  • Delete /xml-sitemap-test.php after you're done.

@raamdev raamdev added this to the Next Release (Pro) milestone Nov 19, 2015
@patdumond
Copy link
Author

@patdumond patdumond commented Nov 19, 2015

Well, I went to run that test on my stubborn site and the message had disappeared. I know it was still there yesterday afternoon, because I logged in specifically to check that before closing up everything for the night.

@ufufufu
Copy link

@ufufufu ufufufu commented Nov 19, 2015

Just run the code above, and below is the output:-

Array
(
    [headers] => Array
        (
            [date] => Thu, 19 Nov 2015 22:42:20 GMT
            [server] => Apache
            [expires] => Thu, 19 Nov 1981 08:52:00 GMT
            [cache-control] => no-store, no-cache, must-revalidate, post-check=0, pre-check=0
            [pragma] => no-cache
            [x-pingback] => https://imouto.my/xmlrpc.php
            [x-robots-tag] => noindex
            [set-cookie] => Array
                (
                    [0] => ct_cookies_test=5566f72b110eb5a7b6503a216e09f6de; path=/
                    [1] => PHPSESSID=f6so1b2b65p7ulmdgpfv9oqur0; path=/
                )

            [strict-transport-security] => max-age=15768000
            [public-key-pins] => max-age=5184000; pin-sha256=2qKyaG0PHPExrUszbEua2SPHmHze8rNa1RNK2pHwfsI=; pin-sha256=Z3TyA+moOEVIq1FRV6C8RAkOJBiX22a80bT3BIs8o80=; pin-sha256=L0YY0bTrFt+E5DCWQYYZq4YSF5ORfMnF4trDzWBjP28=
            [connection] => close
            [content-type] => text/xml; charset=utf-8
        )

    [body] => <?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="https://imouto.my/wp-content/plugins/google-sitemap-generator/sitemap.xsl"?><!-- sitemap-generator-url="http://www.arnebrachhold.de" sitemap-generator-version="4.0.8" -->
<!-- generated-on="19th November 2015 10:42 pm" -->
<sitemapindex xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/siteindex.xsd" xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <sitemap>
        <loc>https://imouto.my/sitemap-misc.xml</loc>
        <lastmod>2015-11-17T05:37:27+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-tax-post_tag.xml</loc>
        <lastmod>2015-11-17T05:37:27+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-tax-category.xml</loc>
        <lastmod>2015-11-17T05:37:27+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2015-08.xml</loc>
        <lastmod>2015-08-16T14:04:17+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2015-06.xml</loc>
        <lastmod>2015-06-10T02:47:50+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2015-05.xml</loc>
        <lastmod>2015-05-13T08:18:37+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2015-04.xml</loc>
        <lastmod>2015-04-17T15:43:33+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2014-11.xml</loc>
        <lastmod>2014-11-20T16:26:45+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2014-10.xml</loc>
        <lastmod>2014-10-25T10:54:46+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2014-09.xml</loc>
        <lastmod>2014-10-04T10:48:38+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2014-06.xml</loc>
        <lastmod>2014-06-13T15:26:13+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2014-05.xml</loc>
        <lastmod>2014-05-31T11:06:23+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2014-04.xml</loc>
        <lastmod>2014-06-08T05:53:51+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-11.xml</loc>
        <lastmod>2014-04-03T15:22:10+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-10.xml</loc>
        <lastmod>2013-10-14T07:56:44+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-08.xml</loc>
        <lastmod>2013-08-21T08:25:55+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-07.xml</loc>
        <lastmod>2013-07-31T14:13:53+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-06.xml</loc>
        <lastmod>2013-06-06T04:01:49+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-05.xml</loc>
        <lastmod>2013-05-27T16:19:40+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-02.xml</loc>
        <lastmod>2013-05-16T02:58:21+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2013-01.xml</loc>
        <lastmod>2013-08-04T07:10:32+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-12.xml</loc>
        <lastmod>2012-12-03T12:01:59+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-11.xml</loc>
        <lastmod>2012-11-21T08:01:26+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-10.xml</loc>
        <lastmod>2012-10-26T05:44:07+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-09.xml</loc>
        <lastmod>2012-09-07T05:33:08+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-08.xml</loc>
        <lastmod>2012-08-27T06:03:59+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-07.xml</loc>
        <lastmod>2012-07-08T05:07:57+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-06.xml</loc>
        <lastmod>2012-07-08T05:09:58+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-05.xml</loc>
        <lastmod>2012-10-07T16:06:21+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-04.xml</loc>
        <lastmod>2012-04-18T11:54:08+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2012-03.xml</loc>
        <lastmod>2012-04-09T01:10:49+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-09.xml</loc>
        <lastmod>2012-02-21T16:48:23+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-08.xml</loc>
        <lastmod>2012-02-06T15:33:46+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-07.xml</loc>
        <lastmod>2012-02-06T15:56:18+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-06.xml</loc>
        <lastmod>2012-05-29T15:46:11+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-05.xml</loc>
        <lastmod>2012-10-17T06:33:27+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-03.xml</loc>
        <lastmod>2011-08-24T12:18:57+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-02.xml</loc>
        <lastmod>2014-06-16T23:13:46+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2011-01.xml</loc>
        <lastmod>2011-08-24T12:27:09+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-12.xml</loc>
        <lastmod>2012-05-08T01:37:50+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-11.xml</loc>
        <lastmod>2011-08-24T12:32:12+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-10.xml</loc>
        <lastmod>2012-05-29T15:51:47+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-09.xml</loc>
        <lastmod>2011-08-24T12:39:42+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-08.xml</loc>
        <lastmod>2011-08-24T12:46:55+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-07.xml</loc>
        <lastmod>2011-08-24T12:51:35+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-06.xml</loc>
        <lastmod>2011-08-24T12:56:43+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-04.xml</loc>
        <lastmod>2014-06-16T23:24:50+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-03.xml</loc>
        <lastmod>2014-06-16T00:42:41+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-02.xml</loc>
        <lastmod>2011-08-24T13:07:46+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2010-01.xml</loc>
        <lastmod>2011-08-24T13:09:47+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-11.xml</loc>
        <lastmod>2011-08-24T13:13:10+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-10.xml</loc>
        <lastmod>2014-06-18T01:22:13+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-09.xml</loc>
        <lastmod>2011-08-24T13:55:47+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-08.xml</loc>
        <lastmod>2011-08-24T13:57:29+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-04.xml</loc>
        <lastmod>2011-08-24T13:59:08+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-03.xml</loc>
        <lastmod>2012-04-29T12:16:34+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-02.xml</loc>
        <lastmod>2011-08-24T14:02:28+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2009-01.xml</loc>
        <lastmod>2009-03-05T10:44:18+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-12.xml</loc>
        <lastmod>2009-10-08T09:13:16+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-11.xml</loc>
        <lastmod>2011-08-24T14:07:35+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-10.xml</loc>
        <lastmod>2011-08-24T14:08:10+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-08.xml</loc>
        <lastmod>2010-04-26T17:45:53+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-07.xml</loc>
        <lastmod>2010-08-31T13:12:19+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-06.xml</loc>
        <lastmod>2010-03-14T11:37:49+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-05.xml</loc>
        <lastmod>2010-04-26T17:50:56+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-04.xml</loc>
        <lastmod>2010-07-18T07:26:02+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-03.xml</loc>
        <lastmod>2010-04-26T17:32:24+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-02.xml</loc>
        <lastmod>2010-05-04T20:31:31+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2008-01.xml</loc>
        <lastmod>2009-09-17T17:01:00+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-12.xml</loc>
        <lastmod>2009-09-17T17:10:46+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-11.xml</loc>
        <lastmod>2009-09-17T17:11:29+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-10.xml</loc>
        <lastmod>2009-09-17T17:11:51+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-09.xml</loc>
        <lastmod>2009-09-17T17:12:21+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-08.xml</loc>
        <lastmod>2010-06-06T15:17:25+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-07.xml</loc>
        <lastmod>2010-04-26T17:42:57+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-06.xml</loc>
        <lastmod>2009-03-11T05:32:28+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-05.xml</loc>
        <lastmod>2009-09-17T17:17:26+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-04.xml</loc>
        <lastmod>2009-09-17T17:26:11+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2007-03.xml</loc>
        <lastmod>2010-08-31T13:12:08+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2006-08.xml</loc>
        <lastmod>2009-09-17T17:26:47+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2006-07.xml</loc>
        <lastmod>2009-09-17T17:28:26+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2006-06.xml</loc>
        <lastmod>2009-09-17T17:29:23+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2006-05.xml</loc>
        <lastmod>2010-06-21T17:28:09+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-post-2006-04.xml</loc>
        <lastmod>2011-03-13T01:14:32+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2015-10.xml</loc>
        <lastmod>2015-10-08T15:30:28+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2015-01.xml</loc>
        <lastmod>2015-11-17T05:37:27+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2014-05.xml</loc>
        <lastmod>2015-10-08T15:26:16+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2012-12.xml</loc>
        <lastmod>2015-10-08T15:28:30+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2012-08.xml</loc>
        <lastmod>2015-10-08T15:07:13+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2011-11.xml</loc>
        <lastmod>2015-11-10T05:34:11+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2011-04.xml</loc>
        <lastmod>2015-10-18T05:49:38+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2011-02.xml</loc>
        <lastmod>2015-10-08T15:37:07+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2010-07.xml</loc>
        <lastmod>2015-10-08T15:32:22+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2010-02.xml</loc>
        <lastmod>2015-10-08T15:35:49+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2009-02.xml</loc>
        <lastmod>2015-10-18T05:49:04+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-pt-page-2008-07.xml</loc>
        <lastmod>2015-10-08T15:12:21+00:00</lastmod>
    </sitemap>
    <sitemap>
        <loc>https://imouto.my/sitemap-authors.xml</loc>
        <lastmod>2015-11-17T05:37:27+00:00</lastmod>
    </sitemap>
</sitemapindex><!-- Request ID: 4b4766808d2af94f6b2d2cee4603436c; Queries for sitemap: 8; Total queries: 40; Seconds: 0.02; Memory for sitemap: 0.5MB; Total memory: 15.5MB -->

    [response] => Array
        (
            [code] => 200
            [message] => OK
        )

    [cookies] => Array
        (
            [0] => WP_Http_Cookie Object
                (
                    [name] => ct_cookies_test
                    [value] => 5566f72b110eb5a7b6503a216e09f6de
                    [expires] => 
                    [path] => /
                    [domain] => imouto.my
                )

            [1] => WP_Http_Cookie Object
                (
                    [name] => PHPSESSID
                    [value] => f6so1b2b65p7ulmdgpfv9oqur0
                    [expires] => 
                    [path] => /
                    [domain] => imouto.my
                )

        )

    [filename] => 
)
@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

@ufufufu Very helpful. Thanks!

If you wouldn't mind, can you run one more test, but this time with this alternate code snippet that uses wp_remote_head() instead please.

<?php
require_once dirname(__FILE__).'/wp-load.php';
header('Content-Type: text/plain; charset=utf-8');
print_r(wp_remote_head('http://example.com/sitemap.xml'));
@ufufufu
Copy link

@ufufufu ufufufu commented Nov 19, 2015

The result has considerably different formatting (no line-breaks):-

Array ( [headers] => Array ( [date] => Thu, 19 Nov 2015 23:01:12 GMT [server] => Apache [expires] => Thu, 19 Nov 1981 08:52:00 GMT [cache-control] => no-store, no-cache, must-revalidate, post-check=0, pre-check=0 [pragma] => no-cache [x-pingback] => https://imouto.my/xmlrpc.php [x-robots-tag] => noindex [set-cookie] => Array ( [0] => ct_cookies_test=5566f72b110eb5a7b6503a216e09f6de; path=/ [1] => PHPSESSID=6ad7227k91ibmsa934alrfgai5; path=/ ) [strict-transport-security] => max-age=15768000 [public-key-pins] => max-age=5184000; pin-sha256=2qKyaG0PHPExrUszbEua2SPHmHze8rNa1RNK2pHwfsI=; pin-sha256=Z3TyA+moOEVIq1FRV6C8RAkOJBiX22a80bT3BIs8o80=; pin-sha256=L0YY0bTrFt+E5DCWQYYZq4YSF5ORfMnF4trDzWBjP28= [connection] => close [content-type] => text/xml; charset=utf-8 ) [body] => [response] => Array ( [code] => 200 [message] => OK ) [cookies] => Array ( [0] => WP_Http_Cookie Object ( [name] => ct_cookies_test [value] => 5566f72b110eb5a7b6503a216e09f6de [expires] => [path] => / [domain] => imouto.my ) [1] => WP_Http_Cookie Object ( [name] => PHPSESSID [value] => 6ad7227k91ibmsa934alrfgai5 [expires] => [path] => / [domain] => imouto.my ) ) [filename] => )
@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

@ufufufu Thank you. Both of those tests show that WordPress is properly identifying that you do in fact have https://imouto.my/sitemap.xml. Couple of questions for you.

  • Do the test results change at all when you alter the scheme; i.e., http:// vs. https:// for the URL?
  • Can you confirm that you are in fact still seeing the warning notice in ZenCache regarding a missing sitemap?
@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

Also, are you running a WordPress Multisite Network or a standard installation?

@ufufufu
Copy link

@ufufufu ufufufu commented Nov 19, 2015

  1. If I use http:// instead, I will get the output below:-
WP_Error Object
(
    [errors] => Array
        (
            [http_request_failed] => Array
                (
                    [0] => Could not resolve host: imouto.mysitemap.xml; Name or service not known
                )

        )

    [error_data] => Array
        (
        )

)

This is by using the...

<?php
require_once dirname(__FILE__).'/wp-load.php';
header('Content-Type: text/plain; charset=utf-8');
print_r(wp_remote_request('http://imouto.my/sitemap.xml'));

...script.

BTW, unless I also clear the opcache. the script's output will be cached.

Also, I've configured Apache to always redirect to https and remove the www. portion of the URL using the code below in Apache configuration.

RewriteEngine On
RewriteCond %{HTTP_HOST} ^www.(.+)$ [NC]
RewriteRule ^(.*)$ https://imouto.my$1 [R=301,L]

RewriteEngine On
RewriteCond %{SERVER_PORT} !^443$
RewriteRule ^/(.*) https://%{HTTP_HOST}$1 [NC,R=301,L]

Therefore, if I load http://imouto.my/sitemap.xml on my browser, it will automatically redirect to https://imouto.my/sitemap.xml

  1. Unless I disable the Autocache engine completely, I will still see the error message.

  2. This is a standard installation.

@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

  1. If I use http:// instead, I will get the output below

Thank you very much for that info. What URL is defined in your WordPress General Options? i.e., what do you have here please? I'm curious to see if perhaps ZenCache is attempting to access the http:// variation by mistake.

2015-11-19_14-29-41

@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

@ufufufu I see that the error report you pasted shows:

Could not resolve host: imouto.mysitemap.xml

That is incorrect altogether, because that's an invalid host name.

Looking at your .htaccess file, I see this line that is causing that.

RewriteRule ^/(.*) https://%{HTTP_HOST}$1 [NC,R=301,L]

It is stripping the / away and creating an invalid host name in the redirection.

It should be:

RewriteRule (.*) https://%{HTTP_HOST}$1 [NC,R=301,L]

Or this would also work:

RewriteRule ^(.*)$ https://imouto.my$1 [R=301,L]
@jaswrks
Copy link

@jaswrks jaswrks commented Nov 19, 2015

@raamdev One possible reason for this could be Multisite Network installations. I'm seeing this block of code where ZenCache is actually trying to find an XML Sitemap for each child blog in the network, and that's not always going to be the case; i.e., the Main Site in the Network may be the only location for the XML sitemaps. In such a case, ZenCache could be alerting site owners about child blogs that really don't matter to them anyway, and that could lead to some of this confusion.

@ufufufu
Copy link

@ufufufu ufufufu commented Nov 20, 2015

Yeah, after editing the relevant .conf file, now both http:// and https:// has the same output.

In 'General Options', both fields contains the correct info.

@jaswrks
Copy link

@jaswrks jaswrks commented Nov 20, 2015

@ufufufu Thanks! And you're not running a Multisite Network, right?

@ufufufu
Copy link

@ufufufu ufufufu commented Nov 20, 2015

Yes, only a single standard installation.

@raamdev
Copy link
Contributor

@raamdev raamdev commented Nov 22, 2015

Related: #616

@raamdev
Copy link
Contributor

@raamdev raamdev commented Nov 22, 2015

@jaswsinc writes...

One possible reason for this could be Multisite Network installations. I'm seeing this block of code where ZenCache is actually trying to find an XML Sitemap for each child blog in the network, and that's not always going to be the case; i.e., the Main Site in the Network may be the only location for the XML sitemaps. In such a case, ZenCache could be alerting site owners about child blogs that really don't matter to them anyway, and that could lead to some of this confusion.

So should we change the behavior so that by default only the Main Site is used for an XML Sitemap and then have an option (that appears when Network Activated) that allows a site owner to specifically enable "Check Each Child Blog For an XML Sitemap"?

If we did that, we'd also need to update the XML Sitemap error message to mention the domain (or maybe the full path) where the XML Sitemap check failed, to make debugging this issue for a Multisite Admin a lot easier ("which Child Blog is missing an XML Sitemap?"). And in that case, it should probably also be possible for a Multisite Admin to dismiss certain notices, if, for example, they already know that a specific Child Blog doesn't have and won't have a XML Sitemap (that would be work related to #616).

However, I'm a bit concerned about feature creep here. It seems like it would be better to just disable XML Sitemaps for Child Blogs (or disable error reporting for Child Blog XML Sitemaps) and leave the additional work to a feature request, if such improvements are requested.

@jaswrks
Copy link

@jaswrks jaswrks commented Nov 23, 2015

So should we change the behavior so that by default only the Main Site is used for an XML Sitemap and then have an option (that appears when Network Activated) that allows a site owner to specifically enable "Check Each Child Blog For an XML Sitemap"?

Yes, I agree with that approach. I don't think that's any big deal. A simple checkbox to flick that on seems worth it to me; i.e., not feature creep IMO.

or disable error reporting for Child Blog XML Sitemaps

That, in concert with the checkbox, sounds like a good idea to me. We can just disable error reporting for child blogs and let the log file suffice in that instance. If a network admin really wants to look closer they can go to the log for this particular aspect. Seems good enough to me.

@raamdev
Copy link
Contributor

@raamdev raamdev commented Dec 3, 2015

Next Pro Release Changelog:

  • Enhancement: The Auto-Cache Engine diagnostic reporting for XML Sitemap-related errors has been greatly improved. The Dashboard notice now explains exactly what error is occurring when the Auto-Cache Engine attempts to verify that the XML Sitemap exists. Props @jaswsinc. See Issue #615 and Issue #618.
  • Multisite Enhancement: The Auto-Cache Engine has a new configuration option when running on WP Multisite Networks that allows you to define whether or not the Auto-Cache Engine should look for XML Sitemaps on each of the child blogs. This now defaults to being off; i.e., by default, child blogs are no longer checked. Props @jaswsinc. See Issue #618.
  • Multisite Enhancement: The Auto-Cache Engine XML Sitemap diagnostic reporting is now always disabled for child blogs and only errors related to a primary sitemap location are displayed on the Dashboard. Props @jaswsinc. See Issue #618.
@raamdev raamdev closed this Dec 3, 2015
@wpsharks wpsharks locked and limited conversation to collaborators Dec 21, 2015
@raamdev
Copy link
Contributor

@raamdev raamdev commented Dec 21, 2015

ZenCache Pro v151220 has been released and includes changes worked on as part of this GitHub Issue. See the release announcement for further details.


This issue will now be locked to further updates. If you have something to add related to this GitHub Issue, please open a new GitHub Issue and reference this one (#618).

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants