WPML generated subdir pagination missing

[thegulshankumar]

Sample 404

/bn/page/2/

where

/page/2/ is ok

[leonstafford]

digging into this a bit, we have an issue where the detected file list is influenced by the WPML language switcher within the admin area:

I don't think this was the case with Polylang, but would be useful to both:

• leverage URLs in sitemap(s) to augment seeding initial crawl list
• implement more of a spidering crawler, as discussed in Unnecessary files included in static files #81 (comment)

[leonstafford]

Strangely, even the crawling is effected when the WPML admin language is set to All languages, 404's for all main site URLs. Switching to primary language solved and saw everything exported properly

[leonstafford]

should be sorted now with infinite_crawl work