Move sitemap fetching into the client

[bookernath]

What/Why?

Moves sitemap index fetching into the client so it gets the benefits of everything the client offers (such as user agent), as well as making the client more useful within other systems who may also wish to use a sitemap.

I fixed some missing user agents on admin API requests while I was at it and also fixed hardcoded hostnames.

Testing

Preview build + server logs

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
catalyst-latest	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jul 16, 2024 8:29pm

6 Skipped Deployments

Name	Status	Preview	Comments	Updated (UTC)
catalyst	⬜️ Ignored (Inspect)			Jul 16, 2024 8:29pm
catalyst-1millionproducts-store	⬜️ Ignored (Inspect)	Visit Preview		Jul 16, 2024 8:29pm
catalyst-au	⬜️ Ignored (Inspect)	Visit Preview		Jul 16, 2024 8:29pm
catalyst-test-store	⬜️ Ignored (Inspect)	Visit Preview		Jul 16, 2024 8:29pm
catalyst-uk	⬜️ Ignored (Inspect)	Visit Preview		Jul 16, 2024 8:29pm
catalyst-unstable	⬜️ Ignored (Inspect)	Visit Preview		Jul 16, 2024 8:29pm

[changeset-bot]

🦋 Changeset detected

Latest commit: b5e8770

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 2 packages

Name	Type
@bigcommerce/catalyst-client	Minor
@bigcommerce/catalyst-core	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[github-actions]

⚡️🏠 Lighthouse report

Lighthouse ran against https://catalyst-latest-kxcmrtm6w-bigcommerce-platform.vercel.app

🖥️ Desktop

We ran Lighthouse against the changes on a desktop and produced this report. Here's the summary:

Category	Score
🟢 Performance	99
🟢 Accessibility	100
🟢 Best practices	96
🟠 SEO	82

📱 Mobile

We ran Lighthouse against the changes on a mobile and produced this report. Here's the summary:

Category	Score
🟠 Performance	87
🟢 Accessibility	100
🟢 Best practices	96
🟠 SEO	85

[bookernath]

Storefront works ✅
Sitemap works https://catalyst-latest-kxcmrtm6w-bigcommerce-platform.vercel.app/sitemap.xml ✅
Shipping estimator on cart page works ✅
User agents observed in logs ✅