Revert "Improve sitemap & remove AI crawler blocking"

[damianlegawiec]

Reverts #19

Summary by CodeRabbit

• Documentation

  • Removed optional environment variables (NEXT_PUBLIC_DEFAULT_COUNTRY, NEXT_PUBLIC_DEFAULT_LOCALE) from README documentation.

• Chores

  • Removed search engine metadata generation files.
  • Removed environment variable configuration placeholder from .env.example.

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
storefront	Ready	Preview, Comment	Apr 1, 2026 2:10pm

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: a9e7374c-8a9a-4db8-8387-7aa9d2cddbbc

📥 Commits

Reviewing files that changed from the base of the PR and between a871fea and 9524fbd.

⛔ Files ignored due to path filters (1)

• package-lock.json is excluded by !**/package-lock.json

📒 Files selected for processing (4)

• .env.example
• README.md
• src/app/robots.ts
• src/app/sitemap.ts

---

Walkthrough

This pull request removes Next.js SEO-related functionality and associated documentation entries. Deleted components include the robots.ts module (which handled robot directives), the sitemap.ts module (which generated XML sitemaps), and documentation references to optional environment variables NEXT_PUBLIC_DEFAULT_COUNTRY and NEXT_PUBLIC_DEFAULT_LOCALE.

Changes

Cohort / File(s)	Summary
Configuration & Documentation .env.example, README.md	Removed commented-out NEXT_PUBLIC_SITE_URL placeholder and optional environment variable entries (NEXT_PUBLIC_DEFAULT_COUNTRY, NEXT_PUBLIC_DEFAULT_LOCALE) from documentation.
SEO Functionality src/app/robots.ts, src/app/sitemap.ts	Removed robots() function and the entire sitemap generation module including generateSitemaps(), sitemap(), and supporting logic for API-driven sitemap chunking, caching, and locale/country resolution.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

• Improve sitemap & remove AI crawler blocking #19: Directly related — this PR reverts the sitemap.ts, robots.ts, and associated environment variable documentation that were previously added.

Poem

🐰 Farewell, oh sitemaps and robots so grand,
Your XML directives no longer command,
The config, the routes, the caches of old,
Gently removed from the manifest fold,
Simpler paths now, through the digital land! 🌾

✨ Finishing Touches

📝 Generate docstrings

• Create stacked PR
• Commit on current branch

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch revert-19-sitemap

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}