Feature: Add a site map

[Witty-Wizard]

Overview

A site map is crucial for improving the website's search engine optimization (SEO). It helps search engines crawl and index pages efficiently, ensuring better visibility in search results.

Why It's Important

1. Improves Search Engine Crawling – A site map provides a structured list of all pages, making it easier for search engines like Google to discover and index content.
2. Enhances SEO Rankings – Proper indexing can lead to higher search rankings, increasing organic traffic.
   Boosts Discoverability of New or Deep Pages – Pages that are new, updated, or buried deep within the site structure are more likely to be discovered.

Implementation Plan

• Generate an XML site map listing all essential pages.
• Submit the site map to search engines via Google Search Console and Bing Webmaster Tools.
• Automate site map updates when new pages are added.
• Add a robots.txt reference to the site map for better discoverability.

Acceptance Criteria

• An XML site map is generated and accessible at /sitemap.xml
• The site map is automatically updated when new pages are added.
• The site map is submitted to Google Search Console.
• robots.txt includes a reference to the site map.

[Witty-Wizard]

Dynamically generate sitemap

Use next-sitemap to dynamically generate a site map.

[Witty-Wizard]

Dynamic Robots.txt

Next-JS support dynamic robot.txt generation, or we can place a static file.

❗ Important

Ensure sitemap.xml is correctly implemented before adding robot.txt.

  User-Agent: *
  Allow: /
  Disallow: /private/

  Sitemap: https://yourdomain.com/sitemap.xml

[BangKartavya]

Added sir, check 🔥

[Witty-Wizard]

@BangKartavya, Looks good closing this