Skip to content

πŸš€ Feature: Add sitemap.xml and robots.txt for SEO OptimizationΒ #728

@Jai-Shankar1033

Description

@Jai-Shankar1033

πŸ”– Feature description

πŸ’‘ What I noticed

I was going through the GitHub Tracker app and realized it's missing sitemap.xml and robots.txt β€” two files that every production web app should have. Right now search engines can't properly crawl or index the app, which means people searching for GitHub activity tracking tools won't find it easily.

It's a small addition but makes a real difference for discoverability.


πŸš€ What I'm proposing

Add a sitemap.xml and robots.txt to the public/ folder, and a few meta tags in index.html so search engines can properly discover and index all pages of the app.


β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Search engine visits the app β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Reads /robots.txt for crawl rules β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Follows /sitemap.xml for all URLs β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
β”‚
β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ Pages get properly indexed 🎯 β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜


πŸ› οΈ Tech Implementation Plan

public/robots.txt

User-agent: *
Allow: /

Sitemap: https://github-spy.netlify.app/sitemap.xml

public/sitemap.xml

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://github-spy.netlify.app/</loc>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://github-spy.netlify.app/tracker</loc>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://github-spy.netlify.app/about</loc>
    <priority>0.7</priority>
  </url>
</urlset>

index.html β€” add inside <head>

<meta name="description" content="Track and analyze GitHub user activity in real time." />
<meta name="robots" content="index, follow" />
<link rel="canonical" href="https://github-spy.netlify.app/" />

βœ… Acceptance Criteria

  • public/robots.txt created with proper crawl rules
  • public/sitemap.xml created with all app routes
  • Sitemap URL referenced inside robots.txt
  • Meta description added to index.html
  • Canonical URL tag added to index.html
  • Sitemap validated using XML Sitemap Validator

πŸ”— References


I'd love to work on this if maintainers are open to it. Happy to discuss before starting.

🎀 Screenshot

No response

πŸ”„οΈ Additional Information

No response

Metadata

Metadata

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions