fix: issue reported by google search console

[bigint]

• chore: remove canonical meta in prerender
• fix: robots.txt

What does this PR do?

🤖 Generated by Copilot at 93bb392

Removed canonical link tag from Tags component and updated robots.txt file to optimize SEO for prerendered pages. These changes aim to avoid duplicate content issues and increase the crawlability and visibility of the prerendered pages by Googlebot.

Related issues

Fixes # (issue)

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Enhancement (non-breaking small changes to existing functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

Explanation of the changes

🤖 Generated by Copilot at 93bb392

• Remove canonical link tag from Tags component to avoid duplicate content issues (link)
• Allow Googlebot to crawl prerendered pages and disallow other bots from accessing _next and settings directories in robots.txt file to improve SEO performance (link)

Emoji

🚫🤖🚀

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated (UTC)
prerender	✅ Ready (Inspect)	Visit Preview	Apr 9, 2023 5:12am
web	✅ Ready (Inspect)	Visit Preview	Apr 9, 2023 5:12am