Skip to content

Break up llms.txt page into multiple smaller pages#4966

Merged
devalog merged 5 commits intomainfrom
fern/break-up-llms-txt-page
Apr 17, 2026
Merged

Break up llms.txt page into multiple smaller pages#4966
devalog merged 5 commits intomainfrom
fern/break-up-llms-txt-page

Conversation

@devin-ai-integration
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration bot commented Apr 16, 2026

Summary

Splits the single llms.txt documentation page into four focused pages under a new llms.txt navigation section:

  1. Overview — What llms.txt is, generated files, custom files, page descriptions
  2. Visibility tagsnoindex exclusion, <llms-only>, <llms-ignore>, query parameter filtering
  3. Per-page directives — Directive configuration (standalone page)
  4. Analytics and integration — Dashboard analytics, adding buttons/dropdowns

Also:

  • Updates navigation in docs.yml to use a section with 4 pages instead of a single page
  • Adds redirect from old URL (/learn/docs/ai-features/llms-txt) to new overview page
  • Updates existing redirects to point to the new overview page
  • Updates ~15 files with internal links that referenced the old page or its anchors

Review & Testing Checklist for Human

  • Verify the new pages render correctly in the preview deployment and content matches the original
  • Check that the redirect from /learn/docs/ai-features/llms-txt to /learn/docs/ai-features/llms-txt/overview works
  • Spot-check a few updated internal links (e.g., from changelogs, site-level-settings, frontmatter pages) to confirm they resolve to the correct new page and anchor

Notes

Requested by: Fern Support

Link to Devin session: https://app.devin.ai/sessions/e608c7db9ba14fdba271af67c69b94e8

Co-Authored-By: bot_apk <apk@cognition.ai>
@devin-ai-integration devin-ai-integration bot requested a review from devalog as a code owner April 16, 2026 11:41
@devin-ai-integration
Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@fern-api
Copy link
Copy Markdown
Contributor

fern-api bot commented Apr 16, 2026

Requested by: devin
Slack thread: View conversation


`llms.txt` and `llms-full.txt` are generated automatically for your site, but how readers and AI tools discover them is up to you. Track usage in the Fern Dashboard and surface endpoints directly in your docs.

## Track LLM traffic
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📝 [vale] reported by reviewdog 🐶
[FernStyles.Headings] 'Track LLM traffic' should use sentence-style capitalization.

@devalog devalog merged commit e7369fd into main Apr 17, 2026
2 checks passed
@devalog devalog deleted the fern/break-up-llms-txt-page branch April 17, 2026 12:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants