docs: expose language-specific LLM aggregates

[oatsandsugar]

This pull request introduces a new system for dynamically generating and serving language-specific documentation (for Python and TypeScript) in the framework-docs app. The main changes include adding API endpoints for documentation generation, a robust file parser and builder, middleware and routing logic for clean URLs, and updates to Next.js rewrites.

Dynamic Documentation Generation and Serving

API Endpoints

• Added new API routes api/llm/py and api/llm/ts that generate and serve plain text documentation for Python and TypeScript, respectively, based on a requested scope. These endpoints use a shared document builder and handle errors gracefully. [1] [2]

Documentation Builder

• Introduced llmDocGenerator.ts, which recursively collects .mdx files, parses front matter, filters content by language tags, cleans up code blocks and markup, and assembles a structured documentation output. It supports scoping, generates a table of contents, and normalizes input paths.

Routing and Middleware Enhancements

Middleware for Clean URLs

• Added a middleware to intercept requests for documentation files (e.g., /llm-py.txt, /some/scope/llm-ts.txt), extract language and scope, and rewrite them to the corresponding API endpoints, ensuring clean and flexible URLs for documentation consumers.

Next.js Rewrites

• Updated Next.js configuration to include rewrites for all relevant documentation file patterns, mapping them to the new API endpoints and supporting scoped documentation queries. [1] [2]

---

Note

Adds dynamic Python/TypeScript doc aggregation via new /api/llm/* endpoints with clean URL handling through middleware and rewrites.

• API:
  • Add GET /api/llm/py and GET /api/llm/ts to serve plain-text, language-specific docs with optional scope and caching headers.
• Library:
  • Introduce src/lib/llmDocGenerator.ts to collect .mdx, parse front matter, filter content by language tags, clean markup, build TOC, and support scoped aggregation.
  • Add src/lib/llmHelpers.ts for safe query param decoding.
• Routing/Middleware:
  • Add middleware.ts to match .../llm-{py|ts}.txt (with optional scope) and rewrite to corresponding API routes.
  • Update next.config.mjs rewrites to map /llm-*.txt and /:scope*/llm-*.txt to /api/llm/{ts|py} with scope.

^{Written by Cursor Bugbot for commit 9035248. This will update automatically on new commits. Configure here.}

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
framework-docs	Ready	Preview	Comment	Oct 23, 2025 8:21pm

[Copilot]

Pull Request Overview

This PR introduces a system for generating and serving language-specific (Python and TypeScript) documentation aggregates designed for LLM consumption. The implementation adds API endpoints that parse MDX files, filter content by language tags, and output plain text documentation with optional scoping support.

Key Changes:

• Added API endpoints /api/llm/py and /api/llm/ts that generate language-filtered documentation from MDX files
• Created a documentation generator that parses front matter, filters by language tags, strips JSX/exports, and builds table of contents
• Implemented middleware and Next.js rewrites to map clean URLs (e.g., /llm-ts.txt, /scope/llm-py.txt) to the API endpoints

Reviewed Changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
apps/framework-docs/src/pages/api/llm/ts.ts	TypeScript documentation API endpoint with scope extraction and error handling
apps/framework-docs/src/pages/api/llm/py.ts	Python documentation API endpoint (identical structure to TypeScript endpoint)
apps/framework-docs/src/lib/llmDocGenerator.ts	Core documentation generator with MDX parsing, language filtering, and content cleaning logic
apps/framework-docs/next.config.mjs	Added rewrites to map /llm-*.txt URLs to corresponding API endpoints
apps/framework-docs/middleware.ts	Request interceptor to parse LLM documentation URLs and rewrite to API endpoints