feat: add llms-txt generation

[centwright]

Closes #10.

This adds a reproducible Sourcey-based generation step for the Undici documentation's LLM indexes:

• pins sourcey@3.6.5 in the lockfile
• generates out/llms.txt and out/llms-full.txt from the latest fetched Undici release docs
• rewrites generated links to the canonical case-sensitive doc-kit routes
• documents the build command and generated outputs

Validation performed:

• npm ci
• npm run build:fetch-docs
• npm run build:html
• npm run build:llms
• live checks of six generated documentation URLs (all HTTP 200)
• git diff --check

[vercel]

@centwright is attempting to deploy a commit to the OpenJS Foundation Team on Vercel.

A member of the Team first needs to authorize it.

[avivkeller]

We have an LLM.txt generator in doc-kit

[centwright]

Updated in 31dc494 to use doc-kit's existing llms-txt generator. The revision removes Sourcey and the custom generation script/config, adds llms-txt to the existing multi-version doc-kit invocation, and supplies a small Undici-specific template. I verified npm run build:html with a deployment-style VERCEL_URL and checked all 125 generated links across the current, v7, and v6 indexes against the generated HTML files.

[centwright]

@avivkeller The requested change is addressed in 31dc494: this now uses doc-kit’s existing llms-txt generator and removes Sourcey plus the custom generator. Local multi-version build and generated-link validation both pass. GitHub does not allow this fork author to submit a formal re-review request, so could you re-review when convenient?

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
undici-website	Ready	Preview, Comment	Jul 13, 2026 7:38pm

[avivkeller]

https://undici-website-git-fork-centwright-codex-sourcey-llms-openjs.vercel.app/llms.txt

[AugustinMauroy]

LGMT !

@avivkeller I didn't get why https://undici-website-git-fork-centwright-codex-sourcey-llms-openjs.vercel.app/v6.x/llms.txt is 404

[centwright]

@AugustinMauroy Confirmed that both /v6.x/llms.txt and /v7.x/llms.txt returned 404 while neighboring versioned assets were served. Fixed in 8b18ac1 by generating byte-identical root-level mirrors and adding a constrained /vN.x/llms.txt rewrite. The full npm run build passes locally and all three mirrors match their generated indexes. Vercel requires OpenJS team authorization for this new fork commit; once the preview is authorized, I will verify the live v6 and v7 URLs.