Skip to content

Updated LLM-readability layer (llms.txt, .md URLs, llms-full.txt)#325

Open
Nonnyjoe wants to merge 1 commit into
mainfrom
temp/update-llmtxt
Open

Updated LLM-readability layer (llms.txt, .md URLs, llms-full.txt)#325
Nonnyjoe wants to merge 1 commit into
mainfrom
temp/update-llmtxt

Conversation

@Nonnyjoe
Copy link
Copy Markdown
Member

  • Rewrote static/llms.txt to cover all 307 sitemap URLs across 30 sections
  • Added "Instructions for AI Agents" section at top of llms.txt with guidance on .md URL access and llms-full.txt
  • Added headTags link[rel=alternate] directive pointing to /llms.txt
  • Added plugins/serve-markdown.js Docusaurus plugin:
    • Dev: serves raw markdown for any .md URL and Accept:text/markdown requests
    • Dev: dynamically generates /llms-full.txt (all docs concatenated, ~1.7MB)
    • Build: writes .md files alongside HTML pages in outDir
    • Build: writes llms-full.txt to outDir

- Rewrote static/llms.txt to cover all 307 sitemap URLs across 30 sections
- Added "Instructions for AI Agents" section at top of llms.txt with
  guidance on .md URL access and llms-full.txt
- Added headTags link[rel=alternate] directive pointing to /llms.txt
- Added plugins/serve-markdown.js Docusaurus plugin:
  - Dev: serves raw markdown for any .md URL and Accept:text/markdown requests
  - Dev: dynamically generates /llms-full.txt (all docs concatenated, ~1.7MB)
  - Build: writes .md files alongside HTML pages in outDir
  - Build: writes llms-full.txt to outDir
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant