AI Discovery

llms-full.txt: Complete AI Knowledge File for Your Website

Generate llms-full.txt automatically with Legible. Provide AI with structured knowledge of your site's identity, capabilities, FAQs, and content in one file for better understanding and accuracy.

6 min readUpdated 2026-03-22AI Discovery
Why this matters

If llms.txt is a table of contents, llms-full.txt is the whole book. It gives AI systems a structured, complete representation of your site — who you are, what you do, what questions you answer, and where to find everything.

Legible generates llms-full.txt automatically from your content. No manual maintenance, no file to keep up to date.

What llms-full.txt is

The llms.txt specification defines two companion files. llms.txt is the index — a list of your pages with titles, URLs, and short descriptions. It tells AI 'here's what exists.' llms-full.txt is the complete picture — structured knowledge about your site that tells AI 'here's what you need to know.'

A well-built llms-full.txt includes your site identity, key concepts, product capabilities, common tasks, FAQs, important pages, and any constraints or policies. It's designed to be consumed in a single request so an AI system can understand your business without crawling every page individually.

Why it matters

AI systems increasingly look for llms-full.txt when they visit your site. If it's missing, the crawler has to fetch your llms.txt, then visit each page one by one, and piece together an understanding of your business from fragments. That's slow, expensive, and error-prone.

With llms-full.txt, an AI system gets structured knowledge about you in a single HTTP request. That means more accurate citations, better answers when users ask about your product, and less chance of your content being misrepresented or missed entirely.

  • AI assistants like ChatGPT, Claude, and Perplexity use llms-full.txt to understand sites they reference in answers.
  • Without it, AI systems fall back to page-by-page crawling — or skip your site for a competitor that has it.
  • Competitor tools like Mintlify and Fern already generate both files. If you're not serving llms-full.txt, you're behind.

What Legible generates

Legible doesn't just dump your pages into a big file. It builds a structured knowledge model from your content and renders llms-full.txt from that model. The output includes:

  • Site identity — who you are, what you do, in 2-3 sentences.
  • Key concepts — the terminology and ideas central to your product.
  • Capabilities — what your product does and the use cases it supports.
  • Common tasks — the workflows your users accomplish.
  • FAQ — the questions your audience asks most, with direct answers.
  • Key pages — ranked by importance, with descriptions and links to full Markdown.
  • Constraints and policies — pricing tiers, limitations, compliance information.
  • Full content index — every page organized by type, with Markdown links.

How it works

Legible builds your llms-full.txt through a knowledge extraction pipeline that runs automatically when your content changes:

  • Content from your CMS (Webflow, WordPress, Drupal) or crawled pages is ingested and cleaned.
  • Pages are semantically chunked and embedded for retrieval.
  • An AI extraction pipeline identifies concepts, capabilities, tasks, and constraints across your content.
  • Each extracted entity is scored by source quality, frequency, relevance, and semantic importance.
  • The top-ranked entities are assembled into a structured knowledge model.
  • llms-full.txt is rendered from that model and published to your site.

Automatic updates

You don't maintain llms-full.txt by hand. When you publish a new page or update content in your CMS, Legible detects the change (via webhook or scheduled crawl), regenerates the knowledge model, and publishes an updated file. High-impact changes like homepage or pricing updates trigger broader regeneration. Routine blog post updates trigger targeted updates.

Content policy controls

Your llms-full.txt respects the AI content permissions you set in Legible. If a page has AI use set to 'not allowed,' its content is excluded from the full knowledge output. Only the title and URL appear, matching the llms.txt manifest entry. You control what AI sees, even in the single-file format.

Viewing your llms-full.txt

Once generated, your llms-full.txt is available at your-domain.com/llms-full.txt. You can also preview it in the Legible dashboard under the Knowledge tab, where you can review the extracted entities, adjust scores, pin or exclude items, and publish when you're satisfied.

Getting started

If you're already on Legible, llms-full.txt is generated automatically once your site has enough content (at least 5 pages with embeddings). Check the Knowledge tab in your dashboard to see your model and preview the output.

Not on Legible yet? Start with a free account and connect your CMS. Your llms.txt and llms-full.txt will be live within minutes.