Open Terminal

llms.txt Checker

Available

Check whether a website publishes an llms.txt file and validate its Markdown structure: title, summary, sections and links, with clear recommendations.

Check an llms.txt

Checks /llms.txt on the site’s host.

llms.txt report

Fetch or paste an llms.txt to see its structure, problems and a readable view.

How it works

llms.txt is a proposed Markdown file at /llms.txt that gives language models a concise overview of a site: an H1 title, a short summary in a blockquote, optional details, and H2 sections listing links to the most useful pages (ideally clean Markdown versions). The checker parses the file and reports structural problems. Paste mode works in your browser; fetching a live file needs the NetTools server.

The proposed format

From the llmstxt.org proposal, in this order:

  1. # Title: the name of the site or project (the only required part).
  2. > Summary: a short blockquote with the key information.
  3. Optional paragraphs or lists with more detail (no headings).
  4. ## Section headings, each with a list of - [Name](URL): notes links. A section named Optional holds links that can be skipped.

It is an emerging convention: some AI tools read it, nobody is required to, and it grants or restricts nothing.

Safeguards & responsible use

  • Fetches only /llms.txt on public hosts through SSRF protection, with a 1 MB size limit and short timeouts.
  • Per-client rate limits; neither the domain nor the file is stored.

Frequently asked questions

Is llms.txt a standard that AI systems must follow?

No. It is an emerging, voluntary convention proposed in 2024 (llmstxt.org). Some tools and AI products read it, many do not, and nobody is obliged to. Publishing one does not guarantee indexing, citation or visibility in AI answers.

What should an llms.txt contain?

A “# Title”, a one- or two-sentence “> summary”, optionally a few paragraphs of context, and “## Section” headings with lists of “- [Page name](URL): short description”. A section named “Optional” marks links that can be skipped when context is limited.

How is it different from robots.txt?

robots.txt tells crawlers what they may fetch. llms.txt points to the content that is most useful to read. It grants or restricts nothing.