llms.txt

llms.txt is a proposed convention for telling AI systems where to find useful machine-readable content on a site. It is not a formal web standard.

Machine read

Useful only for systems that choose to parse the file.

Human read

Helpful editorial map for teams defining key public pages.

Noise check

Publishing llms.txt does not bypass core crawl/index fundamentals.

Hidden failure mode

Teams add llms.txt while critical answers remain buried or stale.

Why it matters

It can help organize a site's most useful pages for AI systems that choose to read it. That makes it useful as a supplement. It does not replace proper HTML, sitemaps, crawl access, or supported structured data.

What site owners should do