llms.txt is a proposed standard file placed at a website's root that gives AI systems a curated, machine-friendly summary of the site's most important content, similar in spirit to robots.txt but oriented to guiding LLMs rather than blocking crawlers.
The file lists key pages with short descriptions in plain markdown, helping AI tools with limited crawling budgets find the content that matters, a hotel's rooms, location, policies and FAQs, without parsing heavy templated HTML.
Adoption is still emerging and no major engine guarantees to honor it, so llms.txt is a low-cost complement, not a strategy. It pairs with the decisions that do have teeth, whether robots directives allow AI crawlers and whether content is structured for extraction.
← sesion.org · All categories · Advisors · Blog · Glossary