llms.txt

Overview

The llms.txt page (/company/llms-txt) stores the contents of your site's llms.txt file — a plain-text guide that helps AI systems understand what your site offers and which pages matter most. Obsurfable uses this content for intent alignment in site analysis and improved query coverage reporting.

Paste the file body here even if you also host llms.txt on your live site. Obsurfable reads what you save in the app during analysis.

Who it's for

• Developers and technical marketers adopting the llms.txt convention
• Content teams curating which pages AI systems should prioritize
• Anyone running site analysis who wants intent-aware coverage insights

Prerequisites

• A saved Company profile with your website URL
• An existing llms.txt file on your site, or a draft you plan to publish
• Recommended: Sitemaps configured for page discovery

Step-by-step

1. Open llms.txt from the dashboard or go to /company/llms-txt.
2. If your site already hosts the file, click the Fetch from link on the page to view your live llms.txt at yoursite.com/llms.txt.
3. Copy the full contents of your llms.txt file.
4. Paste into the llms.txt content textarea.
5. Click Save.
6. Run site analysis when you want updated reports that incorporate the new content.

Configure crawl URLs separately on the Sitemaps page.

Tips

• Keep it current. Update this page when you publish new docs, pricing, or product pages referenced in llms.txt.
• Mirror your live file. The in-app copy should match what you host at /llms.txt to avoid conflicting signals.
• Highlight high-intent pages. llms.txt works best when it points AI systems to your most important URLs with short descriptions.
• Use with use cases. Align llms.txt priorities with Use cases you track in prompts and monitoring.
• Plain text only. Paste the raw file body — no HTML or markdown wrappers.

FAQ

What is llms.txt?

llms.txt is a convention for a root-level text file that summarizes your site for large language models and AI crawlers. It typically lists key pages with brief descriptions.

Do I need to host llms.txt on my site?

Hosting at /llms.txt is recommended for AI crawlers visiting your domain. Obsurfable also needs the content saved in the app for site analysis either way.

How is this different from sitemaps?

Sitemaps list URLs for crawling. llms.txt adds human-readable context about what those pages mean and which matter most for AI understanding.

What counts as complete for setup health?

Setup health marks llms.txt complete when non-empty content is saved.

Should I update llms.txt after changing my site?

Yes. Whenever you restructure docs or launch major pages, update both your live file and the copy saved in Obsurfable, then re-run site analysis.