Sitemaps

Overview

The Sitemaps page (/sitemaps) lets you provide sitemap URLs that Obsurfable crawls for site analysis and query coverage. Enter one URL per line — typically your main sitemap.xml or index sitemaps for docs, blog, and product pages.

Sitemaps work alongside llms.txt content to give site analysis a complete picture of your public pages and stated intent.

Who it's for

• Technical marketers responsible for site structure and SEO
• Developers who maintain sitemap files
• Content leads ensuring AI-relevant pages are discoverable in analysis

Prerequisites

• A saved Company profile with your website URL
• Access to your site's sitemap (usually at /sitemap.xml)
• Optional: llms.txt content for intent alignment

Step-by-step

1. Open Sitemaps from the dashboard or navigate to /sitemaps.
2. Note the example sitemap URL shown on the page — it is derived from your company URL (for example, https://yoursite.com/sitemap.xml).
3. In the Sitemap URLs textarea, enter one sitemap URL per line.
4. Add additional sitemaps if you have separate indexes for docs, blog, or localized content.
5. Click Save.
6. When you want fresh results, run Run site analysis from the Site analysis page in the app.

Configure llms.txt on its dedicated page for intent alignment in reports.

Tips

• Start with your root sitemap. Most sites expose everything through a single sitemap.xml or sitemap index.
• Use absolute HTTPS URLs. Include the full URL including https://.
• Add sub-sitemaps only when needed. If your index already references child sitemaps, the root URL is often enough.
• Re-run site analysis after changes. Saving sitemaps does not automatically refresh reports — trigger a new analysis when you update URLs or publish major content.
• Pair with llms.txt. Sitemaps list pages; llms.txt explains intent. Together they improve query coverage insights.

FAQ

What if my site has no sitemap?

Create one or list key section sitemaps manually. Many CMS platforms (WordPress, Webflow, Next.js plugins) generate sitemaps automatically.

Can I add more than one sitemap?

Yes. Enter multiple URLs, one per line. This is common for sites with separate product, docs, and blog sitemaps.

Does Obsurfable crawl my entire site immediately?

Crawling happens when you run site analysis. Saving sitemap URLs stores your configuration for the next analysis run.

Where do I configure llms.txt?

Use the dedicated llms.txt page at /company/llms-txt. Sitemaps and llms.txt are separate but complementary setup steps.

What counts as complete for setup health?

Setup health marks sitemaps complete when at least one non-empty sitemap URL is saved.