Sitemap generator

Type your website's URL — Crawlie first checks for an existing sitemap.xml (via robots.txt or the default location), which is faster and more complete than crawling. If none exists, it falls back to crawling every internal link it finds until there are no new pages left — or paste your own list manually. Larger sites can take a while since every page goes through the same fetch process as the rest of Crawlie.

Website URL

Crawl the whole site (follow links across every page, not just the homepage)

Frequently Asked Questions

What is the XML Sitemap Generator and how does it work? +

The XML Sitemap Generator is a powerful, browser-based utility designed to streamline your SEO workflow. It processes your inputs entirely in your browser or through secure edge relays, delivering instant, accurate results without storing your data.

How do I use the XML Sitemap Generator? +

Simply enter your URL or required data into the input field above and click the action button. The XML Sitemap Generator will automatically analyze your input and generate a comprehensive, exportable report or code snippet in seconds.

Is the XML Sitemap Generator completely free and unlimited? +

Yes! Like all tools on Crawlie, the XML Sitemap Generator is 100% free to use. There are no paywalls, no login requirements, and absolutely no strict usage limits. You can run as many scans and generate as many reports as you need.

Is my data safe and secure? +

Absolutely. The XML Sitemap Generator runs its core logic locally in your browser. We do not store your website data, track your internal links, or keep a database of your reports.