Can it find all my pages automatically?

Yes. Enter your homepage and the crawler follows your internal links (and reads your existing sitemap) to find up to 500 pages. It skips pages that are noindex, redirect, return errors, or point their canonical elsewhere, and tells you why.

Why is a page missing from the crawl?

The crawler only finds pages linked with normal links or listed in your current sitemap, and it obeys robots.txt. Pages behind a login, linked only from JavaScript, or excluded for SEO reasons (listed under "Left out") won't appear - add them manually if they should be indexed.

Where do I put sitemap.xml?

At your site root, e.g. https://example.com/sitemap.xml, and reference it in robots.txt or submit it directly to search engines.

Sitemap Generator

Crawl your site and generate an XML sitemap automatically.

Crawl your website to find every indexable page automatically, or add URLs by hand, then download an XML sitemap so search engines can crawl your site efficiently.

Find pages automatically

Enter your homepage. We follow your internal links and read your existing sitemap to find every page that should be indexed.

URL

Last modified

Change frequency

Priority

<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">

</urlset>

How to use this tool

1
Crawl your site or add URLs
Enter your homepage to find pages automatically, or add rows by hand.
2
Review the list
Adjust last-modified dates and priorities, and remove anything that shouldn't be indexed.
3
Download
Save the file as sitemap.xml at your site root.

Frequently asked questions

robots.txt Generator

Generate a robots.txt file for search engines.

Web App Manifest Generator

Generate a manifest.json for your PWA.

Canonical URL Generator

Generate canonical link tags.

Adding URLs by hand runs entirely in your browser. If you crawl your site, our server visits your public pages the way a search engine would; the page list is kept for up to an hour so you can download it, then deleted.

Have feedback about this tool?