Crawling and migrations

Extract the URLs from a sitemap

Type the domain or sitemap URL and take away the clean list of its pages, one per line: no XML, no images or language versions mixed in, and with text and date filters.

  • Free
  • No sign-up
  • Indexes included
  • One URL per line

With just the domain we look at /sitemap.xml and robots.txt. Up to 25 sitemaps are read from an index.

Cannot be read? Paste the XML

What goes in the list

Uses each page’s lastmod date. With a date, the list is pages only.

The list will appear here, one URL per line, ready to copy or download.

How to use it

  1. 01

    Type the sitemap

    Just the domain or the exact sitemap URL. If it is an index, the sitemaps it links to are read too.

  2. 02

    Choose what goes in

    Pages only by default. Add images or language versions if you need them, or filter by text and by date.

  3. 03

    Copy or download

    One URL per line, no XML. Copy it, download it as .txt or CSV, or send it straight to IndexNow.

Frequently asked questions

Why does the sitemap have more addresses than pages?

Because besides each page URL (<loc>) it can declare the page’s images (<image:loc>) and its other-language versions (<xhtml:link>). Copy every address in the XML and they come out mixed together. This tool separates each type and gives you pages only by default.

Does it work with a sitemap index?

Yes. If the sitemap is an index, the sitemaps it links to are read, up to 25, and their URLs combined. If your index has more, paste the URL of the specific sitemap you need.

What is the date filter for?

To keep only what changed: pages whose lastmod is on or after the date. That is exactly what you want to send to IndexNow after an update, instead of the whole site.

What if the sitemap cannot be read from here?

It happens with sitemaps over 2 MB, gzipped .gz files or ones behind a block. Open it in your browser, copy the XML and paste it under “Cannot be read? Paste the XML”: it is analyzed the same way, without leaving your device.

Is anything stored?

No. The sitemap URL goes through our Cloudflare function only to download it; the analysis and the list happen in your browser and are not stored.

Next step

Does your sitemap declare what it should not?

Pages that redirect, duplicate versions or URLs that no longer exist. We review it and leave it generating itself from the real content.

What happens next

  1. You tell us about the projectA short form, no strings attached.
  2. We reply within one business dayWith a first read on scope.
  3. Scoping call and proposalWe set it up by email and send you the proposal.

We reply within one business dayBogotá · UTC−5

Message us on WhatsApp (opens in a new tab)