Use case · SEO

Site maps, crawl trees and content audits

Map every URL on a site, see its internal link structure as a crawl tree with depth and status codes, and keep a searchable inventory of every page for content audits.

Start free Website tree tool

1
crawl tree per crawl, with depth and parent per page
2
inventory exports: JSONL and CSV
1B
free tokens on sign-up, no card

// For SEO specialists, content strategists and agencies

A SITE, AS A TREE

GET /api/jobs/:id/treeCrawl tree

example.com/                                   200  depth 0
├── /pricing                                   200  depth 1
├── /blog                                      200  depth 1  · 48 children
│   ├── /blog/technical-seo-checklist          200  depth 2
│   └── /blog/page/2                           200  depth 2
│       └── /blog/2019/old-announcement        404  depth 3
└── /docs                                      200  depth 1  · 112 children
    └── /docs/guides/setup                     200  depth 2
        └── /docs/guides/setup/advanced        200  depth 3
stats
  total_crawled             1,184
  total_links_discovered   21,906
  external_links              763
  redundant_internal_links 19,958
  max_depth                     6

Perfect for

Technical audits

See how deep each page sits, which page links to it first, and which pages return errors.

Content audits

Export a page inventory with URLs and titles, then search it to find overlapping articles.

Sitemap generation

Turn a mapped list of URLs into a sitemap for sites that do not produce one.

Agency reporting

Keep one knowledge base per client site and re-crawl before each report.

How it works

01 / 06

Map every URL

A map job lists the URLs on a domain without fetching their content.

Map URL extractor

02 / 06

Crawl the structure

A crawl follows internal links and records, for each page, its parent, depth, child count and status code.

Crawl Website tree

03 / 06

Read the tree stats

Each tree reports pages crawled, links found, external links, redundant internal links and max depth.

API reference

04 / 06

Build a sitemap

Turn the discovered URLs into a sitemap with the sitemap generator.

Sitemap generator

05 / 06

Export the inventory

Export every page with URL and title as CSV for your spreadsheet, or JSONL with full metadata.

CLI

06 / 06

Watch for changes

Monitor the site to learn when pages are added, changed or removed between audits.

Monitor

How SarvCrawl compares

Feature	SarvCrawl	Desktop SEO crawlers	Sitemap generators	Manual spreadsheets
Full URL inventory
Internal link tree with depth
JavaScript-rendered pages
Page content stored as markdown
Search page content by meaning
Runs in the cloud, nothing to install

See the whole site at once

Map it, crawl the tree, export the inventory. 1 billion free tokens, no card.

Start free Website tree tool