New1 billion tokens free on sign-up — crawl, parse, chunk and embed on the houseSee pricing
SarvCrawlSarvCrawl

Use case · Website migration

Move every page off the old CMS

Crawl the old site and get every page as markdown or HTML with its URL and place in the link tree, then export the lot as JSONL or CSV for the new platform.

  • 2

    content formats per page: markdown and HTML

  • 2

    export formats: JSONL and CSV

  • 1B

    free tokens on sign-up, no card

// For agencies and in-house teams replatforming a website or CMS

EXPORTING THE OLD SITE
SarvCrawlTerminal · sarv-kbCLI
$ sarv-kb map https://old.example.com --kb kb_oldsite --wait
✓ 3,418 URLs found
$ sarv-kb crawl https://old.example.com --kb kb_oldsite \
--limit 5000 --exclude-paths /search,/cart -f markdown,html,json --wait
✓ Crawl completed · 3,206 pages
$ sarv-kb export --kb kb_oldsite --format csv -o inventory.csv
✓ Exported 3,206 rows → inventory.csv
$ head -3 inventory.csv
id,kb_id,job_id,type,url,title,has_markdown,is_document
"pg_01…","kb_oldsite","job_7c…","crawl","https://old.example.com/about","About us","true","false"
"pg_02…","kb_oldsite","job_7c…","crawl","https://old.example.com/files/brochure.pdf","Brochure","true","true"

Perfect for

CMS replatforming

Moving from WordPress, Drupal or a legacy CMS with no clean export: crawl the public site instead.

Site consolidations

Merge several sites into one with a full inventory of what each holds and where it lives.

Redirect planning

Start your redirect map from the complete list of old URLs, not from memory.

Content archives

Keep a searchable markdown copy of a site before it is switched off.

How it works

01 / 06

Map the old site

List every URL first to size the job and decide which sections to leave behind.

02 / 06

Crawl in a real browser

Crawl with markdown and HTML formats; JavaScript-rendered pages are captured as visitors see them.

03 / 06

Review the link tree

Every crawl has a tree of which page linked to which, with depth and status code per page.

04 / 06

Bring the attachments

Linked PDFs and Office files can be parsed in the same crawl, so downloads move too.

05 / 06

Export for import

Export the knowledge base as JSONL or CSV and feed it to your import scripts.

06 / 06

Search the old content

While you rewrite, search the old site by keyword or meaning to find every page on a topic (paid plans).

How SarvCrawl compares

FeatureSarvCrawlCMS export pluginsCopy-paste by handGeneric site rippers
Works on any CMS or static site
Clean markdown per page
Original HTML kept too
Link tree with depth per page
JavaScript-rendered pages
JSONL or CSV export
SarvCrawl

Inventory the old site in an afternoon

Crawl it, review the tree, export every page. 1 billion free tokens, no card.