Use case · Website migration
Move every page off the old CMS
Crawl the old site and get every page as markdown or HTML with its URL and place in the link tree, then export the lot as JSONL or CSV for the new platform.
2
content formats per page: markdown and HTML
2
export formats: JSONL and CSV
1B
free tokens on sign-up, no card
// For agencies and in-house teams replatforming a website or CMS
$ sarv-kb map https://old.example.com --kb kb_oldsite --wait✓ 3,418 URLs found$ sarv-kb crawl https://old.example.com --kb kb_oldsite \--limit 5000 --exclude-paths /search,/cart -f markdown,html,json --wait✓ Crawl completed · 3,206 pages$ sarv-kb export --kb kb_oldsite --format csv -o inventory.csv✓ Exported 3,206 rows → inventory.csv$ head -3 inventory.csvid,kb_id,job_id,type,url,title,has_markdown,is_document"pg_01…","kb_oldsite","job_7c…","crawl","https://old.example.com/about","About us","true","false""pg_02…","kb_oldsite","job_7c…","crawl","https://old.example.com/files/brochure.pdf","Brochure","true","true"
Perfect for
CMS replatforming
Moving from WordPress, Drupal or a legacy CMS with no clean export: crawl the public site instead.
Site consolidations
Merge several sites into one with a full inventory of what each holds and where it lives.
Redirect planning
Start your redirect map from the complete list of old URLs, not from memory.
Content archives
Keep a searchable markdown copy of a site before it is switched off.
How it works
Map the old site
List every URL first to size the job and decide which sections to leave behind.
Crawl in a real browser
Crawl with markdown and HTML formats; JavaScript-rendered pages are captured as visitors see them.
Review the link tree
Every crawl has a tree of which page linked to which, with depth and status code per page.
Bring the attachments
Linked PDFs and Office files can be parsed in the same crawl, so downloads move too.
Export for import
Export the knowledge base as JSONL or CSV and feed it to your import scripts.
Search the old content
While you rewrite, search the old site by keyword or meaning to find every page on a topic (paid plans).
How SarvCrawl compares
| Feature | SarvCrawl | CMS export plugins | Copy-paste by hand | Generic site rippers |
|---|---|---|---|---|
| Works on any CMS or static site | ||||
| Clean markdown per page | ||||
| Original HTML kept too | ||||
| Link tree with depth per page | ||||
| JavaScript-rendered pages | ||||
| JSONL or CSV export |
Inventory the old site in an afternoon
Crawl it, review the tree, export every page. 1 billion free tokens, no card.