/map
Discover every URL on any website
Map the complete link structure of a website in seconds. Find all pages, sitemaps, and resources without fetching full content. Flat rate — 2 credits per call.
$ curl -X POST https://scrapix.meilisearch.dev/map \
-H "Authorization: Bearer sk_live_..." \
-d '{"url": "https://docs.example.com"}'
# Response
{
"total_urls": 847,
"urls": [
"https://docs.example.com/getting-started",
"https://docs.example.com/api-reference",
...
],
"credits_used": 2
}
"total_urls": 847,
"urls": [
"https://docs.example.com/getting-started",
"https://docs.example.com/api-reference",
...
],
"credits_used": 2
}
Use cases
Map is the fastest way to understand a website before crawling it.
Pre-crawl discovery
Discover how many pages a site has and plan your crawl budget before spending credits on full content extraction.
Sitemap generation
Build a complete URL list for any site — even those without a sitemap.xml. Export and use in your own tools.
Link analysis
Understand the link structure and information architecture of any website at a glance.
How it works
Crawls links and sitemaps recursively
Returns a flat list of all discovered URLs
Respects robots.txt directives
Flat rate: 2 credits per call regardless of URLs found
Configurable scope and depth
Fast — no full content fetching