Search any website
Send a URL and a query, get back relevant results. Scrapix crawls, indexes, and searches the site for you — all in one API call.
# Response — search results
"hits": [
{ "title": "Getting Started Guide", "url": "/getting-started" },
{ "title": "Quick Start Tutorial", "url": "/quick-start" },
...
],
"estimatedTotalHits": 23,
"processingTimeMs": 4
}
From URL to search results
Three steps, one API call. Scrapix handles the rest.
Crawl
Scrapix crawls the target website, following links and respecting robots.txt.
Index
Content is extracted, cleaned, and indexed into Meilisearch for full-text search.
Search
Your query runs against the indexed content. Results come back ranked by relevance.
Built for developers
RAG pipelines
Feed relevant web content into your LLM. Search docs and use results as context for AI answers.
Site search
Add search to any website without building an index yourself. Point Scrapix at a site and start querying.
Instant results
Typo-tolerant, relevance-ranked results powered by Meilisearch. Responses in single-digit milliseconds.
Documentation search
Index technical docs and search across multiple sources. Great for internal tooling and developer portals.
Polite crawling
Automatic rate limiting per domain, robots.txt compliance, and configurable delays.
JS rendering
Optionally render pages with a headless browser for JavaScript-heavy sites.