Website crawler
Website crawler: up to 25 pages of one site as clean text, robots.txt obeyed. Render a whole section of a site - up to 25 pages - in a real browser and return every page as clean text.
Answeringour last check, 2026-09-27
1 of 1checks answered this week
1013 msmedian answer time
$0.14listed price per call
$0.14price it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
GET https://apexfaucet.xyz/api/x402/site-extract
| Category | Search and research |
|---|---|
| Provider host | apexfaucet.xyz |
| Networks | eip155:5042, eip155:8453, solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp |
| Payment schemes | exact |
| Self-reported calls, 30 days | 5 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-09-27 | valid payment request | 402 | $0.14 | 1013 ms |
Example input (from the provider)
{
"discoverable": true,
"method": "GET",
"queryParams": {
"full": "1",
"pages": "10",
"url": "https://docs.arc.io/"
},
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"properties": {
"method": {
"enum": [
"GET"
],
"type": "string"
},
"queryParams": {
"properties": {
"full": {
"description": "Set to 1 to render every planned page ($0.14 over x402). Programs pay for every call, with or without it; only a browser sees the crawl plan without it.",
"type": "string"
},
"pages": {
"description": "How many pages to render, default 10, hard cap 25 (a query string, so digits as text).",
"pattern": "^[0-9]{1,2}$",
"type": "string"
},
"url": {
"description": "The page to start from. Only pages on this same host are fetched, and robots.txt is obeyed.",
"type": "string"
}
},
"required": [
"url"
],
"type": "object"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method",
"queryParams"
],
"type": "object"
},
"output": {
"type": "object"
}
},
"required": [
"input"
],
"type": "object"
}