Crawl a website into clean Markdown
Crawl a website into clean Markdown: follows same-site links from a start page (optionally under a path prefix), up to 100 pages, respecting robots.txt. Returns each page's URL, title and text. $0.005 + $0.001 per page. Add store=true (+$0.001) to get a 7-day share link instead of the data inline.
Answeringour last check, 2026-10-18
1 of 1checks answered this week
28 msmedian answer time
$0.025listed price per call
$0.015price it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
GET https://agents.citiviewgroup.com/v1/crawl
| Category | Commerce and shopping |
|---|---|
| Provider host | agents.citiviewgroup.com |
| Networks | eip155:137, eip155:42161, eip155:480, eip155:8453 |
| Payment schemes | exact |
| Self-reported calls, 30 days | 1 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-10-18 | valid payment request | 402 | $0.015 | 28 ms |
Example input (from the provider)
{
"method": "GET",
"queryParams": {
"max_pages": 10,
"path_prefix": "/workers-ai/",
"url": "https://developers.cloudflare.com/workers-ai/"
},
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"method": {
"enum": [
"GET"
],
"type": "string"
},
"queryParams": {
"properties": {
"max_pages": {
"description": "1-100, default 20",
"type": "integer"
},
"path_prefix": {
"description": "Only follow links under this path, e.g. /docs/",
"type": "string"
},
"store": {
"description": "Return a 7-day share link (+$0.001)",
"type": "boolean"
},
"url": {
"description": "Start page",
"type": "string"
}
},
"required": [
"url"
],
"type": "object"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method"
],
"type": "object"
},
"output": {
"properties": {
"example": {
"type": "object"
},
"type": {
"type": "string"
}
},
"required": [
"type"
],
"type": "object"
}
},
"required": [
"input"
],
"type": "object"
}