Robots.txt inspection API for agents at $0.01 USDC
Robots.txt inspection API for agents at $0.01 USDC. Call when you need crawl rules and sitemap hints before indexing or scraping a domain. Use for SEO preflight and polite crawlers via x402—no API key, no subscription.
Answeringour last check, 2026-10-18
1 of 1checks answered this week
1274 msmedian answer time
$0.01listed price per call
$0.01price it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
POST https://api.delx.ai/api/v1/x402/robots-inspect
| Category | Search and research |
|---|---|
| Provider host | api.delx.ai |
| Networks | eip155:8453, solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp |
| Payment schemes | exact |
| Self-reported calls, 30 days | 2 from 2 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-10-18 | valid payment request | 402 | $0.01 | 1274 ms |
Example input (from the provider)
{
"body": {
"url": "https://example.com"
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"body": {
"additionalProperties": false,
"properties": {
"timeout": {
"maximum": 15,
"minimum": 1,
"type": "integer"
},
"url": {
"type": "string"
}
},
"required": [
"url"
],
"type": "object"
},
"bodyType": {
"enum": [
"json",
"form-data",
"text"
],
"type": "string"
},
"method": {
"enum": [
"POST",
"PUT",
"PATCH"
],
"type": "string"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"bodyType",
"body"
],
"type": "object"
},
"output": {
"properties": {
"example": {
"result": {
"allow": [],
"disallow": [],
"robots_url": "https://example.com/robots.txt",
"sitemaps": []
},
"tool_name": "util_robots_inspect"
},
"type": {
"const": "json",
"type": "string"
}
},
"required": [
"type",
"example"
],
"type": "object"
}
},
"required": [
"input",
"output"
],
"type": "object"
}