Scrapes any webpage and pulls title, description, canonical URL, OpenGraph + Twi
Scrapes any webpage and pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering; body content rendered as text, raw HTML, or clean markdown, with optional link extraction. Cheerio-based with no headless browser, so it is fast and cheap, ideal for static pages and SSR sites. For JS-heavy SPAs that need a real browser, see website-screenshot. Use it as a web scraping API or webpage metadata extractor.
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
POST https://x402.agentutility.ai/scrape-website
| Category | Search and research |
|---|---|
| Provider host | x402.agentutility.ai |
| Networks | eip155:8453, solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp |
| Payment schemes | exact |
| Self-reported calls, 30 days | 8 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-09-24 | valid payment request | 402 | $0.04 | 9391 ms |
Example input (from the provider)
{
"body": {
"format": "text",
"url": "https://example.com"
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"body": {
"properties": {
"format": {
"description": "Body output format. 'text' (default, plain text), 'html' (raw HTML body), or 'markdown' (clean markdown \u2014 best for LLM ingestion).",
"enum": [
"text",
"html",
"markdown"
],
"type": "string"
},
"include_links": {
"description": "If true, also returns an array of all <a href> links found on the page. Default false.",
"type": "boolean"
},
"url": {
"description": "Public URL to fetch and parse. Must include scheme (http/https). Follows redirects.",
"type": "string"
},
"user_agent": {
"description": "Custom User-Agent header. Defaults to a modern desktop Chrome UA.",
"type": "string"
}
},
"required": [
"url"
]
},
"bodyType": {
"enum": [
"json",
"form-data",
"text"
],
"type": "string"
},
"method": {
"enum": [
"POST"
],
"type": "string"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method",
"bodyType",
"body"
],
"type": "object"
},
"output": {
"properties": {
"example": {
"properties": {
"body_chars": {
"type": "integer"
},
"canonical": {
"type": "null"
},
"description": {
"type": "string"
},
"final_url": {
"type": "string"
},
"format": {
"type": "string"
},
"h1": {
"type": "string"
},
"lang": {
"type": "string"
},
"og": {
"properties": {},
"type": "object"
},
"status_code": {
"type": "integer"
},
"text": {
"type": "string"
},
"title": {
"type": "string"
},
"twitter": {
"properties": {},
"type": "object"
},
"url": {
"type": "string"
}
},
"type": "object"
},
"type": {
"type": "string"
}
},
"required": [
"type"
],
"type": "object"
}
},
"required": [
"input"
],
"type": "object"
}