QA Judge
QA Judge: grade an agent output against your rubric (structure, citations, claim support, length constraints) and receive a 0-100 score with a signed attestation. $0.10 USDC per grading.
Answeringour last check, 2026-09-24
1 of 1checks answered this week
4043 msmedian answer time
$0.1listed price per call
$0.1price it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
POST https://attester.dev/judge
| Category | Everything else |
|---|---|
| Provider host | attester.dev |
| Networks | eip155:8453 |
| Payment schemes | exact |
| Self-reported calls, 30 days | 1 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-09-24 | valid payment request | 402 | $0.1 | 4043 ms |
Example input (from the provider)
{
"body": {
"context": null,
"output": "Use stream=True and iterate response.iter_text().",
"rubric": [
{
"criterion": "covers streaming with the OpenAI Python SDK"
},
{
"criterion": "includes citations",
"weight": 2
}
]
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"body": {
"properties": {
"context": {
"description": "Optional context (sources, instructions)",
"type": [
"string",
"null"
]
},
"output": {
"description": "The agent output to grade",
"type": "string"
},
"rubric": {
"description": "Grading criteria with optional weights",
"items": {
"properties": {
"criterion": {
"type": "string"
},
"weight": {
"type": [
"number",
"null"
]
}
},
"required": [
"criterion"
],
"type": "object"
},
"type": "array"
}
},
"required": [
"output",
"rubric"
],
"type": "object"
},
"bodyType": {
"enum": [
"json"
],
"type": "string"
},
"method": {
"enum": [
"POST"
],
"type": "string"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method",
"bodyType",
"body"
],
"type": "object"
},
"output": {
"properties": {
"example": {
"type": "object"
}
},
"required": [
"example"
],
"type": "object"
}
},
"required": [
"input"
]
}