AI Answer Evaluation and Comparison
AI Answer Evaluation and Comparison: Score two sets of answers against customer references with normalized exact match and token F1. Up to 200 examples. These metrics do not verify factual truth. Local processing. Limits and retention: /ai-services.
Answeringour last check, 2026-10-03
1 of 1checks answered this week
318 msmedian answer time
$0.03listed price per call
$0.03price it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
POST https://market.datapackvibe.com/x402/ai-answer-evaluation
| Category | Market data |
|---|---|
| Provider host | market.datapackvibe.com |
| Networks | eip155:8453 |
| Payment schemes | exact |
| Self-reported calls, 30 days | 1 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-10-03 | valid payment request | 402 | $0.03 | 318 ms |
Example input (from the provider)
{
"body": {
"examples": [
{
"answer_a": "Paris",
"answer_b": "London",
"reference": "Paris"
}
]
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"body": {
"additionalProperties": false,
"properties": {
"examples": {
"default": [
{
"answer_a": "Paris",
"answer_b": "London",
"reference": "Paris"
}
],
"items": {
"additionalProperties": false,
"properties": {
"answer_a": {
"maxLength": 1500,
"minLength": 1,
"type": "string"
},
"answer_b": {
"maxLength": 1500,
"minLength": 1,
"type": "string"
},
"reference": {
"maxLength": 1500,
"minLength": 1,
"type": "string"
}
},
"required": [
"reference",
"answer_a",
"answer_b"
],
"type": "object"
},
"maxItems": 200,
"minItems": 1,
"type": "array"
}
},
"required": [
"examples"
],
"type": "object"
},
"bodyType": {
"enum": [
"json",
"form-data",
"text"
],
"type": "string"
},
"method": {
"enum": [
"POST"
],
"type": "string"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method",
"bodyType",
"body"
],
"type": "object"
},
"output": {
"properties": {
"example": {
"type": "object"
},
"type": {
"type": "string"
}
},
"required": [
"type"
],
"type": "object"
}
},
"required": [
"input"
],
"type": "object"
}