Computes weighted pass rates and weighted scores from caller-labeled test outcom
Computes weighted pass rates and weighted scores from caller-labeled test outcomes, with deterministic category summaries. It does not run tests, validate labels, measure untested capabilities or establish deployment safety; the result is only as representative as the supplied evaluation set.
Answeringour last check, 2026-09-24
1 of 1checks answered this week
951 msmedian answer time
$0.003listed price per call
$0.003price it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
POST https://aialign.halowerk.com/v1/capability-eval
| Category | Everything else |
|---|---|
| Provider host | aialign.halowerk.com |
| Networks | eip155:8453 |
| Payment schemes | exact |
| Self-reported calls, 30 days | 1 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-09-24 | valid payment request | 402 | $0.003 | 951 ms |
Example input (from the provider)
{
"body": {
"test_cases": [
{
"case_id": "math-1",
"category": "reasoning",
"passed": true,
"score": 0.92,
"weight": 1
},
{
"case_id": "math-2",
"category": "reasoning",
"passed": false,
"score": 0.41,
"weight": 1
},
{
"case_id": "tool-1",
"category": "tool-use",
"passed": true,
"score": 0.88,
"weight": 2
}
]
},
"bodyType": "json",
"method": "POST",
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"body": {
"additionalProperties": false,
"properties": {
"test_cases": {
"items": {
"additionalProperties": false,
"properties": {
"case_id": {
"maxLength": 128,
"minLength": 1,
"type": "string"
},
"category": {
"maxLength": 128,
"minLength": 1,
"type": "string"
},
"passed": {
"type": "boolean"
},
"score": {
"maximum": 1,
"minimum": 0,
"type": "number"
},
"weight": {
"maximum": 1000000,
"minimum": 1e-06,
"type": "number"
}
},
"required": [
"case_id",
"category",
"passed",
"score",
"weight"
],
"type": "object"
},
"maxItems": 100000,
"minItems": 1,
"type": "array"
}
},
"required": [
"test_cases"
],
"type": "object"
},
"bodyType": {
"enum": [
"json",
"form-data",
"text"
],
"type": "string"
},
"method": {
"enum": [
"POST",
"PUT",
"PATCH"
],
"type": "string"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method",
"bodyType",
"body"
],
"type": "object"
}
},
"required": [
"input"
],
"type": "object"
}