Ask a typed question about any content and get an answer your code can branch on

Ask a typed question about any content and get an answer your code can branch on, not prose to parse. Three question types: choice (pick one of your named options, with a probability for each and a confidence), score (a position on levels you describe), and noul (a yes/no as a probability from 0 to 1). Up to 8 questions per call, answered in parallel over one piece of state. Model-backed, not deterministic.

Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.

Endpoint

POST https://agent402.tools/v1/judge

Our checks, last 30 days

Example input (from the provider)

{
  "body": {
    "questions": {
      "is_reproducible": {
        "instructions": "Does this report describe steps that would let an engineer reproduce the problem?",
        "type": "noul"
      },
      "severity": {
        "criteria": [
          "Cosmetic; no impact to functionality",
          "Broken or degraded feature, but a workaround exists",
          "Blocking issue; no workaround exists"
        ],
        "instructions": "How severe is the reported issue?",
        "type": "score"
      }
    },
    "state": "The export button crashes the settings page in Safari. It works in Chrome, but a few of our customers only use Safari."
  },
  "bodyType": "json",
  "method": "POST",
  "type": "http"
}

Promised output schema (from the provider)

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {
    "input": {
      "additionalProperties": false,
      "properties": {
        "body": {
          "properties": {
            "model": {
              "description": "Defaults to jev-latest.",
              "enum": [
                "jev-latest",
                "jev-preview"
              ],
              "type": "string"
            },
            "questions": {
              "description": "Your own ids mapped to question objects. Each has type (choice/score/noul), instructions, and criteria for choice/score.",
              "type": "object"
            },
            "state": {
              "description": "The content to judge. Up to 8000 characters.",
              "type": [
                "string",
                "object",
                "array"
              ]
            }
          },
          "required": [
            "state",
            "questions"
          ],
          "type": "object"
        },
        "bodyType": {
          "enum": [
            "json",
            "form-data",
            "text"
          ],
          "type": "string"
        },
        "method": {
          "enum": [
            "POST"
          ],
          "type": "string"
        },
        "type": {
          "const": "http",
          "type": "string"
        }
      },
      "required": [
        "type",
        "method",
        "bodyType",
        "body"
      ],
      "type": "object"
    }
  },
  "required": [
    "input"
  ],
  "type": "object"
}

This page as JSON