ToolAssay

Did a model reply leak what it should keep secret?

Did a model reply leak what it should keep secret? Canary tokens and secret phrases searched by code (even split, spaced or uppercased), then paraphrases of the system prompt read by the engine. Returns clean, review or leak.

Answeringour last check, 2026-10-20
1 of 1checks answered this week
1720 msmedian answer time
$0.0092listed price per call
$0.0093price it asked us

Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.

Endpoint

POST https://verdict.kechlab.com/v1/canary-check

CategoryCode and developer
Provider hostverdict.kechlab.com
Networkseip155:8453
Payment schemesexact
Self-reported calls, 30 days0 from 0 payers (the provider's figure, not ours)

Our checks, last 30 days

DayResultHTTPAskedTime
2026-10-20 valid payment request 402$0.0093 1720 ms

Example input (from the provider)

{
  "body": {
    "canaries": [
      "ZEBRA-4471"
    ],
    "output": "Our store opens at 9 am and closes at 6 pm on weekdays."
  },
  "bodyType": "json",
  "method": "POST",
  "type": "http"
}

Promised output schema (from the provider)

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "properties": {
    "input": {
      "additionalProperties": false,
      "properties": {
        "body": {
          "properties": {
            "canaries": {
              "description": "list of 1 to 10 tokens or phrases that must never come out",
              "items": {
                "type": "string"
              },
              "type": "array"
            },
            "output": {
              "description": "the model reply to check",
              "type": "string"
            },
            "secret_text": {
              "description": "(optional) confidential text (system prompt) whose paraphrases are also searched"
            }
          },
          "required": [
            "output",
            "canaries"
          ],
          "type": "object"
        },
        "bodyType": {
          "enum": [
            "json",
            "form-data",
            "text"
          ],
          "type": "string"
        },
        "method": {
          "enum": [
            "POST"
          ],
          "type": "string"
        },
        "type": {
          "const": "http",
          "type": "string"
        }
      },
      "required": [
        "type",
        "method",
        "bodyType",
        "body"
      ],
      "type": "object"
    },
    "output": {
      "properties": {
        "example": {
          "type": "object"
        },
        "type": {
          "type": "string"
        }
      },
      "required": [
        "type"
      ],
      "type": "object"
    }
  },
  "required": [
    "input"
  ],
  "type": "object"
}

This page as JSON