A/B test significance from visitors and conversions
A/B test significance from visitors and conversions - lift, z-score, p-value, confidence interval, winner and the sample size needed per variant
Answers HTTP 404 without x402 payment termsour last check, 2026-10-18
0 of 1checks answered this week
n/amedian answer time
$0.01listed price per call
n/aprice it asked us
Paid test badge: not yet. The checks above are free: we call the tool without paying and read the payment request it sends back. The Verified badge needs paid calls whose answers match the promised output, and nobody can buy a badge.
Endpoint
GET https://saylorinnovations.com/api/math/ab-test
| Category | Everything else |
|---|---|
| Provider host | saylorinnovations.com |
| Networks | eip155:8453, solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp |
| Payment schemes | exact |
| Self-reported calls, 30 days | 1 from 1 payers (the provider's figure, not ours) |
Our checks, last 30 days
| Day | Result | HTTP | Asked | Time |
|---|---|---|---|---|
| 2026-10-18 | no x402 terms | 404 | 262 ms |
Example input (from the provider)
{
"method": "GET",
"queryParams": {
"a_conversions": "250",
"a_visitors": "5000",
"b_conversions": "295",
"b_visitors": "5000"
},
"type": "http"
}
Promised output schema (from the provider)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"properties": {
"input": {
"additionalProperties": false,
"properties": {
"method": {
"enum": [
"GET",
"POST",
"PUT",
"PATCH",
"DELETE",
"HEAD"
],
"type": "string"
},
"queryParams": {
"properties": {
"a_conversions": {
"description": "Conversions in A",
"type": "string"
},
"a_visitors": {
"description": "Visitors in variant A",
"type": "string"
},
"b_conversions": {
"description": "Conversions in B",
"type": "string"
},
"b_visitors": {
"description": "Visitors in variant B",
"type": "string"
}
},
"required": [
"a_visitors",
"a_conversions",
"b_visitors",
"b_conversions"
],
"type": "object"
},
"type": {
"const": "http",
"type": "string"
}
},
"required": [
"type",
"method"
],
"type": "object"
},
"output": {
"properties": {
"example": {
"properties": {
"absolute_difference_points": {
"description": "Absolute difference points",
"type": [
"number",
"null"
]
},
"advice": {
"description": "The advice text",
"type": "string"
},
"alpha": {
"type": [
"number",
"null"
]
},
"confidence_interval_difference": {
"description": "Confidence interval difference",
"type": "object"
},
"current_sample_per_variant": {
"description": "Current sample per variant",
"type": [
"number",
"null"
]
},
"note": {
"description": "Caveat or context for reading the result",
"type": "string"
},
"p_value": {
"description": "P value",
"type": "number"
},
"probability_b_beats_a_approx": {
"description": "Probability b beats a approx",
"type": [
"number",
"null"
]
},
"relative_lift_percent": {
"description": "Relative lift, as a percentage",
"type": [
"number",
"null"
]
},
"sample_size_per_variant_to_detect_observed_effect": {
"description": "Sample size per variant to detect observed effect",
"type": [
"number",
"null"
]
},
"significant": {
"type": "boolean"
},
"source": {
"description": "Data source the values come from",
"type": "string"
},
"underpowered": {
"type": [
"boolean",
"null"
]
},
"variant_a": {
"description": "Variant a",
"type": "object"
},
"variant_b": {
"description": "Variant b",
"type": "object"
},
"winner": {
"type": "string"
},
"z_score": {
"description": "Z score",
"type": "number"
}
},
"required": [
"variant_a",
"variant_b",
"p_value",
"significant"
],
"type": "object"
},
"type": {
"const": "json",
"type": "string"
}
},
"required": [
"type"
],
"type": "object"
}
},
"required": [
"input"
],
"type": "object"
}