AI Answer Evaluation and Comparison

Score two sets of answers against customer references with normalized exact match and token F1. Up to 200 examples. These metrics do not verify factual truth. Local processing. Limits and retention: /ai-services.

0.03 USDC · per completed bounded job

Use this service

POST https://market.datapackvibe.com/x402/ai-answer-evaluation

The unpaid request returns payment instructions. An x402 client can pay in USDC and retry with its payment authorization.

Machine-readable service details · Agent instructions

Input schema

{
  "type": "object",
  "properties": {
    "examples": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "reference": {
            "type": "string",
            "maxLength": 1500,
            "minLength": 1
          },
          "answer_a": {
            "type": "string",
            "maxLength": 1500,
            "minLength": 1
          },
          "answer_b": {
            "type": "string",
            "maxLength": 1500,
            "minLength": 1
          }
        },
        "required": [
          "reference",
          "answer_a",
          "answer_b"
        ],
        "additionalProperties": false
      },
      "minItems": 1,
      "maxItems": 200,
      "default": [
        {
          "reference": "Paris",
          "answer_a": "Paris",
          "answer_b": "London"
        }
      ]
    }
  },
  "required": [
    "examples"
  ],
  "additionalProperties": false
}

Customer retains rights to supplied content. Generated/model-derived outputs require customer review; base-model licences apply.