> ## Documentation Index
> Fetch the complete documentation index at: https://docs.2501.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Run a benchmark

> One benchmark over the scenarios given, each as its own run. Accepted, not finished. Scheduling is not supported: call this for each occurrence.



## OpenAPI

````yaml /0.16/openapi.json post /api/v1/benchmarks
openapi: 3.0.3
info:
  title: 2501 Public API
  version: v1
  description: >-
    The stable, versioned HTTP API for driving 2501 as code. See the API
    Overview for authentication, the org_id rule, cursor pagination, and the
    error envelope.
servers:
  - url: https://{command_center_host}
    variables:
      command_center_host:
        default: your-command-center-host
        description: Your Command Center host
security:
  - bearerAuth: []
paths:
  /api/v1/benchmarks:
    post:
      tags:
        - Benchmarks
      summary: Run a benchmark
      description: >-
        One benchmark over the scenarios given, each as its own run. Accepted,
        not finished. Scheduling is not supported: call this for each
        occurrence.
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              properties:
                org_id:
                  type: string
                scenario_ids:
                  type: array
                  items:
                    type: string
                  minItems: 1
                  maxItems: 50
                with_agent:
                  type: boolean
                  default: true
                gateway:
                  type: string
                  enum:
                    - runner
                    - servicenow
                  default: runner
                main_engine:
                  type: string
                  minLength: 1
                secondary_engine:
                  type: string
                  minLength: 1
                gateway_engine:
                  type: string
                  minLength: 1
                sequential:
                  type: boolean
                  default: false
              required:
                - org_id
                - scenario_ids
              additionalProperties: false
      responses:
        '200':
          description: The launched benchmark
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/BenchmarkLaunch'
        '400':
          description: >-
            Bad request - a field is missing, malformed, or not allowed
            (VALIDATION_FAILED, BAD_REQUEST, INVALID_CURSOR)
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Error'
        '401':
          description: >-
            No credentials, or a key that is invalid, revoked, or expired
            (UNAUTHORIZED)
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Error'
        '403':
          description: >-
            Authenticated but not allowed (FORBIDDEN, ORG_ACCESS_DENIED,
            STEP_UP_REFUSED, TWO_FACTOR_ENROLLMENT_REQUIRED,
            LICENSE_CAP_REACHED, LICENSE_EXPIRED)
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Error'
        '404':
          description: No such row that this caller can see (NOT_FOUND)
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Error'
components:
  schemas:
    BenchmarkLaunch:
      type: object
      properties:
        benchmark_id:
          type: string
          example: bch_0f4a6d1b-...
        workflow_id:
          type: string
          example: wfl_7d3b9c2e-...
        report_ids:
          type: array
          items:
            type: string
          description: One report per scenario, in the order they were given
      required:
        - benchmark_id
        - workflow_id
        - report_ids
    Error:
      type: object
      properties:
        code:
          type: string
          example: VALIDATION_FAILED
        message:
          type: string
          example: Validation failed
        request_id:
          type: string
          example: req_3702b7e7-...
        field:
          type: string
          description: Set when one input is at fault
        errors:
          type: array
          items:
            type: object
            properties:
              field:
                type: string
              message:
                type: string
            required:
              - field
              - message
          description: Set when several inputs are at fault
        details:
          type: object
          additionalProperties:
            nullable: true
      required:
        - code
        - message
        - request_id
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      description: >-
        An API key minted in Command Center (Settings -> API Keys), sent as
        `Authorization: Bearer 2501_ak_...`. A Command Center session cookie is
        also accepted.

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.