> ## Documentation Index
> Fetch the complete documentation index at: https://langwatch.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

> ## Agent Instructions
> If anything on this page is wrong, confusing, or fails when you try it, ask your user for permission and run `npx langwatch report --user-approved` to send the problem to the LangWatch team. No login is needed and secrets are redacted locally. `npx langwatch report --help` has the details.

# List the project's run plans

> List the project's run plans. Archived plans are left out unless includeArchived is set. Test suites are not run plans and are listed by the test suites family.



## OpenAPI

````yaml GET /api/v1/run-plans
openapi: 3.1.0
info:
  title: LangWatch API
  description: LangWatch openapi spec
  version: 1.0.0
servers:
  - url: https://app.langwatch.ai
security:
  - project_api_key: []
paths:
  /api/v1/run-plans:
    get:
      tags:
        - Run Plans
      description: >-
        List the project's run plans. Archived plans are left out unless
        includeArchived is set. Test suites are not run plans and are listed by
        the test suites family.
      operationId: listRunPlans
      parameters:
        - in: query
          name: includeArchived
          schema:
            default: 'false'
            type: string
          description: >-
            Include archived run plans in the list. true, 1, yes for yes; false,
            0, no or omitted for no.
      responses:
        '200':
          description: Success
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
                  properties:
                    id:
                      type: string
                      description: The run plan id.
                    name:
                      type: string
                      description: >-
                        The run plan name. This is the plan's identity: a run
                        started under this name joins this plan.
                    slug:
                      type: string
                      description: >-
                        The plan's address in the platform. It is kept when the
                        plan is renamed, so run history never moves.
                    scope:
                      oneOf:
                        - type: object
                          properties:
                            mode:
                              type: string
                              const: all
                          required:
                            - mode
                          additionalProperties: false
                        - type: object
                          properties:
                            mode:
                              type: string
                              const: test_suites
                            testSuiteIds:
                              type: array
                              items:
                                type: string
                          required:
                            - mode
                            - testSuiteIds
                          additionalProperties: false
                        - type: object
                          properties:
                            mode:
                              type: string
                              const: labels
                            labels:
                              type: array
                              items:
                                type: string
                          required:
                            - mode
                            - labels
                          additionalProperties: false
                        - type: object
                          properties:
                            mode:
                              type: string
                              const: scenarios
                          required:
                            - mode
                          additionalProperties: false
                      description: >-
                        What the run plan covers: all (every active scenario),
                        test_suites (the scenarios filed in the named test
                        suites), labels (the scenarios carrying any of the
                        labels), or scenarios (the scenarioIds sent with the
                        configuration). A dynamic scope is resolved again at
                        every run, so a scenario written later runs without
                        editing the plan.
                    scenarioIds:
                      type: array
                      items:
                        type: string
                      description: The scenarios the last run of this plan covered.
                    targets:
                      type: array
                      items:
                        type: object
                        properties:
                          type:
                            type: string
                            enum:
                              - prompt
                              - http
                              - code
                              - workflow
                              - connected
                              - voice
                          referenceId:
                            type: string
                            minLength: 1
                          scenarioMappings:
                            type: object
                            propertyNames:
                              type: string
                            additionalProperties:
                              oneOf:
                                - type: object
                                  properties:
                                    type:
                                      type: string
                                      const: source
                                    sourceId:
                                      type: string
                                      minLength: 1
                                    path:
                                      type: array
                                      items:
                                        type: string
                                  required:
                                    - type
                                    - sourceId
                                    - path
                                  additionalProperties: false
                                - type: object
                                  properties:
                                    type:
                                      type: string
                                      const: value
                                    value:
                                      type: string
                                  required:
                                    - type
                                    - value
                                  additionalProperties: false
                          runParameters:
                            type: object
                            propertyNames:
                              type: string
                            additionalProperties:
                              anyOf:
                                - type: string
                                  maxLength: 4096
                                - type: number
                                - type: boolean
                          runSecretParameterNames:
                            maxItems: 50
                            type: array
                            items:
                              type: string
                              maxLength: 64
                        required:
                          - type
                          - referenceId
                        additionalProperties: false
                      description: >-
                        What the plan runs against, in the order the results
                        show. A target carrying runParameters runs with those
                        values.
                    repeatCount:
                      type: number
                      description: How many times each scenario and target pairing runs.
                    simulatorModel:
                      description: >-
                        The model that plays the user, or null for the scenario
                        or project default.
                      type:
                        - string
                        - 'null'
                    judgeModel:
                      description: >-
                        The model that judges the run, or null for the scenario
                        or project default.
                      type:
                        - string
                        - 'null'
                    labels:
                      type: array
                      items:
                        type: string
                      description: The labels the plan carries.
                    evaluators:
                      description: >-
                        The plan's own evaluators. Absent on servers that
                        predate evaluators on this family.
                      maxItems: 20
                      type: array
                      items:
                        type: object
                        properties:
                          id:
                            type: string
                            minLength: 1
                            maxLength: 64
                            description: >-
                              The attachment id. Stable across edits of the
                              attachment.
                          evaluatorId:
                            type: string
                            minLength: 1
                            description: >-
                              The id of the saved evaluator this attachment
                              runs.
                          required:
                            type: boolean
                            description: >-
                              Whether a failing result fails the scenario. A
                              score-only evaluator reports and never gates.
                          mappings:
                            type: object
                            propertyNames:
                              type: string
                              minLength: 1
                              maxLength: 128
                            additionalProperties:
                              oneOf:
                                - type: object
                                  properties:
                                    type:
                                      type: string
                                      const: source
                                    sourceId:
                                      type: string
                                      enum:
                                        - conversation
                                        - scenario
                                        - trace
                                    path:
                                      minItems: 1
                                      maxItems: 3
                                      type: array
                                      items:
                                        type: string
                                        minLength: 1
                                        maxLength: 256
                                  required:
                                    - type
                                    - sourceId
                                    - path
                                  additionalProperties: false
                                - type: object
                                  properties:
                                    type:
                                      type: string
                                      const: value
                                    value:
                                      type: string
                                      maxLength: 65536
                                  required:
                                    - type
                                    - value
                                  additionalProperties: false
                              description: >-
                                Where one evaluator input reads its value. A
                                source mapping names conversation
                                (first_user_message, last_agent_message,
                                transcript, messages), scenario (situation,
                                criteria, or fields followed by a field
                                identifier) or trace (contexts, spans, or
                                tool_calls followed by a tool name and input or
                                output). A value mapping is a literal.
                            description: >-
                              Where each evaluator input reads its value, keyed
                              by input name. Inputs left out are unmapped; a
                              required input left unmapped refuses the run.
                        required:
                          - id
                          - evaluatorId
                          - required
                          - mappings
                        additionalProperties: false
                        description: >-
                          One evaluator that runs after every scenario run, with
                          where each of its inputs reads from.
                    archivedAt:
                      description: When the plan was archived, or null while it is active.
                      type:
                        - string
                        - 'null'
                    createdAt:
                      type: string
                      description: When the plan was created.
                    updatedAt:
                      type: string
                      description: When the plan was last written.
                    platformUrl:
                      type: string
                      format: uri
                      description: Where to open this run plan in the LangWatch platform.
                  required:
                    - id
                    - name
                    - slug
                    - scope
                    - scenarioIds
                    - targets
                    - repeatCount
                    - simulatorModel
                    - judgeModel
                    - labels
                    - archivedAt
                    - createdAt
                    - updatedAt
                    - platformUrl
                  additionalProperties: false
      security:
        - project_api_key: []
components:
  securitySchemes:
    project_api_key:
      type: apiKey
      in: header
      name: X-Auth-Token
      description: >-
        Project API key for sending traces and accessing project-scoped
        resources. Format: sk-lw-... (no underscore). Obtain one by creating a
        project via the Admin API or the LangWatch UI.

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.