Lingua Language Detection

This evaluator detects the language of the input and output text to check for example if the generated answer is in the same language as the prompt, or if it’s in a specific expected language.

POST /lingua/language_detection/evaluate

Python

Experiment

import langwatch

df = langwatch.datasets.get_dataset("dataset-id").to_pandas()

experiment = langwatch.experiment.init("my-experiment")

for index, row in experiment.loop(df.iterrows()):
    # your execution code here
    experiment.evaluate(
        "lingua/language_detection",
        index=index,
        data={
            "output": output,
            "input": row["input"],
        },
        settings={}
    )

200

[
  {
    "status": "processed",
    "score": 123,
    "passed": true,
    "label": "<string>",
    "details": "<string>",
    "cost": {
      "currency": "<string>",
      "amount": 123
    }
  }
]

Authorizations

X-Auth-Token · string · header · required

API key for authentication

Body

application/json

output · string · required

The output/response text to evaluate

input · string

The input text to evaluate

settings · object

Show child attributes

Response

200

application/json

Successful evaluation

status · enum<string>

Available options: processed, skipped, error

score · number

Numeric score from the evaluation

passed · boolean

Whether the evaluation passed

label · string

Label assigned by the evaluation

details · string

Additional details about the evaluation

cost · object

Show child attributes