Groq

Add a Groq API key under Settings, Model Providers and call Groq models through the LangWatch AI Gateway.

Add the credential

Open Settings > Model Providers, click Add Model Provider and select Groq. Give the row a name, pick the organization, team or project it belongs to, and fill in:

Field	Value
GROQ_API_KEY	Your Groq API key.

Save the row. Every virtual key whose scope can see the row can now dispatch to it, unless the key restricts its providers. See Virtual keys.

The Groq row: name, scope, GROQ_API_KEY and the routing handle groq.

Model names

Write groq/<model>, for example groq/llama-3.3-70b-versatile. The gateway does not infer Groq from a bare name.

Send a request

curl https://gateway.langwatch.ai/v1/chat/completions \
  -H "Authorization: Bearer $LANGWATCH_VIRTUAL_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "groq/llama-3.3-70b-versatile",
    "messages": [{"role": "user", "content": "Say hi in one word"}]
  }'

Endpoints

Endpoint	Served
POST /v1/chat/completions	Yes
POST /v1/messages	Yes, translated
GET /v1/models	Yes, from the Groq catalog