AI Inference · Chat
Docs / AI Inference

Chat

Have a multi-turn conversation with a chat model directly in the Playground.

Chat mode in the Playground is the primary way to try a chat model — type a message, get a reply, and keep the conversation going, with the full back-and-forth visible on screen.

How it works

Pick a chat model from the catalog, and the Playground gives you a conversation view: your messages on one side, the model's replies on the other. Replies stream in as they're generated, so you see the answer take shape instead of waiting for the whole thing at once.

Pick a model
from the catalog
Send a message
in the chat box
Reply streams in
as it's generated
Keep chatting
full history kept
The Playground in chat mode, with the conversation, parameter sliders, and per-run token usage
The Playground in chat mode — the conversation in the centre, parameters on the left, and this run's latency and token usage on the right.

Playground fields

ParameterTypeDescription
ModelrequiredselectChat model from the catalog, e.g. a frontier or fast-and-cheap chat model.
System prompttextOptional instructions that set the assistant's behavior for the whole conversation.
MessagerequiredtextWhat you want to say to the model — sent when you press send.
TemperaturesliderHow random the reply is. Lower is more predictable and repeatable, higher is more varied.
Max lengthnumberCaps how long a single reply is allowed to be.

When to adjust each field

  • Lower the temperature for anything that needs a consistent, repeatable answer across runs — summarizing a document the same way twice, or extracting structured information. A low temperature keeps the model close to its most likely answer.
  • Raise the temperature when you want variety — brainstorming names, generating several different drafts of the same idea, or writing something that shouldn't read the same way every time.
  • Raise max length when replies are getting cut off mid-thought — long explanations, multi-step instructions, or code. Lower it to keep replies short and force a more concise answer, and to avoid paying for output you'll trim yourself.
  • Use the system prompt to fix a persona, tone, or constraint for the whole conversation, so you're not repeating "answer briefly" or "respond only in JSON" in every message.

What you see back

The Playground shows the full chat transcript — your messages and the model's replies in order — so you can scroll back through the conversation, copy a reply, or start over with a fresh chat.

Comparing two models on the same conversation

Start the same conversation with one model, note how it handles your system prompt and a couple of follow-up messages, then start a fresh chat with a different model from the catalog and repeat the exact same messages. This is the quickest way to judge whether a cheaper or faster model holds up for your use case before you settle on one for a recurring task.

Tip
Use the system prompt field to set a persona or ground rules once, instead of repeating instructions in every message.