Test AI models v2.0 is hereSee what's new
Test AI models

Chat test

Chat with several AI models at once. Each answers in its own conversation.

Run your first test free
  • 10k free credits
  • No card

Send one message to several models at once. Each keeps its own conversation, so you compare replies turn by turn.

How it works in three steps

A back-and-forth with several models, side by side.

  1. Pick the models

    A chat test skips the prompt step. Pick your models, and if you like, a name, a project and a system prompt for every conversation.

  2. Send a message

    It goes to every model you picked. Each model keeps its own history and never sees another model's replies.

  3. Compare, then ask the next thing

    Each message gets a row of reply cards, one per model, so you read every answer before you decide what to ask next.

What you get while you chat

Separate conversations, side by side

You are having several independent conversations at once, not one shared thread, so each reply reflects only that model's own history.

Settings always in view

A compact row at the top keeps the test's key settings in view while you chat: model, temperature, top P and max tokens.

Cost as you go

Each message shows the credits needed to start before you send it, with no popup in front of every message.

One system prompt for all

Set a system prompt before you start, and it applies to every model's conversation.

When a model is retired

If a provider retires a model mid-conversation and a successor is confirmed, your next message continues with the replacement.

The details before you start

What it costs

Each message shows the credits needed to start before you send it. A reply's cost grows with the conversation so far, since each model reads its own history.

On both plans

Chat tests are on both plans, with up to 10 models per test on Pay as you go and up to 20 on PRO.

Where your messages go

Each message, that model's conversation so far and your system prompt go to the company behind each model you pick.

What it does not have yet

Reasoning effort and a few other compare-test settings are not offered on chat tests yet. Each message uses the model's default behavior.

Questions about chat tests

Anything else, write to us or book a demo.

How is a chat test different from a compare test?

A compare test is one prompt and one round of answers. A chat test is an ongoing back-and-forth: each message goes to every model you picked, and each model keeps its own conversation.

Do the models see each other's replies?

No. Each model only sees its own conversation, so you are running several independent conversations side by side.

What happens if a model is retired mid-chat?

Where a live successor is confirmed, your next message continues with the replacement model, which takes over the earlier replies as its own history.

Can I set reasoning effort in a chat?

Not yet. Chat tests use each model's default behavior for every message.

Find the cheaper model before your next invoice

  • 10k free credits
  • No card
  • No API keys
Run your first test free