Test AI models v2.0 is hereSee what's new
Test AI models

Test it. Check it. Keep monitoring it.

Run your first test free
  • 10k free credits
  • No card

Test your real prompt on many models, check the answers against your own rule, monitor them for changes, and explore what wins. Pick a feature to see how it works.

Use cases what teams use it for

Two moments: before you build, and again when the API bill grows.

Works for data extraction, classification, support replies, summaries, translation and more.

Explore what is out there and what wins

Every active model with its prices, and benchmarks from the accounts that share their results.

Manage the account side

The parts that keep your tests, spend and help in one place.

Home dashboard and analytics

See your latest tests, recent activity and alerts on Home, and where your credits go on Analytics.

Projects

Group related tests and workflows so they are easy to find later.

Credits, billing and spend caps

Top up credits, manage PRO, and set a spend cap per alert check or workflow run.

Help, docs and status

Read how every feature works, what it costs and where your prompt goes.

Nine providers, tested the same way

50+ models from nine providers, with new ones added within days of release. Every model is called the same way on the same prompt, so no provider gets a head start.

Anthropic
OpenAI
Google
xAI
DeepSeek
Mistral
Moonshot
Qwen
Perplexity
Claude Opus 4.6Anthropic
Claude Sonnet 5Anthropic
Gemini 3.1 Pro PreviewGoogle
Gemini 3.1 Flash LiteGoogle
Claude Sonnet 5.5Anthropic
GPT-5.5OpenAI
Grok 4.3xAI
DeepSeek V4.1 FlashDeepSeek
Mistral Small 4Mistral
50+ models, 9 providers
Explore all models

What is different here

Trackers tell you that you are overpaying. Benchmarks tell you how models did on someone else's prompts. This tells you what to switch to, tested on your prompt and checked against your rule.

FeatureTest AI modelsOther testing toolsBenchmark platformsManual testing
Test your own promptsYesYes-Yes
Quality check against your own ruleYesSome tools-Manual only
Real API callsYesYes-Yes
Exact cost of every callYesSome show costs-Can be implemented
Switching with proofTest first, alerts after you switchVaries by toolResearch onlyYes
Time to first resultAbout a minute, no setupVaries by toolInstant comparisonSlow: one model at a time
API keysNo API keysVaries by toolNo API keysNeed 9+ accounts
What it costs10,000 credits on signup, then pay as you go, PRO optionalPaid tiers or self-hostedFreeA paid account with each provider

Know where your prompt goes before you run it

Your prompt goes to the models you pick. Two things also see it: the task label, sent once to Anthropic (or OpenAI as a fallback), and the judge models if you run a quality check. Prompts and answers are kept until you delete them, hosted in Frankfurt, and each account only sees its own data.

Read the privacy details

Check it for yourself

What we're building next

Building in public - shipping features teams ask for most.

  1. Smart alerts

    Built

    Re-run a test or workflow on a schedule and get an email when cost, speed or the answer changes.

  2. Quality check (LLM-as-judge)

    Built

    Write a pass rule in plain words and a panel of judge models marks each answer pass, fail or uncertain.

  3. API access

    Planned

    Run tests and read results programmatically from your own code and pipelines.

  4. MCP access

    Planned

    Connect Test AI models to AI assistants and agents through an MCP server.

  5. New model alerts

    Planned

    Get an email when a new model is added to the platform.

  6. System prompts

    Planned

    Test and compare system prompt variants across models on the same workload.

  7. Quality regression checks

    Planned

    Run the quality check automatically on scheduled alerts to catch drift when you switch models.

Find the cheaper model before your next invoice

  • 10k free credits
  • No card
  • No API keys
Run your first test free