The Test AI models blog
Real tests, plain guides and product updates on choosing AI models by cost, speed and quality.
Startup.Talk interviewed us: "Data is our moat"
Startup.Talk published an interview with our founder on November 18. Here is what we mean by data as a moat, and what it means for your prompts.
Read the postCost per run vs price per token: what a model costs
A price per token is a rate, not a bill. What goes into the cost of one run, why a cheaper rate can cost you more, and how to check it on your real prompt.
Read the post14 AI models on 5 freight documents: what we found
Zonik AI, a logistics product we co-founded, compared 14 AI models on 5 documents from 3 broker templates in Test AI models. What it found, and what it does not show.
Read the postHow alerts watch a test, and what they cost
An alert re-runs a test on a schedule and tells you when a cheaper model, a price rise, a slower model, or a changed answer shows up. How to set one up.
Read the postHow to write a pass rule for the quality check
The quality check marks each answer against a rule you write. What a good pass rule looks like, with weak and strong examples you can copy and adapt today.
Read the postTest AI models 2.0: we rebuilt the whole app in code
We moved Test AI models from a no-code MVP to a full product in code. Chat tests, a quality check, workflows, alerts, and credits you see before every run.
Read the postWhere your prompt goes when you run a test
Testing AI models means sending your prompt to other companies. Who receives it in Test AI models, what we store and where, and what you can switch off.
Read the postWorkflows: test each model step of your pipeline
A workflow runs up to 10 tests together and keeps their history, so you can see which model-calling steps of a pipeline or agent can move to a cheaper model.
Read the postFind the cheaper model before your next invoice
- 10k free credits
- No card
- No API keys