Skip to main content
Who is it for? Heads of AI, ML and data science, their teams, and the data teams that own the training data. You do not need a research team to run a training loop. Mid-training or post-training? Both. Mid-training continues training on your domain data so the model knows your world. Post-training with SFT, DPO or GRPO teaches it how to behave. Most teams start with post-training. Do I have to change my agent? No. The SDK reads what the agent does, from its traces or from its tools and policy. The agent keeps running where it runs today. See connect your agent. What if my agent is not in production yet? Describe the behavior you want in a sentence. The SDK drafts the policy and the simulated rollout set from it, so there is training data before there is traffic. Do I need a key? Not to start. simulator=False writes situations from templates, seeded_agent stands in for an agent, and a lambda can be the judge, all offline. A key adds the hosted situation writer, the hosted judge, dataset storage, training and serving. See install. How do I know it got better? Every run ends with pass@1 per task category, before and after, on a held-out set with a 95% confidence interval. If the interval includes zero, nothing ships. Which models can it train? Open models you own at the end: Qwen, Llama, Nemotron and other open-weight families. Training runs SFT, DPO or GRPO on hosted GPUs, and the result is served from your own endpoint. See the platform reference. Where do the rollouts come from? From your agent’s own tools and policy. A separate model plays the customer, a mock world answers the tool calls, and every conversation is scored against a written rubric before it is kept. See how it works. Is the judge another LLM? Yes, when you do not pass a program. So it is measured against gold labels, probed with known hacks, versioned by rubric hash, and drawn from a different model family than the policy. See the engine. What happened to zeroproof? Same package, renamed in 0.51. pip install zeroproof and import zeroproof.simulations still work and give you whileai.