Pinned
Topics is now GA on all plans.
Continuously find the patterns worth investigating across your production traffic.
Braintrust
@braintrust
Active observability for agents in production.
Joined August 2023
- What's new: - Braintrust's Eval library, a resource of open source evals and 20+ skills, for running your own evals and inspecting our results - Kimi K3 and DeepSeek V4 join the Braintrust model lineup across playgrounds, prompts, and the Gateway, no AI provider setup required -
- There are two ways to score a coding agent. By its output, or by its behavior. Output scoring tells you if the agent produced a desired result, but can miss cases where the agent does something it was instructed not to. So we ran an eval to see if scoring by behavior can catch
- Join @ankrgyl at @browserbase's Navigate conference for a panel on the state of agent infra. Thursday, Sep 10 in San Francisco. More here → browserbase.run/zJ0Bkjp
- Evals are hard. Good eval research should be accessible. At Braintrust, we have unique access to how leading AI teams think about quality. We study the best existing research and conduct our own experiments. Today we're making this work available in one place, with an open
