Certified self-improvement
Evaluate proposed changes without confusing adaptive benchmark gains for real population improvements.
We are advancing the science of reliable AI agents—bringing statistical rigor to autonomous analysis, continual improvement, and decision-making.
AI agents are no longer static tools. They search, decide, write code, and increasingly improve themselves. But a better benchmark score does not necessarily mean a truly better or statistically valid agent.
STATrust brings statistical thinking into the agent lifecycle: understanding what an agent has learned, what its evaluation actually proves, and when it is safe to move forward.
See how we approach the challenge ↗Three complementary research directions help make evolving agents more reliable. Their guarantees apply under specific mathematical assumptions.
Evaluate proposed changes without confusing adaptive benchmark gains for real population improvements.
Investigate how evolving analytical agents can maintain statistical error guarantees as their versions change.
Account for an agent's search process when evaluating scientific findings and statistical evidence.
“An agent should not be trusted simply because it reports a better result. The evidence must support the claim.”
Bioequivalence is our first application—not the limit of our ambition. We envision a family of research-oriented AI agents and statistical assurance tools.
An AI agent for bioequivalence statistical workflows, combining language-model orchestration with controlled statistical tools in Python and R.
Research software for evaluating proposed updates, validating agent behavior, and integrating statistical safeguards into agent development workflows.
STATrust draws on research in adaptive data analysis, statistical testing, and autonomous AI systems. We aim to turn sound mathematical ideas into practical tools.
Explore REUSE research ↗Reliable self-improvement when agents reuse their benchmarks.
Interested in research collaboration, early product feedback, or exploring statistically grounded agentic AI?