Performance & Cost

Success rate, throughput, spend and evaluations

PO

Average success rate

93.8%

Agent minutes today

14h 24m

Across tasks completed today

Spend today

$41.40

Monthly budget

$1,570

Per-agent caps sum to this ceiling

Agent performance & cost

Throughput, reliability and spend against each agent's cap

AgentTasks todaySuccessAvg minutesSpend todayMonthly capCap used

Product Analyst

reasoning-v3 · v1.4.0

397.2%14$1.90$60
3%

Architecture Agent

reasoning-v3 · v1.2.1

195.8%22$2.40$80
3%

Frontend Agent

reasoning-v3 · v2.1.0

692.4%31$7.80$240
3%

Backend Agent

reasoning-v3 · v2.0.3

590.1%38$9.20$280
3%

Database Agent

reasoning-v3 · v1.8.0

294.6%26$4.10$120
3%

QA Agent

fast-v2 · v3.0.1

1198.3%9$3.60$150
2%

Security Agent

reasoning-v3 · v1.6.2

496%18$5.00$160
3%

DevOps Agent

fast-v2 · v2.3.0

388.5%17$2.20$140
2%

Reliability Agent

fast-v2 · v1.9.4

893.7%7$2.90$130
2%

Support Agent

fast-v2 · v2.4.1

1491.2%5$1.40$90
2%

Licensing Agent

fast-v2 · v1.1.0

089.4%6$0.00$70
0%

Documentation Agent

fast-v2 · v1.5.3

297.8%12$0.90$50
2%

A cap is a hard stop: the agent pauses rather than continuing past its budget. Cost is tracked per run in agent_tool_calls.

Evaluation datasets

A version ships only after it beats the baseline

DatasetCasesCadenceScore
Code change quality240Regression suite on every PR94%
Incident triage accuracy120Weekly, replaying past alerts91%
Support reply quality180Weekly, human-graded sample88%
Policy compliance60Every agent version change100%

Cost & reliability controls

Kept deliberately boring

  • Per-task and per-day caps; a breach pauses the agent and notifies its owner.
  • Workload routing sends tasks to the cheapest agent that meets the quality bar.
  • Failures are reviewed weekly; recurring findings become evaluation cases.
  • Provider changes are configuration, not a rewrite — spend stays comparable.
activepausedfailed