Pre-Clooney stack
A Python routing service maintained by two engineers, three separate MLOps tools for evals and traces, and a custom usage-metering pipeline feeding their billing system. Every new model provider was a six-week integration project.
- Two engineers dedicated full-time to "router maintenance"
- No consistent trace schema across agents
- SOC 2 audit blocked on observability gaps for 4 months