For three years, managed AI APIs were priced below what heavy usage actually costs to serve. Pilots were cheap, agents were cheap, and nobody asked what a few hundred of them would cost in production. Now flat-rate plans are giving way to metered, token-based billing, and teams running agentic workloads are reporting bills two or three times higher than before. ServiceNow has reportedly burned through its full-year Anthropic budget in the first months of 2026. In this week’s newsletter, we look at what’s really driving the token bleed, and it’s often not the model. When an agent has to dig through a chaotic, ungoverned data lake to find a basic answer, every lookup becomes an expensive round trip. Swapping one LLM for another won’t fix that. Fixing the data foundation and the pipeline around it will. Here are 3 levers that bring AI spend back under control: - 🧮 Token budgets and semantic caching: Learn how to cap what an agent can “spend” on a task directly in the orchestration layer. You’ll also see why an expensive answer about last quarter’s revenue should be generated once, cached, and served locally instead of paid for again with every new question. - 🔓 Open-weight models, with honest math: See how close open-weight models like DeepSeek V4 Pro, GLM-5.2 and Kimi K3 have come to the proprietary frontier, and how to calculate real TCO for self-hosting. With H200 rentals around $4.30 to $4.90 per GPU-hour and frontier-scale models needing far more than a single card, utilization and cluster size decide whether self-hosting saves money or burns it. - 🔀 Hybrid fallback routing: Discover why treating every prompt the same is a recipe for financial ruin, and how policy-driven routing sends queries to a local or hosted open-weight model first, escalating to a premium API only when the request truly needs it. Before you cut your model or your budget, ask which one is actually the problem. A cheaper model lowers the price per token. A clean data foundation lowers the number of tokens. Only one of those keeps working when prices rise again.