Cloudflare AI Gateway Adds Real-Time Spend Limits, Identity-Driven Budgets

CloudflareCloudflare

· Updated

Cloudflare's AI Gateway now offers real-time spend limits to control token costs across various AI providers. This update, combined with identity-driven budgets via Cloudflare Access, helps companies manage AI expenses and attribute usage to specific users or teams. It addresses the challenge of runaway bills and lack of visibility in enterprise AI deployments.

Cloudflare AI Gateway now includes real-time spend limits, allowing organizations to set dollar-based budgets for AI usage across multiple providers and models. Limits can be scoped by model, provider, or custom attributes (user, team, application), with daily, weekly, or monthly windows. When a budget is met, the gateway can block requests or reroute them to a fallback model.

This update addresses unmanaged AI costs and lack of visibility, often leading to overspending on frontier models for routine tasks. By providing granular cost control and attribution, AI Gateway helps companies track ROI and manage AI expenses like other business line items. It builds on its existing capabilities for unified billing and logging across multiple providers.

Spend limits are in open beta now, set from the dashboard or the API. A closed beta adds identity-driven budgets through Cloudflare Access, so a limit can attach to a specific user, team, or even an autonomous agent — with the cost broken down the same way.

Cloudflare
Cloudflare
@Cloudflare
X

AI Gateway now features real-time spend limits to prevent runaway token bills across multiple AI providers. By integrating with Cloudflare Access, companies can use identity-driven budgets and policies. https://t.co/tsW1Q5Vhso

21retweets184likes
View on X

Every HeadsUpAI update is written based on its original source and reviewed before it's published. Read our editorial standards →

Share this update