FinOps for AI Overview is the FinOps Foundation's reference guide, co-authored by a broad working group (Google, AWS, MetLife, Wells Fargo, Roche, Accenture, KPMG, EY…) and published under a CC BY 4.0 license. It extends the FinOps discipline to generative AI services, starting from the token as the fundamental unit of consumption, whose "meters" differ profoundly from classic cloud metrics.
The document provides a battery of KPIs with formulas and worked examples: Cost Per Token (total cost / tokens), Cost Per Inference (inference costs / requests, e.g., $0.05), Training Cost Efficiency (cost / accuracy point), ROI ((benefits − costs)/costs × 100), and above all the LLM Model Choice Quality Score Alignment, which compares the minimum MMLU score a task requires against the MMLU of the model actually used, to detect over-provisioning (a sentiment analysis task requiring MMLU 54 should not run on GPT-4).
On the optimization side, the focus is on token reduction (shortening prompts while preserving clarity), caching of repeated responses, model selection ("avoid using the most complex and expensive models for every task"), and model distillation for production.
The structural core maps the 14 capabilities of the FinOps Framework onto "common to cloud" versus "different for AI." The most affected: Allocation (traceability of multi-agent workloads, absence of a standard framework), Planning (estimating successful outputs and separating them from hallucinations), Forecasting (lower predictability in early phases), Benchmarking (per-token metrics, few external benchmarks), Unit Economics (cost-per-call, customer satisfaction per dollar), and Rate Optimization (volatile pricing such as OpenAI Scale Tier).
Maturity progression follows a Crawl → Walk → Run model: fail-fast prototyping and manual calculations at the start; basic tracking automation and anomaly detection next; advanced tracking, integrated financial metrics, and vigilance against cutting costs that compromise non-functional requirements in the Run phase. The document lists eight pricing models (on-demand, reserved/CUD, provisioned — OpenAI Scale Tier, Azure PTU —, spot/batch, subscription, tiered, freemium, hybrid) and favors showback as an awareness lever ahead of chargeback.
A notable limitation: AI agents are not yet treated as a distinct category (only multi-agent workloads surface under Allocation), which explains the value of vendor complements. The guide is accompanied by a Certified FinOps for AI certification and points to FinOps X 2026 (June, San Diego).