All sectors

AI cost tracking by project (FinOps)

Cloud infrastructure and model costs are consolidated in euros per AI project, with hard budgets and rate limits. Spending is attributed to the projects that incur it.

Talk to an engineer

Illustrative mock-up: the names, values and documents shown are fictitious.

Context

A portfolio of more than 20 AI experiments on a shared cloud and model gateway.

The problem

AI spend not attributed to projects, and no limits per project.

What we built

A dashboard that ingests, twice a day, cloud costs by application and machine and model gateway costs by key, attributes them to each project, isolates shared infrastructure, and allows budgets to be set.

Steps

01Collection of cloud and model costs
02Attribution rules by project
03Spending and rate limits
04Planned extension to the main platform

Hosting and models

Client's Azure Container Apps; Azure Cost Management API and LiteLLM; no language model.

Services involved

AI & Cloud Strategy

We name a client only with their written agreement. The budgets and detailed results of our engagements remain confidential.