From pilot to production: AI inside governed workflows

From pilot to production: AI inside governed workflows

Capmark research · Published 26 June 2026

At a glance

~1 in 20

Custom AI tools that reach production in financial services

Source: MIT (2025)

Up to ~80%

Cost reduction available from caching, prompt design and right-sizing the model

Source: Capmark analysis of LLM pricing, prompt caching and model right-sizing

3

Deployment patterns that keep customer data under the institution's control

Source: Capmark analysis

Summary

Most financial institutions run AI pilots; far fewer run AI in day-to-day operations. MIT's 2025 research found only around one custom tool in twenty reaches production. The gap is rarely the technology.

The paper sets out the three gates that decide the outcome — data the institution can prove, model risk it can validate, and a named owner accountable for the result — alongside the two questions banks ask first: what does this cost at scale, and where does our data go. The same workload can run at a fraction of its unengineered cost through caching, prompt design and matching the model to the task, and three deployment patterns keep customer data under the institution's control, with personal data masked before the model ever sees it.

The full paper covers the use cases that pay first — screening, surveillance and client onboarding, drawn from production deliveries in regulated institutions — plus the EU AI Act timetable and the governance supervisors now expect. Sources include MIT NANDA and Lenovo/IDC.

Download

Get the full paper

Enter your email to download “From pilot to production: AI inside governed workflows”. We use it to deliver the PDF and, if you opt in, related insights.