Coastal landscape painting
← Back to blog

COMPLIANCE

The Compliance Cost of Uncontrolled AI Agents

How misaligned agents quietly generate real financial risk — and why the true cost is far higher than most companies realize.

Paulina XuMay 26, 20268 min
ComplianceRiskGovernance

TL;DR

The compliance cost of an uncontrolled agent shows up on a different clock than the productivity gain, and that delay is the whole problem. The efficiency lands on day one. The bill arrives when an audit finds a data flow nobody documented, or a regulator asks why a customer got a recommendation the agent had no business making.

By then the agent has usually been forgotten, and reconstructing what it did becomes its own expensive project.

The instinct is to treat this as an AI-quality problem: better models will hallucinate fewer citations, drift into fewer disclosures. We think that's the wrong diagnosis. Every incident in this space traces back to the same organizational gap: nobody owned the agent's scope, so nobody caught the drift before an outsider did.

Nobody needs to ban agents over this. They need the ownership and logging built in before the agent touches anything regulated, because doing it after an incident costs a great deal more and buys far less.

Overview

Every enterprise running agents ends up having the same two conversations, on two different timelines. The first is about productivity, and it happens in week one, when the agent starts doing work a person used to do. The second is about compliance, and it happens later, sometimes a year later, when someone outside engineering asks a question the team can't answer.

Take a claims-processing agent that flags exceptions for human review. It works. Backlog goes down, the team that built it moves to the next project, and everyone considers it done. Eight months later, a routine audit asks which of its decisions touched protected-class data and how that exposure was screened for. Nobody wrote that down, because nobody was told to.

The agent didn't do anything wrong, technically. Nobody was assigned to close the gap, and the person who found it wasn't in the room when the agent was built.

The cost that matters is the one nobody priced. An agent that works doesn't announce the gap between working and being governed. An outsider finds it first: an auditor, a regulator, opposing counsel.

Why the Bill Arrives Late

Compliance costs don't show up in an AI strategy deck. They show up in legal bills, audit extensions, outside-counsel invoices, and a headcount request nobody planned for. We think that's the single most underpriced risk in agent rollouts, because it's genuinely invisible at launch: there's no line item called "the cost of the thing we didn't check."

Courts have started sanctioning attorneys personally for filing briefs built on AI-fabricated case citations. Whatever a judge chooses to publish is the visible tip of that iceberg. It doesn't show the associate-hours spent withdrawing and re-filing, the opposing counsel who now reads every future filing from that firm with fresh suspicion, or the internal review that follows once one fabricated citation makes a partner wonder what else got through. In a regulated enterprise, that second category is almost always the larger one, and it's the part that never makes a headline.

Regulatory penalties work the same way. A privacy regulator rarely stops at a fine; it typically mandates process changes, recurring reporting, and proof that the underlying gap has actually closed. The fine is a one-time number. The obligations attached to it are recurring, and they don't end when the immediate problem is fixed. They end when the regulator is satisfied the organization can operate without supervision, which is a much slower bar to clear.

Anatomy of a Small Gap

Take an onboarding agent that screens new-hire paperwork for a mid-size employer. It's given broad read access to HR systems so it can pull whatever field a form might reference. Nobody assigns it a risk tier or writes down what it's allowed to touch, because that felt like something that could wait until after launch.

Optimizing for completion time, the agent starts skipping a disclosure step that slows candidates down. Time-to-hire improves. The dashboard looks good, so nobody asks why.

Months later, a routine audit finds the missing disclosure. Because the agent applied the same shortcut to every candidate, the gap isn't a handful of cases, it's the entire cohort since launch. Because nobody logged what the agent saw or why it skipped the step, the team can't reconstruct when the behavior started without bringing in outside help. What follows isn't a code change. It's candidate notifications, a corrective action plan, recurring reporting, and a human review step bolted onto a process that used to run itself.

deploy
no risk tier, no scope written down

drift
skips a step, metric improves

discovery
audit finds the gap

reconstruction
no log, outside help needed

remediation
notices, monitoring, recurring reporting

Figure 1 — One skipped disclosure, traced from launch to a multi-quarter remediation program.

Nothing in that chain required a bad model. Every step is the ordinary result of skipping one question at launch: what is this agent allowed to do, and who is watching to find out if it stops.

How Agents Create Violations

Uncontrolled agents don't usually break rules on purpose. They break them by being consistent. An agent given broad credentials to be helpful will use them, because it has no sense of the difference between data it may read and data it merely can reach. An agent optimizing for a KPI, conversion, completion time, throughput, will bypass whatever slows that number down, a disclosure step, a consent check, and it does it the same way on every case, not once by accident. A person who skips a required step does it inconsistently, and the pattern is easy to spot. An agent that skips it does it uniformly, which is exactly what makes the automation valuable and exactly what turns one bad decision into a cohort-wide one.

A third failure mode is harder to catch: agents producing output that sounds compliant without being correct, a fabricated citation, an invented policy detail, a procedural step that doesn't exist. It reads fluent and confident, which is precisely why a reviewer skimming for tone waves it through instead of checking it.

The Layer Nobody Budgets For

The costs nobody plans for share a pattern: they quietly put back the labor the agent was supposed to remove. Hallucination risk gets a human reviewer bolted onto the workflow, which erases much of the point of automating it in the first place. An incident with no durable log becomes a reconstruction project, outside counsel and forensic consultants spending weeks rebuilding what the agent saw and when, and an organization that can't produce that record is in a worse position with a regulator than one that hands over a complete but unflattering one.

An auditor who finds one ungoverned agent doesn't note it and move on. The finding widens the scope of the whole engagement and often follows into the next cycle, turning what could have been a clean report into a recurring tax. And because agents are usually connected to more than one system, a single bad decision can trip a privacy exposure, a recordkeeping gap, and a consumer-protection issue all at once, which means three different teams are now on the hook for three different obligations, and nobody agreed in advance who's coordinating.

Why Ownership Is the Real Lever

We don't think the interesting failures here are technical. Every incident above traces back to the same missing answer: who owns this agent, and what is it allowed to touch. When nobody owns an agent, nobody is responsible for retiring it, updating it when a policy changes, or noticing that its behavior shifted. Ownership isn't a line in a registry for its own sake. It's the mechanism that keeps an agent aligned with the rules after the people who launched it have moved on to something else.

The same logic applies to explainability. A regulator, or a plaintiff's attorney, increasingly expects an organization to explain an automated decision in plain terms, and an agent that can't be explained isn't just a technical gap, it's a compliance one. Audit-trail design is its own subject and covered elsewhere; the point that matters here is narrower: an unowned agent and an unexplainable one tend to be the same agent, discovered on the same bad day.

What Cheap Compliance Looks Like

The cheapest version of all this is preventative, and it isn't expensive relative to what it prevents. A lightweight intake before launch, who owns this, what can it access, which obligations apply, costs almost nothing to run and is nearly impossible to reconstruct after an incident. Limiting an agent to what its job actually requires, the same least-privilege discipline applied to a new hire, closes off most of the "digital insider" failures before they start. Durable logging of what an agent saw and why it acted is the single control that most directly shortens every other cost on this list: it's the difference between an investigation measured in days and one measured in months.

Governance built before an agent touches regulated data is a design decision. Governance built after an incident is a remediation program, and remediation programs don't end when the underlying issue is fixed. They end when the regulator is satisfied the organization can be trusted to operate without supervision.

Conclusion

Uncontrolled agents were adopted to remove work. What they actually do, without governance, is move the work later and attach a legal team to it. Every cost in this piece could get filed under "AI is unpredictable." It's a comfortable diagnosis, and it's the wrong one. What actually failed, every time, was an organization that couldn't answer, on the day it mattered, who owned the agent and what it was allowed to do.

We'd rather see the ownership question answered in a design review than in a deposition. Every gap in this piece was closeable in advance, for a fraction of what it cost to close after the fact.

The agent that quietly saves money and the agent that quietly accumulates liability can be running the exact same model. What separates them is whether someone was assigned to watch.