AI transformation is a governance problem: where it belongs in the sequence

Cover image for AI transformation is a governance problem: where it belongs in the sequence

Most AI programs don't stall because the models underperform. They stall because ownership is unclear, approval paths are undefined, and no one can say which systems are running or who has the authority to shut them down. By the time model quality enters the conversation, the real blocker has already taken hold at the organizational layer.

Retrofitting governance after an incident costs far more than building it in from the start. When an agent writes to production overnight, or a regulator asks for an inventory of AI systems, the absence of records becomes the problem. Governance only becomes real when approvals, ownership, inventory, and audit trails live inside the systems where AI actually runs. Teams that build those controls before rollout scale faster than teams retrofitting them after something breaks.

This article makes the case for putting governance first in the AI transformation sequence. It works through the five parts of the governance problem: decision rights, runtime enforcement, visibility, evidence records, and human judgment for actions that are hard to reverse.

Part 1 — Decision rights: AI transformation stalls on decision rights

AI programs stall when decision rights stay implicit. An agent writes to production at 2 a.m. The alert fires, several people pile into the incident channel, and nobody can say who owns the agent, who granted it write access, or who has the authority to stop it.

The decision-rights gap is common enough to show up in survey data. McKinsey's survey found that, on average, two different leaders are responsible for AI governance within the same organization, and only 17% of respondents say their board oversees it.

Analysts increasingly warn that a significant share of enterprises will end up demoting or decommissioning autonomous AI agents due to governance gaps that are only identified after production incidents. Gartner analyst Shiva Varma is direct about the cause: "Enterprises are treating AI agent governance as binary, either locked down or fully trusted, and that is the root cause of failure."

Decision rights also determine whether AI investments connect to anything. A large share of department-level AI initiatives operate without formal approval or oversight, even as IT and security leaders increasingly say governance, privacy, and regulations are top priorities.

Unapproved department-level deployments are exactly the deployments for which nobody can name an owner once they misbehave. Without an approval record, teams have no record of who signed off and no named owner to page at 2 a.m. when scoped permissions need to be revoked.

Part 2 — Runtime enforcement: Policy documents don't govern anything at runtime

A policy document records intent. A runtime control records what actually happened. Most organizations remain far from mature on AI autonomy controls, and the checks and escalation paths tend to lag behind the pace of deployment.

Samsung's 2023 experience shows what advisory-only governance produces. Within weeks of allowing engineers to use ChatGPT, confidential data was leaked into the tool, including proprietary source code. The response was a memo and an upload limit, both applied after the fact.

An operational governance layer replaces memos with mechanisms. It catalogs the AI systems, models, and datasets in use, along with their relationships. It encodes policy as enforceable checks, such as an approval gate that fires before a high-risk action executes. Workflows record who did what, and when a reviewer applied or overrode a policy. Teams test each workflow in a draft environment, review it, and push it live through change control.

Part 3 — Visibility: You can't govern what you can't see

You likely govern a fraction of the AI actually running in your environment. Research consistently shows that IT and security leaders need end-to-end visibility into AI initiatives, yet many organizations still lack basic visibility into where AI is used, what data it touches, and who owns the risk.

Shadow AI is a growing driver of security and compliance incidents, and IBM's breach report found it was a factor in a meaningful share of breaches, with a significant cost premium where shadow AI use ran high.

Blocking doesn't restore visibility when employees already bring unsanctioned AI into work. Knowledge workers routinely bring their own AI tools into the workplace, whether or not the organization sanctions them.

Every AI action needs a sanctioned path with logging and attribution. Requests should flow through a defined intake, get checked against identity and existing system inventory, and land in a record that captures the approval, all without routing every piece of software through a manual IT review that can't scale with demand. Every step, deterministic or AI-driven, should write to the same audit trail.

Part 4 — Evidence: Regulation is turning governance into a market-access requirement

Governance evidence is becoming a condition of selling into the EU market. On August 2, 2026, the EU AI Act's broad enforcement wave takes effect:

  • The European Commission gains enforcement powers over general-purpose AI (GPAI) model providers.

  • Article 50 transparency obligations activate.

  • Enforcement begins at national and EU level.

  • Penalties for prohibited practices reach €35 million or 7% of global annual turnover, whichever is higher.

  • GPAI violations carry fines up to €15 million or 3%.

For a security or IT team, scope analysis is only the start. The answers need to exist as records: which AI systems are running, what data each one touches, who approved each system, which actions reviewers handled, and what happened the last time someone overrode a recommendation.

Inventory, approval, reviewer, and override answers are taken from logs. The person asked for that inventory on a Friday afternoon is usually the person who has never seen a complete list of it. No slide deck assembled after an inquiry lands will substitute, so the work has to happen before rollout.

Part 5 — Human judgment: Human-in-the-loop is an operating discipline

Human-in-the-loop works when decision points are embedded in the workflow, with the inbox used only for notifications. Approval fatigue arrives faster than anyone plans for: queues build up, context gets lost, and within a week people are clicking approve on anything that looks routine. Oversight that depends on reading every request stops being oversight.

Teams getting real value from AI wire the decision points into execution instead, and save human judgment for actions that are hard to reverse, including in the security operations center (SOC), where high-risk remediation requires clear approval paths.

Gartner's agent-governance guidance describes "Act with Approval" as an autonomy level where agents execute actions such as writing data, sending communications, or modifying configurations only after explicit human approval. AI assistance can still speed up investigative work when humans remain on the decision path: a CSA benchmark study found that AI-assisted SOC analysts completed investigations 45 to 61% faster.

Making that discipline real means deciding, inside the workflow itself, which actions run automatically and which wait for a human. A practical pattern mixes three modes:

  • Deterministic: an alert fires a webhook, enrichment steps check indicators against threat intelligence sources, and a populated case opens in the team's ticketing system.

  • Agentic: an AI agent reads the case, scores the alert, and drafts a recommended action, with routing based on configured confidence thresholds.

  • Human-in-the-loop: low-confidence results route to a chat channel with one-click approve or override, and on approval, a containment action executes.

This execution mix gives teams a practical way to match control level to risk. The programs that make that choice before rollout are the ones that can scale without later rebuilding governance.

Governed programs move faster than ungoverned ones

Sequence determines outcome. Programs that build governance in from the start move faster than those that retrofit it after an incident, because clear ownership, approval paths, and audit trails give teams the confidence to scale rather than pause. 

The failure pattern is familiar: governance gets scoped as a later phase, autonomy keeps expanding, and the gaps only surface once something breaks.

An AI-native environment built for this sequence gives IT and security teams a single place to run, monitor, and govern the agents, apps, and automations employees are already building — with approval, ownership, and audit trails attached to the work itself, not bolted on after.

Start where the AI activity already is, not where a rollout plan says it should be. A closer look at what's running in your environment right now is a good place to begin. Sign up for Tines today and see how it works. 

Frequently asked questions

Should AI governance come before or after AI deployment?

Before. Governance scoped as a phase-two project rarely gets built, while the autonomy itself keeps widening one use case at a time. Building approval gates and audit trails before rollout costs far less than discovering the gaps live.

What's the difference between an AI governance policy and an operational governance layer?

A policy states intent. An operational layer enforces it at runtime through an inventory of AI systems, approval gates for high-risk actions, and audit trails recording every action. If a program can't produce a log of what its AI systems did last week and who reviewed it, the oversight exists only on paper.

What is shadow AI and why does it matter?

Shadow AI is employee AI use outside sanctioned channels and security controls. Personal ChatGPT accounts and unapproved browser extensions are common examples. IBM's 2025 breach research ties it to a fifth of all breaches, with roughly $670,000 in additional costs where shadow AI prevalence runs high. Restricting tools tends to push the behavior underground; a governed, sanctioned alternative is the durable fix.

What changed with the EU AI Act in August 2026?

The Act's broad enforcement wave takes effect on August 2, 2026. It covers the Commission's enforcement powers over GPAI model providers and Article 50 transparency obligations; enforcement also begins at the national and EU levels. Annex III high-risk obligations follow on December 2, 2027, after the AI Omnibus deferral.

Sign up today to get started or schedule time with our team to learn more.