← All posts

ai:governance

An enterprise AI governance framework you can actually run.

An enterprise AI governance framework is the set of operating rules that lets a large organization use AI without losing control of its data, its decisions, or its evidence. In practice it has four layers: data classification (what AI may touch), model and use-case approval (what runs, under which conditions), human oversight (who reviews what, set by consequence), and an audit trail that can reconstruct, for any AI-assisted output, what went in, which model ran, and who approved it. A framework that lives in approval queues, registers, and logs gets followed; one that lives in a ten-page PDF gets archived.

This post lays out the version we install and maintain for clients under managed AI operations. It is written for operators, not counsel: the regulatory dates below are checkable, and nothing here is legal advice.

Why enterprise AI governance usually fails.

Two failure modes account for most of the wreckage. The first is the binder: a long policy written by legal, full of principles like 'use AI responsibly', that no engineer or analyst can apply to the tool in front of them on a Tuesday. Usage doesn't stop, it goes underground, onto personal accounts where none of the controls apply. The second is the committee: every proposed use of AI queued for a monthly review board, a meeting-notes summarizer waiting behind a credit-risk model, six-week turnarounds, and teams quietly routing around the process. Both modes produce the same outcome: an AI estate leadership can't see.

Scale is what separates this problem from a small company's version of it. In an agency or a single team, a one-page AI policy genuinely is the framework, because one person can still see all the work. Past a few hundred people, rules alone stop scaling: nobody can hold the estate in their head, so the rules need structure to inherit from. That structure is the four layers below, and the order matters: classification makes approval fast, approval makes oversight assignable, and all three only count if the audit trail can prove they happened.

The enterprise AI governance framework, layer by layer.

Each layer answers one question, and each produces a concrete artifact with a named owner rather than a chapter in a document:

:

Data classification

Which categories of data may enter which categories of AI system. Decided once, centrally, published, and inherited by every use case that follows.

:

Model and use-case approval

A register of cleared models, and a risk-tiered pipeline that approves new uses in days for low-stakes work and with full review for consequential work.

:

Human oversight

Review requirements set by the cost of a wrong output and written into each workflow, not left to the judgment of whoever is busiest that week.

:

Audit trail

Logging that can reconstruct any AI-assisted output: the input and its data tier, the model and version, the workflow version, the reviewer, and the exceptions.

Data classification: decide what AI can touch.

Start here because almost every question that lands on an AI review board is secretly a data question. May the support team paste this ticket into the assistant? May analytics fine-tune on customer records? Answer the data question once, centrally, and most approval traffic disappears. Most enterprises already run a data classification scheme for security; extend it with an AI-handling column rather than inventing a parallel one, so the two schemes can't drift apart.

Data tierAI handlingExamples
PublicAny approved tool or modelPublished content, marketing copy, open documentation
InternalApproved tools on enterprise agreements, logging onProcess docs, internal reports, routine analytics
ConfidentialApproved workflows only, with a named owner and reviewContracts, financials, unreleased plans, customer records
RegulatedCase-by-case review before any AI useHealth, payment, and biometric data; anything under sector rules

Model and use-case approval without the committee.

The committee fails because it applies one ceremony to every request. The fix is to separate two decisions that usually get blurred: whether a model or platform is acceptable to the organization at all, and whether a specific use of it is acceptable. The first is rare and deserves depth; the second is constant and must be fast. Run it as a pipeline:

  1. 01:

    Keep an approved-model register

    A short list of models and platforms cleared at the organization level: security review done, data-processing terms checked, training-on-inputs excluded, deployment region known. Everything downstream picks from this list instead of re-litigating it.

  2. 02:

    Take use cases in through one form

    The proposing team states what the workflow does, which data tier it touches, who is affected when the output is wrong, and whether a human sits in the loop. Ten minutes to fill in; most of the approval decision is already in the answers.

  3. 03:

    Tier by consequence, not by technology

    Low consequence (internal drafts, research assistance) auto-clears against the register and the data rules. Medium (customer-facing output, confidential data) needs a named owner and an oversight plan. High (decisions about people, regulated data) gets the full review. Most requests are low tier and should clear in days.

  4. 04:

    Approve with conditions, in writing

    An approval names the data-tier ceiling, the required review step, the logging requirement, and a re-review date. Unconditional approvals are how a use case drifts far beyond what anyone agreed to.

  5. 05:

    Maintain a living use-case register

    Every approved use, its owner, tier, conditions, and re-review date, in one place. This register is the first thing an auditor, an enterprise customer, or a regulator will ask to see, and it's also how you find out what you actually run.

Human oversight, tiered by consequence.

A blanket rule of 'human review for all AI output' sounds safe and fails twice: at volume the review becomes a rubber stamp, and under deadline it quietly disappears from exactly the workflows where it mattered. Set review levels by the cost of a wrong output, write them into the workflow itself, and keep the same failure-path discipline we describe in scaling AI from pilot to production:

  • Low consequence (internal drafts, research, code suggestions). The user is the review. No extra step; the framework's only job here is keeping the data rules intact.
  • Medium consequence (customer-facing content, confidential analysis). A named reviewer approves before anything leaves the team, and the approval is logged, not just performed.
  • High consequence (decisions affecting people, regulated outputs). A qualified person makes the decision with AI as an input, the reasoning is recorded, and the workflow is built so that skipping review is impossible rather than merely forbidden.
  • Everywhere: a kill path. Every workflow names who can pause it and what the manual fallback is. Oversight that cannot stop the system is commentary, not oversight.

Auditable AI workflows: the layer that makes the rest true.

Auditable AI workflows are the difference between governance you can assert and governance you can demonstrate. The test is reconstruction: for any AI-assisted output, can you show six months later what went in, which model and version ran, which prompt or workflow version was live, who reviewed it, and what shipped? If yes, an incident is an engineering problem. If no, every incident becomes an argument, and the argument lands on whoever approved the framework. For each production workflow, log five things:

  • Inputs and their data tier. What entered the run and which classification it carried. This is how you prove the data rules held, not just existed.
  • Model, version, and configuration. Providers update and retire models on their own schedule. Without the version in the log you cannot explain a change in behavior, let alone defend one.
  • Workflow version. Prompts and pipelines change weekly in a healthy system; the log must say which version produced which output.
  • Review events. Who approved, when, against which checks. An unlogged review is unprovable, which in an audit is the same as absent.
  • Exceptions. Overrides, failures, and fallbacks to the manual path. The exceptions are the first thing an auditor reads, because they show how the system behaves when the happy path breaks.

Where standards and regulation fit.

You do not have to invent the scaffolding. NIST's AI Risk Management Framework (AI RMF 1.0, published January 2023) is voluntary and organizes the work into four functions (govern, map, measure, manage) that map cleanly onto the layers above. ISO/IEC 42001, published in December 2023, turns the same discipline into a certifiable management system; it is where to look once customers start asking for proof rather than policy. Treat both as checklists to validate your framework against, not as documents to adopt wholesale.

In the EU, the AI Act's obligations arrive in stages, and the dates moved in 2026: the Article 50 transparency duties (disclosing AI to people interacting with it, marking synthetic media) have applied since August 2, 2026, while the Digital Omnibus package pushed the main Annex III high-risk obligations (uses in areas like employment, credit, and biometrics) to December 2, 2027. If your use-case register honestly records which uses touch those categories, mapping the regulation onto your estate is a filter query, not a project. Interpretation belongs to counsel; the register is what makes their job tractable.

Do it yourself, or bring us in.

Everything above is buildable internally: extend the data classification you already have, stand up the two registers and the intake form, tier the oversight, and wire the logging into your existing event and retention infrastructure. For a capable platform or ops lead with real authority, that is a quarter of focused work. Where it decays is afterward: re-review dates pass silently, the register stops matching reality, model updates outrun evaluation, and two years later the framework describes an estate that no longer exists. Governance rots at exactly the rate the stack changes.

We work both ends of that problem. Under managed AI operations the registers, approvals, logs, and re-reviews are maintained alongside the workflows they govern, so the framework moves when the stack moves. When the gap is build rather than carry, our forward-deployed engineers wire the controls into your real systems, embedded with your team. And if you do not yet know what your AI estate contains, start with an audit: you cannot govern what you have not mapped.

Talk to us about it

Frequently asked questions.

What should an enterprise AI governance framework include?

Four layers: a data classification stating what AI may touch, a risk-tiered approval pipeline with an approved-model register and a use-case register, human-oversight requirements set by the consequence of a wrong output, and an audit trail that can reconstruct any AI-assisted output. The artifacts matter more than the prose: if the registers and logs exist and are current, the framework is real.

How is this different from an AI policy?

The policy states the boundaries; the framework is the machinery that enforces and evidences them. For a smaller team, a one-page policy genuinely is the framework, because one person can see all the work. Past the point where that stops being true, you need the classification, the registers, the tiers, and the logs, or the policy is a description of intentions.

Do we need ISO 42001 certification?

Need, rarely; benefit, sometimes. Pursue certification when customers or regulators are concretely asking for proof, because that is what it buys you: externally verifiable evidence. Before that point, use the standard as a maturity checklist against the framework above, which is compatible with it either way. Certification without the operating layers is the binder failure mode with a stamp on it.

Who should own AI governance in a large organization?

A named operator with authority over the registers and budgeted time for the reviews, usually in platform, operations, or risk. Not a committee: committees advise well and own badly, and an unowned register is how re-review dates pass silently. Legal and security are consulted parties, and the oversight duties live with the teams running each workflow. Rolling it out is as much an adoption problem as a control problem; we cover that side in AI change management for large teams.

Won't governance slow every AI project down?

The ungoverned version is slower; the cost is just hidden in shadow usage, re-litigated approvals, and the occasional incident that freezes everything for a quarter. A risk-tiered pipeline clears low-stakes uses in days and saves the ceremony for decisions about people and regulated data. The slow version of governance is the all-purpose committee, and replacing it is half the point of the framework.

Keep reading.

:

An AI policy for agencies that people actually follow.

:

Scaling AI from pilot to production.

:

AI change management for large teams.