Field notes on enterprise agent security

The Watch Floor

You know what your agents are allowed to do. This is about what they actually did, in production, with real credentials, against systems that matter.

Disclosure: I work at Rein Security on AI strategy and implementation. Rein sells runtime enforcement for enterprise agents, which is what a lot of this site argues for. I have a commercial interest in you buying it.

Tool calledrecorded
Inputsrecorded
Returnedrecorded
Latencyrecorded
Error staterecorded
What it did nextusually not

Field notes

Updated weekly

What I've learned from incidents, primary sources, and conversations with people running agents in production. Practitioners appear by role, never by name.

What keeps coming up

Across the conversations I'm having, four themes recur: runtime visibility, agent identity and access, auditability, and scaling workflows safely. Not generic AI governance. Nobody is asking about policy documents.

How agents go wrong

Four failure modes, and only one of them is prompt injection

Hijacked goals: content the agent reads carries hidden instructions, and it uses its real permissions to exfiltrate or destroy. Tool and privilege abuse: a real tool called with destructive parameters, or tools chained in an order nobody intended. Poisoned memory: an attacker seeds persistent memory slowly, so decisions go wrong long after the injection. Cascading failure: in multi-agent workflows, one bad agent poisons everything downstream.

Repeated capability gaps look identical to prompt injection

One team widens agent access when the agent keeps hitting the same wall, treating it as a signal the scope was too narrow. An attacker steering an agent toward a permission it lacks produces exactly the same signal. The widening decision needs a human every time, and most teams have not noticed why.

An architect at a global consultancy

Endpoint-resident agents are a risk surface people underestimate

An agent that lives on the endpoint inherits everything already wrong with that endpoint, and adds destructive local actions to the blast radius. It also generates event volume nobody has budgeted for. Security teams tend to reach this conclusion after deployment rather than before.

65% had an incident. 82% found agents they didn't know about.

Two-thirds of enterprises reported an AI agent security incident in the past year, and four in five discovered shadow agents nobody had registered. The second number explains the first.

Cloud Security Alliance and Token Security data · covered on camera

What your controls actually cover

Isolation isn't a control

A sandbox an agent can reach out of is a boundary on a diagram, not a boundary in production. Isolation counts when something enforces it at the moment the agent tries to cross.

Hugging Face, OpenAI and METR disclosures · covered on camera

Self-reported logs aren't an audit trail

If the agent writes the record of what the agent did, the record inherits every failure mode of the agent. An audit trail is produced by something the agent cannot edit.

Hugging Face, OpenAI and METR disclosures · covered on camera

Detection isn't enforcement

Knowing an agent did something harmful after it did it is incident response. Enforcement is the control that sat between the decision and the action.

Hugging Face, OpenAI and METR disclosures · covered on camera

Edge controls see the wire, not the action

Gateways and proxies see what crosses them, and actions that never route through them fall outside. Prompt firewalls score text for injection patterns, then let the resulting tool call through uninspected. Both are worth having. Neither answers what the agent did once it started acting.

Air-gapped stops egress, not deviation

Running in a customer-controlled, disconnected environment solves data leaving. It does nothing about an agent wandering off its intended path inside the boundary, which is the harder problem and the one teams reach second.

Use MITRE ATLAS as a coverage map, not a reading list

Take each technique that targets the execution layer and name the specific control in your stack that would catch it. Most organizations find the input stages covered and almost nothing after that. It takes an afternoon and it is the most useful afternoon in this whole subject.

What people running agents have figured out

The trace fields that actually matter

Tool name, inputs, returned result or summary, latency, error state, and what the agent did next. Structured metadata retained, full payloads kept selectively. The framing that came with it: this is an observability problem before it becomes an ML problem.

A CISO at a global bank

Structured output is auditable in shape, not in how the agent got there

A clean JSON response passes schema validation and tells you nothing about the reasoning, the tools called, or the data touched on the way to producing it. The cleanest statement of the whole problem I have heard.

A CISO at an Asian insurance group

Ephemerality as containment

Scheduled prompt, fresh session, shut down after. No long-running agents on purpose. It caps blast radius and kills memory poisoning outright, at the cost of everything persistent context buys you.

A security researcher running agents in production

Retention asymmetry: ten years on the record, ninety days on the reasoning

One regulated firm keeps records for ten years, logs for thirty days, and log backups for ninety. When a regulator asks in year three why an agent made a decision, the decision is on file and the reasoning is long gone.

A compliance lead at a regulated financial firm

Agents appear in no asset inventory

They behave like transient workloads. They spin up, hold credentials, act, and disappear, and the CMDB never learns they existed. Discovery is the first move for a reason.

A security leader at a large SaaS vendor

Agent identity is unsolved and everyone is improvising

The question teams hit first when they scale past a handful of agents is what identity to issue them, and there is no settled answer. Shared service accounts, per-agent credentials, borrowed human identity, all in production somewhere right now. MCP makes it sharper, because the credential and the tool surface arrive together and nothing standardizes either.

Cross-language failures turn incident response into a relay race

When an agent workflow spans services in different languages owned by different teams, tracing a failure backwards means each team walks its own segment in sequence. Days, not hours, and the trace is reconstructed rather than recorded.

What this doesn't fix

Read this one

Most of this site argues for runtime. Here is what runtime does not solve, including the parts my own side of the industry tends to skip.

An agent overprovisioned by design

If the agent was given the ability to move funds and it moves funds, every control in the stack correctly records a permitted action. Runtime tells you what happened. It does not tell you the permission should never have existed. That is a design review, and it happens before deployment.

A bad business decision

Runtime sees the action, not the judgment behind it. An agent that denies the wrong claim, correctly, through permitted tools, produces a clean trace of a bad outcome.

The human in the loop

If a person reads an agent's output and then acts in a system the agent never touched, nothing at the agent layer sees it. That path is real, it is common, and it is outside the boundary. I am not going to pretend otherwise.

Attribution across multiple agents

When four agents hand work to each other and the fourth does something wrong, tracing the decision back to the agent that poisoned it is still hard. Nobody has solved this cleanly. Anyone who says they have is selling.

Framework churn

ATLAS ships monthly. AIUC-1 updates quarterly. The crosswalks between them are months old. Building a compliance program against a moving target makes the mapping maintenance, not a one-time project.

Episode archive

Roughly 60 seconds each

Each episode takes one real incident or primary-source report and pulls out the control lesson. No recaps.

Hugging Face, OpenAI and METR Posted

The three-point breakdown. Isolation isn't a control, self-reported logs aren't an audit trail, detection isn't enforcement.

The Anthropic threat report Posted

Attackers running autonomous agents against enterprises, and credentials as the loot they optimize for.

ChatGPT AgentForger Posted

A vulnerability disclosure that turns on what the agent was permitted to do next, not what it was asked.

The Hugging Face breach Posted

Pre-release models reached through a shared package repository. Supply chain, applied to model artifacts.

Lockton Re and Agentforce 360 Posted

A reinsurance agent in production, and the gap between what it was scoped to do and what anyone can observe.

65% and 82% Posted

The incident rate and the shadow agent rate, and why the second number explains the first.

Wispr Flow Posted

Voice to action. A ten-second cut on what changes when the input modality stops being a keyboard.

The OpenAI wiki incident Filmed

An internal knowledge surface as an injection vector, with the EU regulatory beat alongside it.

Critical cyber pause Filmed

What it means when a lab pauses a release on cyber capability grounds, and what it implies downstream.

Stolen reasoning traces Scripted

A cross-vendor reasoning-API flaw, and why the reasoning is worth more to an attacker than the output.

Eval sandbox escapes at three labs Scripted

The same escape pattern at three separate labs. When it happens three times it is not an implementation bug.

The AML co-investigator Scripted

A self-hosted anti-money-laundering agent. Regulated workflow, real autonomy, and the evidence question that follows.

Submission processing for MGAs Scripted

An insurance submission agent reading untrusted documents all day. The input is the attack surface.

Agent SSO Scripted

What identity means when the thing authenticating is not a person and does not stop after one action.

The podcast

Not launched

Longer form, same rules

Some stories do not fit in sixty seconds. The podcast is where those go: one story, the people who actually work on it, and the same discipline about sources and about pitching, which is none.

No launch date yet. Leave an address and you get one email when episode one exists. Nothing else.

One email at launch. No sequence, no newsletter.

Talk to me

Fastest route

If you are running agents in production and want a read on what companies in your sector are doing to protect them, that is a conversation I have most weeks and I am glad to have it with you. No deck, no demo unless you ask for one.

Pick a time directly. That works better than trading messages about which day is good.