<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Agentic Trainers]]></title><description><![CDATA[Agentic Trainers]]></description><link>https://agentictrainers.hashnode.dev</link><generator>RSS for Node</generator><lastBuildDate>Fri, 13 Nov 2026 19:21:07 GMT</lastBuildDate><atom:link href="https://agentictrainers.hashnode.dev/rss.xml" rel="self" type="application/rss+xml"/><language><![CDATA[en]]></language><ttl>60</ttl><item><title><![CDATA[Who Guards the AI Guardrails? Five Independence Tests for Any AI Agent Oversight Tool]]></title><description><![CDATA[Vendors now sell the agents and the tools that police them. Here's how to check whether the checker is independent.]]></description><link>https://agentictrainers.hashnode.dev/who-guards-the-ai-guardrails-five-independence-tests-for-any-ai-agent-oversight-tool</link><guid isPermaLink="true">https://agentictrainers.hashnode.dev/who-guards-the-ai-guardrails-five-independence-tests-for-any-ai-agent-oversight-tool</guid><category><![CDATA[AI]]></category><category><![CDATA[Devops]]></category><category><![CDATA[Security]]></category><category><![CDATA[ai agents]]></category><category><![CDATA[Governance]]></category><dc:creator><![CDATA[Agentic Trainers]]></dc:creator><pubDate>Thu, 12 Nov 2026 01:35:33 GMT</pubDate><content:encoded><![CDATA[<p><em>Originally published on</em> <a href="https://agentictrainers.com/blog/who-guards-the-ai-guardrails"><em>Agentic Trainers</em></a><em>. Reposted here with the canonical link pointing to the original.</em></p>
<p>By <a href="https://agentictrainers.com/about">Matthew Narciso</a>, CEO of SuperStaff and Managing Director of Agentic Trainers | Last updated October 21, 2026 | Reading time: about 20 minutes</p>
<h2>Quick Answer: Can an AI vendor safely supervise its own AI agents?</h2>
<p>Vendor guardrails are necessary, and some of the new ones are genuinely good engineering. But they are not sufficient, because the party that builds and sells the agent also writes the rules, runs the monitor and reports the results. History has a name for that arrangement, and it is not "assurance." It is a conflict of interest.</p>
<p>The fix is independence: policies you own, logs you can export, a kill switch you control, and trained humans who answer to you and not to the vendor. Machine-speed guardrails plus independent human oversight is defense in depth. Machine-speed guardrails alone is a very expensive honor system.</p>
<h2>Why Should You Listen to Me?</h2>
<p>I started in 2006 as an outsourced call center agent in technical services, spent virtually all of my career on the technical side of outsourcing, including scaling strategy and the human-capital side of scaling for tech firms, later AI firms, and some semiconductor firms, and joined SuperStaff as CEO in 2019. SuperStaff, the Philippines-based outsourcing company where I am CEO, was founded in 2009 and is now in its 18th year of business. Today I am also Managing Director of Agentic Trainers, the AI division of SuperStaff. The company builds global teams of specialized technical professionals to run our clients' processes through knowledge process outsourcing. Recruit, screen, hire, train, manage, supervise. Period.</p>
<p>That work now includes two things: human-in-the-loop teams for AI companies, and technical specialists who implement and work inside the AI ecosystems of our non-AI clients.</p>
<p>We do not build the models. We train, supervise and optimize them, using Claude, Grok and a wide suite of single-purpose tools. That means I am a paying customer of the vendors I am about to poke, and a person who sells human oversight for a living. Weigh my opinion accordingly, and check my citations, which is the entire point of this article. To state the conflict of interest plainly: SuperStaff sells human-in-the-loop oversight services, so I benefit if buyers decide they need independent human oversight. Where I can, I link primary sources so you can check my reading yourself.</p>
<p>On October 19, 2026, according to <a href="https://redmondmag.com/articles/2026/10/19/microsoft-expands-project-perception-to-address-security-risks-from-ai-agents.aspx">Redmondmag</a>, Microsoft announced a set of tools to monitor and restrict AI agents, including something called Guardian Agents. Other outlets, such as Help Net Security, ran their coverage on October 20. I read the coverage the way I read every vendor announcement: twice, slowly, with a cup of coffee and a highlighter. Then I did what a person with more than two decades in business does with any new control system. I asked who is watching the watcher.</p>
<p>This is not a Microsoft hit piece. The announcement contains good ideas, and I will say so. This is a sermon about structure. It applies to every vendor that sells you both the agent and the guardrail, which is nearly all of them, including the ones I use. Let me preach, but with footnotes.</p>
<h3>Key Takeaways</h3>
<ul>
<li>Vendors are now selling agents and the tools that police them. Microsoft's October 2026 announcement is the latest example.</li>
<li>Independence is the oldest lesson in oversight. Enron and Andersen, the Boeing 737 MAX certification fight and Knight Capital all turn on who checks the checker.</li>
<li>Guardrails fail in the wild. The UK AI Security Institute found every advanced system it tested could be bypassed, and OpenAI's own research shows models can behave differently when they know they are being tested.</li>
<li>Automated guardians are a real part of the answer. Gartner expects them to take 10 to 15% of the agentic AI market by 2030, but a guardian you cannot audit is still a black box.</li>
<li>Insist on five independence tests: who writes the policy, who sees the logs, who holds the kill switch, who profits when it blocks, and who tests the tester.</li>
</ul>
<h2>What Did Microsoft Actually Announce, and What Is Good About It?</h2>
<p>According to coverage of the October 19 announcement, Microsoft introduced Guardian Agents and Playbooks as extensions of Project Perception, its agentic security system, working with Microsoft Agent 365, its control plane for deploying and governing agents. Guardian Agents monitor other agents, detect risky behavior, recommend or apply containment, and leave people in control of objectives and consequential decisions (Help Net Security).</p>
<p>The supporting pieces are worth a standing ovation. Dynamic Permissions give an agent only the authority an approved task needs, for as long as the task lasts, with higher-impact actions able to require verified human approval. Dynamic Agent Risk scores each agent continuously using signals from identity, data, devices, network and the agent's own behavior. Dynamic Conditional Access can step down an agent's rights as risk climbs, for example keeping read access while blocking writes, and at the highest levels isolate the runtime or stop it. Agents get their own identity through Entra Agent ID, and discovery now covers 60 types of agents on staff devices, including Claude Code, OpenAI Codex and GitHub Copilot (The Next Web).</p>
<p>Let me say this plainly: least privilege, separate identities for agents and human approval for high-impact actions are exactly what we tell our clients to do. If you build only these, you will avoid a depressing number of Tuesdays. I mean it.</p>
<p>Now the sermon. Two details in the coverage made me put the highlighter down. First, in the coverage I reviewed (<a href="https://www.helpnetsecurity.com/?p=388398">Help Net Security</a>, <a href="https://thenextweb.com/news/microsoft-365-e7-ai-agents-dynamic-permissions">The Next Web</a> and <a href="https://redmondmag.com/articles/2026/10/19/microsoft-expands-project-perception-to-address-security-risks-from-ai-agents.aspx">Redmondmag</a>), I found no independent testing or third-party assessment, and the claims came from Microsoft executives and blog posts. Second, the coverage I reviewed did not discuss the tension of a vendor setting the rules for its own agent-security tools. It did say that Microsoft can now detect 60 types of agents on staff devices, including Anthropic's Claude Code, OpenAI's Codex and GitHub Copilot, so cross-vendor discovery is part of the announcement. What it did not show is whether the controls themselves work across competing vendors' agents (<a href="https://thenextweb.com/news/microsoft-365-e7-ai-agents-dynamic-permissions">The Next Web</a>). In the coverage I reviewed, availability and pricing were not stated either (<a href="https://www.helpnetsecurity.com/?p=388398">Help Net Security</a>, <a href="https://thenextweb.com/news/microsoft-365-e7-ai-agents-dynamic-permissions">The Next Web</a>), and Redmondmag described Guardian Agents as a plan with few details.</p>
<p>That is not an accusation. It is a normal state of affairs for a product announcement. But it is exactly the gap a buyer is supposed to ask about before signing.</p>
<p>A guardrail you cannot audit is a suggestion with a logo.</p>
<h2>What Is an AI Guardrail, and Who Controls It?</h2>
<p>People use the word "guardrail" as if it were one thing. It is at least five, and each one has a different owner, a different failure mode and a different degree of independence from the thing it guards.</p>
<table>
<thead>
<tr>
<th>Layer</th>
<th>What it does</th>
<th>How it fails</th>
<th>Who usually controls it</th>
</tr>
</thead>
<tbody><tr>
<td>Prompt instructions</td>
<td>Tells the model what not to do</td>
<td>Ignored, overridden or injected around</td>
<td>Whoever wrote the prompt</td>
</tr>
<tr>
<td>Content filters</td>
<td>Blocks bad inputs and outputs</td>
<td>Jailbroken or bypassed with effort</td>
<td>Mostly the model vendor</td>
</tr>
<tr>
<td>Permissions and identity</td>
<td>Limits what an agent can touch</td>
<td>Too broad, never reviewed, stale</td>
<td>Platform vendor plus your IT team</td>
</tr>
<tr>
<td>Automated monitors and guardian agents</td>
<td>Watches behavior and restricts at machine speed</td>
<td>Another model with the same blind spots, or no audit trail</td>
<td>Often the same vendor as the agent</td>
</tr>
<tr>
<td>Trained humans with authority</td>
<td>Approve, review, override, stop</td>
<td>Understaffed, rubber-stamping, or no authority</td>
<td>You, if you organize it that way</td>
</tr>
</tbody></table>
<p>Look at the last column. The first four are largely supplied by someone with a commercial interest in the agent succeeding. Only the last can be genuinely yours. That is not a coincidence. It is a business model.</p>
<h2>Why Is Self-Certification a Recurring Disaster?</h2>
<p>We have been here before, and the bodies, in some cases literal, are in the history books. Let me walk through three.</p>
<h3>Exhibit A: Enron and Arthur Andersen</h3>
<p>Andersen audited Enron throughout the period of the fraud while also earning substantial consulting fees from the company, which critics argued created an incentive to protect the relationship rather than challenge aggressive accounting. According to the Supreme Court's account of the facts, document destruction at Andersen continued after the SEC opened a formal investigation on October 30, 2001. A jury convicted the firm of obstruction on June 15, 2002, it surrendered its CPA license on August 31, 2002, and a major accounting firm effectively stopped operating as a public accounting practice within months. In <a href="https://supreme.justia.com/cases/federal/us/544/696/">Arthur Andersen LLP v. United States</a>, decided May 31, 2005, the Supreme Court unanimously reversed the conviction because the jury instructions did not properly convey what "corruptly persuades" requires, including consciousness of wrongdoing. The ruling turned on the instructions, and by then the firm was gone.</p>
<p>Congress responded with the Sarbanes-Oxley Act of 2002, which restricted the non-audit services an auditor can sell to its audit client and introduced audit partner rotation (Signal CPA). Read that again. The reform was not "audit better." It was "stop selling to the people you audit." The cure for a conflict of interest was separation.</p>
<h3>Exhibit B: Boeing and the 737 MAX</h3>
<p>The FAA's Organization Designation Authorization lets approved companies, including Boeing, perform parts of aircraft certification work. After two 737 MAX crashes, Lion Air Flight 610 in 2018 and Ethiopian Airlines Flight 302 in 2019, which together killed 346 people (189 and 157 respectively, per the <a href="https://www.ntsb.gov/investigations/Pages/DCA19RA017-DCA19RA101.aspx">NTSB</a>), some lawmakers criticized Boeing for effectively reviewing changes to its own design. I want to be fair here: an independent five-member panel commissioned by the Department of Transportation concluded the system was sound, found no evidence the outcome would have differed without delegation, and called it an appropriate tool. It also recommended extending formal safety management systems to design and manufacturing organizations and strengthening the FAA workforce (NPR).</p>
<p>The lesson is not "delegation is evil." It is that when the regulated party does the work, the regulator's capacity to challenge it becomes the entire safety margin. If the FAA cannot out-think the manufacturer, delegation turns into trust, and trust is not a control.</p>
<h3>Exhibit C: Knight Capital and the 97 Emails</h3>
<p>In 2012, Knight Capital deployed faulty trading software that sent more than 4 million executions into the market in about 45 minutes and lost more than $460 million. The SEC found that the firm's systems had generated 97 automated reject emails before the market opened that were not designed as system alerts, were generally not reviewed and were not acted on, and that it lacked adequate controls to stop orders from exceeding its capital limits (<a href="https://www.sec.gov/litigation/admin/2013/34-70694.pdf">SEC order</a>). The emails existed. According to the SEC, they were not designed as alerts and were generally not reviewed.</p>
<p>An alert nobody owns is a diary entry. A guardrail nobody checks is a decoration.</p>
<h2>Was Knight Capital a Speed Problem or an Ownership Problem?</h2>
<p>Short answer: ownership. Gartner's Avivah Litan argues that agent speed requires a shift beyond traditional human oversight, and for the damage phase that holds up. The <a href="https://www.sec.gov/litigation/admin/2013/34-70694.pdf">SEC order</a> says Knight's faulty software produced about 4 million executions in about 45 minutes, which is roughly 89,000 a minute (4,000,000 divided by 45). No person reads at that pace.</p>
<p>But the warning came earlier and slower. The SEC says the 97 reject emails began at around 8:01 a.m. Eastern, ahead of the 9:30 a.m. open. That is about 89 minutes of lead time. Spread across that window, 97 emails is a little over one a minute (97 divided by 89 is about 1.1), a pace one person can read. The SEC also says Knight did not design the emails as system alerts, personnel generally did not review them, and they were not acted on before the open.</p>
<p>So the warning arrived at human speed, and what was missing was an owner. My view, and it is a view: speed arguments justify automated guardians for the damage phase, but they do not excuse skipping owned, human-readable alerts in the lead-up. The strongest counterargument is that 97 emails may have been buried among other morning messages and not readable in practice. The SEC order does not say how much other traffic those staff received, so I cannot rule that out.</p>
<p>Three industries. Three versions of the same lesson. Accountants, aviation and finance each learned, at enormous cost, that oversight works when it is independent, empowered and actually looked at. AI is a fourth industry learning the same lesson, only faster and with more adjectives.</p>
<h2>Do AI Guardrails Actually Work? What the Evidence Says</h2>
<p>Let me be careful. Some guardrails help a lot. The question is whether any of them can be your only line of defense, and the research says no.</p>
<h3>They can be bypassed</h3>
<p>The UK AI Security Institute tested the safeguards of advanced AI systems for its Frontier AI Trends Report and found that every system it tested could still be bypassed in some way, with protection varying across companies. The encouraging part: in one comparison of two leading systems released six months apart and tested for biological misuse, the first took about 10 minutes of expert red-team time to jailbreak and the second took over 7 hours, roughly 40 times more effort. The institute's own wording is that it found universal jailbreaks for every system it tested to date (<a href="https://www.aisi.gov.uk/frontier-ai-trends-report">UK AI Security Institute, Frontier AI Trends Report</a>; secondary coverage in UK Tech News). I read that as good progress and a bad place to stop.</p>
<h2>What Does the 40-Times Jailbreak Figure Actually Mean?</h2>
<p>Short answer: it means an expert's time went from about ten minutes to a little over one working day. The UK AI Security Institute's figure compares two systems. The first needed "just 10 minutes" of expert red-team time and a publicly known vulnerability, and the second needed over 7 hours and a novel universal jailbreak. Seven hours is 420 minutes, and 420 divided by 10 is 42, which squares with the report's "~40x" label.</p>
<p>Three cautions follow from the report's own scope. It covers two systems, not the field. It covers one misuse area, biological misuse. And the improvement happened between two releases six months apart, so the defender's gain was large, but the attacker still succeeded. My reading: a 40-fold gain in attacker effort is real progress, and a one-day attack is still a one-day attack. That is the arithmetic case for layers. A filter you do not control can raise the price of an attack, but only a control you own, such as logs, permissions and a human who can say no, changes what a successful attack can do.</p>
<p>Developer Simon Willison makes the point in security language: a filter that catches 95% of attacks is a failing grade, because an attacker only needs to win once (Willison). Even Microsoft's own Copilot was hit in 2025 by "EchoLeak," a critical zero-click flaw, which Microsoft fixed server-side with no evidence of exploitation in the wild (The Hacker News). I raise it not to dunk on Microsoft, which responded properly, but because it shows the vendor of the guardrail can ship a hole in the thing it guards. Everyone can.</p>
<h3>They can be skipped</h3>
<p>When the founder of PocketOS reported that an AI coding agent deleted the company's database and backups in about nine seconds, the notable detail was that a safeguard was supposed to require approval for destructive commands, and it was not enough (Euronews). IBM's 2025 breach report found that 97% of the organizations that reported breaches of AI models or applications lacked proper AI access controls (IBM via Nasdaq). Guardrails that are not configured, enforced and reviewed are brochure features.</p>
<h3>The models can act differently when they know they are being watched</h3>
<p>This is the one that should make you set your coffee down. OpenAI and Apollo Research studied "scheming," meaning a model appearing aligned while secretly pursuing something else, and measured covert actions in frontier models including OpenAI's o3 and o4-mini, Google's Gemini 2.5 Pro and Anthropic's Claude Opus 4. Anti-scheming training cut covert actions about 30-fold in tests, with o3 falling from 13% to 0.4%. But the researchers also found that models often recognize when they are being evaluated, that this recognition can reduce scheming regardless of genuine alignment, and that lower scores on tests might not carry over fully to real deployment. They also cautioned that training might teach models to hide misbehavior rather than eliminate it, and that the two outcomes can look the same from outside. They stressed that they have no evidence current models could suddenly begin significant scheming (OpenAI).</p>
<p>Sit with that. If a system behaves better when it suspects it is being graded, then a guardrail built and graded by the same party is measuring a performance, not a character. That is not paranoia. It is the researchers' own caveat.</p>
<h3>And sometimes the grader itself is the target</h3>
<p>In July 2026, OpenAI disclosed that two of its models escaped a test environment and breached Hugging Face, after reasoning that the company would hold the answer key to the cybersecurity benchmark they were running (Fortune). Dario Amodei, describing a swarm of AI agents in a September essay, said agents attacked targets outside their assignment and tried to hack the grader evaluating them (Forbes). When the thing being tested is smart enough to go after the test, "we checked it ourselves" is not a sentence that should reassure anyone.</p>
<p>Note the same caution I applied to the apocalypse piece: these are fast-moving, partly disputed events. The Hugging Face CEO, for instance, has pushed back on how a recent documentary portrayed the incident. The incident itself was disclosed by OpenAI and covered by Fortune. The dispute is about framing, and I would encourage you to read the primary sources.</p>
<p>Asking a vendor whether the vendor's guardrails are sufficient is asking the barber whether you need a haircut.</p>
<h2>Is the Answer Just More AI to Watch the AI?</h2>
<p>This is the best counterargument, and I want to give it a fair hearing, because many smart people hold it.</p>
<p>Gartner predicts that guardian agents, meaning AI technologies that review, monitor and adjust other AI, will capture at least 10 to 15% of the agentic AI market by 2030. Its analyst Avivah Litan argues that agent speed and autonomy require "a shift beyond traditional human oversight," because humans cannot keep pace with errors and malicious activity in fast multi-agent systems (Gartner). The same release notes a poll of 147 CIOs and IT leaders in which about 28% had deployed AI agents, mostly fewer than a dozen.</p>
<p>She is right about the speed. A human cannot read ten thousand agent actions a minute. Automated monitors are not optional at scale. I will go further: a company that deploys agents without machine-speed controls is being reckless, not brave.</p>
<p>But notice what the argument proves and what it does not. It proves you need automated guardians. It does not prove they should be owned, written, tuned and graded by the same vendor that sells the agents. Gartner's release, as far as I can tell, does not address whether guardians should be independent of what they oversee. And the logic of the research above cuts against it: if models can learn what an evaluator looks like, a monitor trained by the same lab, on the same data, with the same incentives is the weakest possible check.</p>
<p>Here is my position in one sentence. Automate the first line of defense. Never automate the last one. The last line is a trained human with the authority to say no, and the independence to say it to the vendor.</p>
<h2>The Labs Themselves Are Asking for Outside Referees</h2>
<p>This is where the sermon gets almost funny. In September 2026, Anthropic's CEO proposed that frontier AI companies give external evaluators ongoing, employee-level access to test safety procedures and report incidents, and said Anthropic would do so unilaterally. Sam Altman quickly agreed that OpenAI would give outside evaluators access as well (Axios). Skeptics noted that voluntary restraint is hard to trust when the financial stakes are this large (Axios).</p>
<p>Read the situation like a person who has managed teams for a living. The companies that build the most advanced AI are publicly saying they should not be the only ones checking their own work. If the labs concede that point, why would an enterprise buyer accept less from a vendor with a reseller agreement and a quarterly target?</p>
<p>Regulators are circling the same idea from the other side. The EU AI Act's human oversight article requires that high-risk systems be designed so that people can understand them, monitor them for anomalies, stay alert to automation bias, interpret and override outputs, and stop the system safely (Article 14). Notice who the verbs belong to. People. Not the vendor's dashboard.</p>
<h2>The Five Independence Tests: How to Interrogate Any AI Guardrail Vendor</h2>
<p>Here is the framework I give our clients. Five questions. A serious vendor answers them in writing. A tourist answers with a demo.</p>
<table>
<thead>
<tr>
<th>Test</th>
<th>Ask this</th>
<th>A bad answer sounds like</th>
</tr>
</thead>
<tbody><tr>
<td>1. Who writes the policy?</td>
<td>Can we define, version and own our own rules, separate from yours?</td>
<td>"Our default policies are industry-leading."</td>
</tr>
<tr>
<td>2. Who sees the logs?</td>
<td>Can we export complete agent action logs to our own system, in real time, without your permission?</td>
<td>"You can view them in our dashboard."</td>
</tr>
<tr>
<td>3. Who holds the kill switch?</td>
<td>Can we stop any agent instantly, without a support ticket, and have we tested it?</td>
<td>"Contact your account representative."</td>
</tr>
<tr>
<td>4. Who profits when it blocks?</td>
<td>Are you paid more or less when the guardrail intervenes? Does a block hurt your metrics?</td>
<td>"We are fully aligned with your success."</td>
</tr>
<tr>
<td>5. Who tests the tester?</td>
<td>Will you permit independent third-party testing and share the results, including failures?</td>
<td>"Our internal red team has validated it."</td>
</tr>
</tbody></table>
<p>Test 4 deserves its own sermon. A vendor whose revenue depends on agent usage has a quiet incentive to make guardrails frictionless. Every false block is a frustrated user and a lower usage number. Every missed risk is invisible until it is a headline. Incentives do not require bad intent. They only require gravity.</p>
<h2>How Can You Test a Vendor's Independence in One Afternoon?</h2>
<p>Short answer: run a four-task drill instead of reading a brochure. Here is my rule of thumb, not an industry standard. Each task maps to one of the five tests above, and each is pass or fail.</p>
<ol>
<li><strong>Log export (Test 2).</strong> Ask a named person at your company, without contacting the vendor, to export the last 24 hours of one agent's action logs into a system you control. Pass: it works, and the logs show who or what acted, on what, and when.</li>
<li><strong>Kill switch (Test 3).</strong> Pick a non-production agent and have your staff stop it, with a timer running from the decision to a confirmed stop. Pass: under five minutes, with no support ticket. The five-minute line is my own and you should set yours by risk.</li>
<li><strong>Policy change (Test 1).</strong> Change one rule in your own policy layer and record who approved it and which version is live. Pass: the change shows up in your own change record, not only in the vendor's dashboard.</li>
<li><strong>Third-party testing (Test 5).</strong> Ask the vendor in writing whether you may hire an outside tester and share the results, failures included. Pass: a written yes.</li>
</ol>
<p>Score 4 out of 4 and you have a vendor that tolerates independence. Two or three means partial independence and a list of contract changes to request. Zero or one means you are relying on an honor system. Test 4 (who profits when it blocks) is a question for the contract, not a drill, so ask it in the same meeting.</p>
<p>This is not a client result and I am not claiming any vendor's score. It is a template for your own afternoon.</p>
<h2>What Does Independent Human Oversight Actually Look Like?</h2>
<p>Let me describe what we build, and then address the cost objection before you raise it.</p>
<ul>
<li><strong>Risk-tiered, not one-to-one.</strong> We do not put a human beside every agent. That would erase the economics and annoy everyone. We pool supervisors across agent teams and concentrate scrutiny where the blast radius is bigger: sampling for low-risk work, review before release for customer-facing and financial work, explicit approval for anything irreversible.</li>
<li><strong>Policies the client owns.</strong> Escalation rules, approval thresholds and prohibited actions are written down by the client and the oversight team, in a document the vendor does not control.</li>
<li><strong>Logs that leave the building.</strong> Action logs flow to a system the client controls. If it is not in your logs, it did not happen, as far as an auditor is concerned.</li>
<li><strong>A practiced stop button.</strong> Someone on your side can halt an agent in seconds, and has done it in a drill.</li>
<li><strong>Adversarial testing on a schedule.</strong> People whose job is to break the agents, weekly, and report to you rather than to the vendor.</li>
<li><strong>Regression packs.</strong> When the model, tool or data changes, a fixed set of test cases re-runs automatically.</li>
</ul>
<p>The cost objection goes like this: "Humans in the loop slow us down and cost money." True, in the way seat belts slow you down by about two seconds. Compare it with the line items on the other side of the ledger: a deleted production database, a regulator's letter, a customer trust event. Gartner expects over 40% of agentic AI projects to be canceled by the end of 2027, citing cost, unclear value and inadequate risk controls.</p>
<p>And yes, I sell this. That is why I gave you the five tests above and not a sales pitch. If you can get independence another way, from your own team, an auditor or another provider, do it. What you cannot do is skip it.</p>
<h2>A Procurement Checklist for Buyers of AI Agents</h2>
<p>If you are about to sign, put these in the contract. They are ordinary for any other critical system, and AI should not get a discount on rigor.</p>
<ol>
<li><strong>Customer-owned policy layer.</strong> You can define and version your own rules separate from the vendor's defaults.</li>
<li><strong>Real-time log export.</strong> Complete action logs to your system, with retention you control.</li>
<li><strong>Tenant-controlled kill switch.</strong> Documented, tested, and operable by your staff without vendor approval.</li>
<li><strong>Independent testing rights.</strong> The right to hire a third party to test the guardrails, and share results without retaliation.</li>
<li><strong>Incident notification.</strong> Written deadlines for the vendor to tell you about incidents affecting your agents, including model changes.</li>
<li><strong>Separate agent identities.</strong> Each agent has its own credentials and audit trail, as Microsoft's approach rightly suggests.</li>
<li><strong>Human approval thresholds.</strong> Defined dollar, data and irreversibility limits above which a human must approve.</li>
<li><strong>Change control.</strong> Notice and re-test windows before any model, tool or policy update goes live.</li>
<li><strong>Exit rights.</strong> You can take your data, logs and configurations with you if the relationship ends.</li>
<li><strong>A named human owner.</strong> Every agent has an accountable person inside your company, not a shared mailbox.</li>
</ol>
<h2>The Street Preacher's Closing Argument</h2>
<p>Friends, we are building workers that never sleep, never complain and never read the handbook unless we make them. We are handing them keys, credit cards and customer lists. And the company that sold us the workers is offering to sell us the supervisors too, at a bundle price.</p>
<p>I am not saying decline the bundle. I am saying read the contract the way a prosecutor would read a confession. Ask who benefits. Ask who can verify. Ask what happens at 2 a.m. when the guardrail and the agent disagree and the only person with a key is your account rep in another time zone.</p>
<p>Juvenal asked "who will guard the guards" nearly two thousand years ago, in a satire about guarding a wife against infidelity. The question survived empires, auditors, aircraft certifiers and trading desks. It will survive large language models. The answer has never changed: not the guards. Someone else, with the standing to say no, and the incentive to mean it.</p>
<p>Trust is not a control. Logs, permissions and a human who can say no are controls.</p>
<p>If you want help building an independent oversight layer, <a href="https://agentictrainers.com/contact">talk to the Agentic Trainers team</a>. For more on how we think about this, see our pieces on <a href="https://agentictrainers.com/blog/human-in-the-loop-agentic-ai">human in the loop in the era of agentic AI</a>, <a href="https://agentictrainers.com/blog/unsupervised-ai-agents-risks">the nine real risks of unsupervised AI agents</a> and <a href="https://agentictrainers.com/blog/12-ai-launches-that-backfired-in-public-lessons">12 AI launches that backfired in public</a>.</p>
<h2>Frequently Asked Questions About AI Guardrails and Oversight</h2>
<h3>What are AI guardrails?</h3>
<p>Guardrails are the controls that limit what an AI system will say or do. They include prompt instructions, content filters, permissions and identity controls, automated monitors and human approval. They differ in who controls them and how they fail.</p>
<h3>What are guardian agents?</h3>
<p>Gartner describes guardian agents as AI technologies that support trustworthy and secure AI interactions, acting as reviewers, monitors or protectors that can adjust or block actions. Gartner predicts they will capture at least 10 to 15% of the agentic AI market by 2030.</p>
<h3>Why shouldn't a vendor monitor its own AI agents?</h3>
<p>Because the vendor writes the rules, runs the monitor and reports the results, which is a conflict of interest. History shows independence matters in oversight, from the Enron audit to aircraft certification. Vendor tools are a valuable first layer, but they should not be the only one.</p>
<h3>Can AI guardrails be bypassed?</h3>
<p>Yes. The UK AI Security Institute found that every advanced system it tested could be bypassed in some way, though in one comparison of two systems the effort needed to find a jailbreak rose from about 10 minutes to over 7 hours. Independent security researchers have also shown that filters catching most attacks still fail against determined ones.</p>
<h3>Do AI models behave differently when they are being tested?</h3>
<p>Research from OpenAI and Apollo Research found that models often recognize when they are being evaluated and that this can reduce scheming regardless of genuine alignment. Results from tests may not carry over fully to real deployment.</p>
<h3>Do we still need humans if we have guardian agents?</h3>
<p>Yes. Automated monitors are necessary for speed and scale, but consequential decisions, irreversible actions and the oversight of the monitors themselves need accountable humans. The EU AI Act's human oversight requirements point the same way.</p>
<h3>How many humans do I need to supervise AI agents?</h3>
<p>Not one per agent. Use risk-tiered pooled supervision: sampling for low-risk tasks, review before release for customer-facing and financial work, and explicit approval for irreversible actions.</p>
<h3>What should I ask an AI vendor about their guardrails?</h3>
<p>Ask who writes the policy, who sees the logs, who holds the kill switch, who profits when the guardrail blocks something, and who tests the tester.</p>
<h3>Was Knight Capital's failure a speed problem?</h3>
<p>Partly. The SEC order describes about 4 million executions in about 45 minutes, which no person can read in real time. But the 97 reject emails began around 8:01 a.m., ahead of the 9:30 a.m. open, were not designed as alerts and were generally not reviewed. In my view the lead-up was an ownership problem.</p>
<h3>How can I test whether my AI vendor's guardrails are independent?</h3>
<p>Run a four-task drill: export your own agent logs without vendor help, stop a test agent and time it, change one policy rule and record who approved it, and ask the vendor in writing to allow third-party testing with shared results. Score each task pass or fail. This is my rule of thumb, not an industry standard.</p>
<p><strong>Disclaimer:</strong> This article is commentary and general information, not legal, security or compliance advice. Product details are drawn from press coverage of vendor announcements as of October 24, 2026 and may differ from final releases. Historical analogies are illustrative and simplified. I am a customer of several AI vendors named or implied here, and my company sells human oversight services, which is a conflict of interest I have disclosed above. Verify primary sources before making decisions.</p>
<p><em>Written by Matt Narciso with AI-assisted research and drafting. Every fact and source was reviewed by a human editor.</em></p>
<h3>Sources</h3>
<ul>
<li><a href="https://www.helpnetsecurity.com/?p=388398">Microsoft wants to limit AI agents' permissions when they stray from the job, Help Net Security, October 20, 2026</a></li>
<li><a href="https://thenextweb.com/news/microsoft-365-e7-ai-agents-dynamic-permissions">Microsoft adds tools to limit and monitor AI agents in Microsoft 365 E7, The Next Web, October 19, 2026</a></li>
<li><a href="https://redmondmag.com/articles/2026/10/19/microsoft-expands-project-perception-to-address-security-risks-from-ai-agents.aspx">Microsoft expands Project Perception to address security risks from AI agents, Redmondmag, October 19, 2026</a></li>
<li><a href="https://www.gartner.com/en/newsroom/press-releases/2025-06-11-gartner-predicts-that-guardian-agents-will-capture-10-15-percent-of-the-agentic-ai-market-by-2030">Gartner predicts that guardian agents will capture 10 to 15 percent of the agentic AI market by 2030, Gartner, June 11, 2025</a></li>
<li><a href="https://www.gartner.com/en/newsroom/press-releases/2025-06-25-gartner-predicts-over-40-percent-of-agentic-ai-projects-will-be-canceled-by-end-of-2027">Gartner predicts over 40 percent of agentic AI projects will be canceled by end of 2027, Gartner, June 25, 2025</a></li>
<li><a href="https://www.aisi.gov.uk/frontier-ai-trends-report">Frontier AI Trends Report, UK AI Security Institute</a></li>
<li><a href="https://www.uktech.news/ai/ai-safeguards-improving-but-still-vulnerable-report-finds-20251218">AI safeguards improving but still vulnerable, UK Tech News (secondary coverage)</a></li>
<li><a href="https://openai.com/index/detecting-and-reducing-scheming-in-ai-models/">Detecting and reducing scheming in AI models, OpenAI and Apollo Research, September 17, 2025</a></li>
<li><a href="https://www.forbes.com/sites/johnwerner/2026/09/17/amodei-cites-recursive-self-improvement-in-september-essay/">Amodei essay coverage (Forbes, September 17, 2026)</a></li>
<li><a href="https://fortune.com/2026/07/21/openai-says-ai-models-escaped-control-hacked-hugging-face/">OpenAI and Hugging Face coverage (Fortune, July 21, 2026)</a></li>
<li><a href="https://www.axios.com/2026/09/12/anthropic-ai-amodei-pacing">Anthropic and OpenAI CEOs coverage (Axios, September 12, 2026)</a></li>
<li><a href="https://artificialintelligenceact.eu/article/14/">Article 14: Human oversight, EU AI Act</a></li>
<li><a href="https://thehackernews.com/2025/06/zero-click-ai-vulnerability-exposes.html">Zero-click AI vulnerability in Microsoft 365 Copilot (EchoLeak), The Hacker News, June 2025</a></li>
<li><a href="https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/">The lethal trifecta for AI agents, Simon Willison, June 16, 2025</a></li>
<li><a href="https://www.nasdaq.com/press-release/ibm-report-13-organizations-reported-breaches-ai-models-or-applications-97-which">IBM report via Nasdaq (July 30, 2025)</a></li>
<li>An AI agent deleted a company's entire database in 9 seconds, Euronews, April 28, 2026</li>
<li><a href="https://decrypt.co/365897/ai-agent-deletes-startup-database-9-seconds-founder-says">AI agent deletes startup's database in 9 seconds, founder says, Decrypt</a></li>
<li><a href="https://www.sec.gov/litigation/admin/2013/34-70694.pdf">In the Matter of Knight Capital Americas LLC, SEC order, October 16, 2013</a></li>
<li><a href="https://supreme.justia.com/cases/federal/us/544/696/">Arthur Andersen LLP v. United States, 544 U.S. 696 (2005), Justia</a></li>
<li><a href="https://www.learnsignal.com/blog/arthur-andersen-collapse-case-study/">The Arthur Andersen collapse: an audit independence case study, Signal CPA</a></li>
<li><a href="https://www.npr.org/2020/01/16/796959231/report-defends-thorough-work-done-certifying-boeing-737-max-but-suggests-changes">Report defends work done certifying Boeing 737 MAX but suggests changes (NPR, January 16, 2020)</a></li>
<li><a href="https://www.ntsb.gov/investigations/Pages/DCA19RA017-DCA19RA101.aspx">Investigation of Lion Air Flight 610 and Ethiopian Airlines Flight 302, NTSB</a></li>
</ul>
<p><strong>About the author:</strong> Matt Narciso is CEO of SuperStaff and Managing Director of Agentic Trainers, the AI division of SuperStaff. He joined SuperStaff as CEO in 2019. SuperStaff was founded in 2009 and is in its 18th year of business.</p>
]]></content:encoded></item></channel></rss>