·
AI your auditors will sign off.
A public-sector team had AI that worked, but nobody would approve it. We built eight AI agents to be approved from the start. All eight now run in production with no audit gaps.
The AI did not change. The way it was built did.
- Looked good in a demo
- No one could say what the AI used for an answer
- No plan for when it was wrong
- Checks ran after the answer had gone out
- Every answer traces back to its source
- Rule checks run on the inputs, before a decision
- Weak evidence is visible, not hidden in a confident answer
- Each agent has its own stop button, and a team on call
The AI worked. Nobody would sign it off.
The output looked good in a demo, but approval never came. No one could answer what the system had used to reach a conclusion. No one could say what would happen if an agent got one wrong. This was citizen services, so it mattered.
- No clear source behind each answer.
- No plan for when an agent is wrong.
- A weak basis hidden inside a confident answer.
- Checks that ran after the answer had already gone out.
- Governance that fades after go-live.
- You cannot say what your AI used to reach a conclusion.
- You cannot say what happens when an agent gets one wrong.
- Confident answers might be hiding weak evidence.
- Your checks run after the answer has already gone out.
Why it mattered. "An agent that cannot be audited cannot be deployed." The model was not the blocker.
Start from what the auditors need to approve.
We began with what the audit team would need, not with what the model could do. It sounds like a small change of order, but it decides what gets built in Week 2. Traceability, rule checks, confidence scores and the stop button went in with the build, not added later. A late fix is exactly what a reviewer learns to spot.
Controls built in with the agents, not after.
- Week 1: a one-pager that wrote down what the audit team would need to approve.
- Trace to source on every signal.
- Rule checks on the inputs feeding a decision.
- A confidence score on every signal.
- A stop button for each of the eight agents.
- An on-call team handed over at the end, so controls stay live after launch, "which is where most AI governance quietly lapses."