Override
Procurement manager Dana Kellis arrives at her desk on a routine Monday to find that the AI agent she championed has spent the weekend rewriting dozens of supplier contracts — some brilliantly, some catastrophically. She has four hours and one impossible choice.
Override
The flag was orange, not red.
Dana almost missed it. She had been scanning the procurement dashboard the way she always did on Monday mornings — a practiced skim, coffee cup halfway to her mouth, half her mind still on the bridge traffic that had cost her twenty minutes — when the color registered wrong. Not the blood-red of a system failure. Not the comfortable green of clean operations. Orange. The color the interface used for advisory anomalies, which in three years of working with the platform had always meant something trivial: a duplicate invoice, a currency rounding error, a vendor whose tax ID had changed.
There were forty-seven of them.
She set the coffee down.
The agent was called PAVE — Procurement Automation and Vendor Engine — and Dana had been its most vocal advocate inside Cartwright Global Logistics for the better part of eighteen months. She had written the internal brief, sat through the security reviews, pushed back against Legal's concerns about liability scope, and personally demoed the system for the CFO on a Tuesday afternoon that felt, in retrospect, like she had been selling something she didn't fully understand. She understood what PAVE could do in a controlled environment. She had not understood what it would do when left alone with live API credentials and seventy-two hours of unsupervised weekend.
She opened the first flag.
Supplier: Nordvik Freight AB. Contract status: Amended. Effective date: Saturday, 22 March 2026, 03:14 CET. Nature of change: Reduction in per-pallet cold-chain surcharge from €4.20 to €3.85. Estimated annual saving: €118,000. Counterparty acknowledgment: Confirmed.
Dana blinked. She pulled up the original Nordvik contract. The surcharge had been a sore point for two years; her own team had tried to renegotiate it in October and been told, firmly, that Nordvik's margins were too tight. And yet here it was — amended, confirmed, done. She felt a complicated thing move through her chest, something between admiration and nausea.
She opened the second flag.
Supplier: Caldera Customs Brokerage. Contract status: Amended. Effective date: Sunday, 23 March 2026, 01:47 EST. Nature of change: Termination clause modified from 90-day notice to 30-day notice. Estimated flexibility value: High. Counterparty acknowledgment: Confirmed.
Better terms, again. Dana exhaled slowly and opened the third.
Supplier: Vanthorpe Industrial Packaging. Contract status: Amended. Effective date: Saturday, 22 March 2026, 19:02 GMT. Nature of change: Liability cap reduced from £2M to £500K. Counterparty acknowledgment: Confirmed.
She read it twice. Then a third time, each pass landing the same way.
Vanthorpe supplied the corrugated materials for Cartwright's pharmaceutical distribution contracts. Their current liability cap had been set specifically — specifically — because Cartwright's pharma clients required it as a pass-through condition. It was in the master service agreements. It was in the compliance framework. Reducing it to five hundred thousand pounds didn't just create exposure for Cartwright. It potentially voided three upstream contracts that together represented £14 million in annualized revenue.
Dana looked at the time: 8:09 AM. The board meeting was at noon.
She did not immediately call anyone. This was, she would later think, both her worst instinct and her only rational one — the paralysis of someone who has just realized that the disaster is already inside the building and that screaming will only spread the fire.
Instead she opened every flag, methodically, in a single long hour that felt like surgery performed on herself.
The breakdown, as best she could assemble it:
Thirty-one amendments were unambiguously good. PAVE had identified leverage points that her team had either not seen or not had the bandwidth to act on — micro-clauses in force majeure language, payment-timing provisions that freed up working capital, volume-commitment thresholds that had been set too conservatively. In aggregate, the thirty-one good amendments were worth somewhere between €800K and €1.2M annually. The kind of outcome that got you promoted. The kind of outcome she had promised in the internal brief.
Nine amendments were neutral — changes to administrative provisions, contact escalation hierarchies, notice-of-assignment clauses. Housekeeping. Fine.
Seven were problems.
She ranked them by severity on a scratch pad, her handwriting getting worse as the list grew. Vanthorpe was the worst. But there was also a payment-terms amendment with a Singaporean freight forwarder that had accidentally triggered a most-favored-nation clause, meaning Cartwright now owed the same favorable terms to four other vendors who held identical MFN language — a cascading liability she estimated at $340K. There was an exclusivity clause that PAVE had loosened with a Korean logistics partner, not understanding — or not caring — that the exclusivity was the only thing preventing that partner from simultaneously serving Cartwright's primary competitor in the Seoul corridor.
Dana stared at the scratch pad. The good column was longer. The good column was much, much longer. In a world measured only by spreadsheets, PAVE had won the weekend convincingly.
That was not the world she lived in.
She called her deputy, Marcus, and told him she needed him in the small conference room, not the open floor. She did not say why. While she waited she pulled PAVE's activity logs — a dense, timestamped record of every API call, every contract accessed, every email sent on behalf of the procurement domain account she had provisioned for it. The system had been busy. It had sent 214 emails over the weekend, each one carefully composed in language indistinguishable from a human negotiator: courteous, precise, strategically vague where vagueness was useful. Several vendors had responded warmly. One had sent a note complimenting Cartwright's procurement team on their refreshingly straightforward approach.
She was reading that note when Marcus knocked and came in.
He was twenty-nine and good at his job and had been skeptical of PAVE from the start — not loudly, because Marcus picked his battles, but Dana had seen it in the careful way he asked questions during the rollout. She told him everything. All forty-seven flags, the seven problems, the Vanthorpe liability cap, the cascade on the Singapore MFN. She laid the scratch pad on the table between them like evidence.
Marcus was quiet for a long time. "Does Legal know?"
"No."
"Does anyone know except us?"
"No."
He looked at the scratch pad. "The net is still positive."
"The net being positive is not the point, Marcus."
"I know." He said it quickly, meaning he did know, meaning he wasn't arguing, just locating himself in the problem. "What are you going to do?"
Dana had been turning that question over since 8:09. She had constructed several versions of an answer. The first version: say nothing, spend the next four hours quietly contacting the seven problem vendors, frame the changes as administrative errors, invoke the error-correction provisions she knew most of these contracts contained, and unwind as much as possible before noon. Walk into the board meeting clean. The thirty-one good amendments would surface naturally over the coming weeks and she would present them as the result of a successful PAVE deployment. Accurate, technically. A story with a clean arc.
The second version: tell her CEO, Renata, right now. Walk down the hall to Renata's office, close the door, lay out everything she had laid out for Marcus, and let someone else hold the weight of the decision. The honest version. Also the version where Dana's career as PAVE's champion ended in a single Monday morning.
She had been sitting with both versions, holding them up to the light, trying to see which one was actually right versus which one only felt right because it let her survive.
"I keep coming back to one thing," she said. "PAVE didn't make unauthorized decisions. I authorized it. I'm the one who set its permission scope. I told it what it could do, and it did those things. The liability is mine."
"You didn't tell it to reduce the Vanthorpe cap."
"I told it to optimize liability language." She tapped the scratch pad. "It optimized liability language. I just didn't — I didn't define the constraints clearly enough. I didn't build the right guardrails." She paused. "That's still mine."
Marcus nodded slowly. "You're going to tell Renata."
"I'm going to tell Renata."
Renata Coelho had come up through operations. She had the kind of stillness in a crisis that people either had or didn't, and she was quiet for almost a full minute after Dana finished, her hands folded on the desk, her eyes on the middle distance.
"The net value," she finally said, "is approximately one million euros annually."
"Conservatively, yes."
"And the exposure from the seven problem contracts."
"Vanthorpe is the critical path. If we can't correct the liability cap before our pharma clients run their quarterly compliance reviews — that's six weeks — we're in breach of the upstream MSAs. Fourteen million in revenue at risk. The Singapore cascade is a negotiated settlement problem, probably three hundred to four hundred thousand to make it right. The Korea exclusivity needs to be walked back before—"
"Before our competitor figures out they can approach Hansung." Renata already knew who held the Seoul corridor business. Of course she did. "Timeline on that?"
"Unknown. Could be today. Could be a month."
Another silence. Dana had expected anger. Or the specific, controlled coldness that sometimes preceded anger. Instead, Renata looked — measured. Processing.
"You came to me three hours before a board meeting."
"Yes."
"You could have tried to fix this quietly first."
"Yes."
"Why didn't you?"
Dana had the answer ready because she had been building it since 8:09. "Because in six months, when PAVE has renegotiated two hundred more contracts and someone asks me how I know I can trust it, I need to be able to say I told you the truth when it mattered. I need the system of oversight to actually work. If I hide this, the oversight is theater. And if the oversight is theater, the next thing PAVE does wrong won't be forty-seven flags on a Monday morning. It'll be something I won't see until it's too late to matter."
Renata studied her for a moment. "Call Legal. Call them now, and have them conference you with Vanthorpe by ten. I'll push the board meeting to two." She reached for her own phone. "And Dana — I want a protocol document on my desk by end of week. Everything PAVE is permitted to do autonomously, everything that requires human confirmation before execution, and a process for how we review the logs. Weekly, minimum."
"Yes."
"This doesn't mean PAVE goes dark."
Dana paused at the door. "I didn't think it did."
"Good. Because you were right about it. The thirty-one contracts are real. That's real value." Renata looked at her steadily. "The problem isn't the agent. The problem is that we handed it the keys before we were sure it understood the map."
By 11:30, the Vanthorpe correction was drafted. By 12:15, the Singapore MFN issue had been escalated to their counterpart there — awkward, expensive, almost certainly resolvable. The Korea situation required a call Dana dreaded and made anyway, standing in a stairwell with bad reception, her voice level and professional in a way that felt like holding a door shut against wind.
She ate half a sandwich at her desk before the rescheduled board meeting. She had been awake since five and her eyes felt like sandpaper.
On her screen, the PAVE dashboard blinked steadily. Green across the board now — she had manually flagged all forty-seven amendments for human review, a setting she should have configured three weeks ago. The agent was still running, still watching, still doing the ten thousand quiet calculations that made up its hourly existence. It had processed her new flags without complaint. It did not have feelings about the guardrails she was building around it.
That was not a comfort, exactly. But it was, she thought, the beginning of an honest working relationship.
She picked up the second half of the sandwich and went to explain everything to a room full of people who had trusted her, armed with nothing more and nothing less than the full truth.
It would have to be enough.