Featured
The mass tort playbook
Codify qualification and audit logic, deploy agent-driven validation, and route exceptions cleanly — so clean cases move automatically.
Read the playbook
Share
← Notes
Part 2 · AI Adoption in Ops-Heavy Industries
AI Strategy

You don't have an AI strategy, you have experiments

A dozen running AI projects is not momentum. It is a collection of disconnected experiments held together by a few tired operators and a lot of unwritten knowledge. Part two of a series on why AI adoption gets messy in fast-growing, ops-heavy companies, and what to do about it.

Adrian ColeAdrian ColeFounderJun 20265 min read

Most companies discover AI the same way. Someone on the team gets curious, builds a prompt that drafts a tricky email, and saves an hour. A dispatcher writes a script that cleans up carrier paperwork. A recruiter wires a tool that screens resumes against a job spec. Each of these is a real win. None of them is a strategy.

For a while, the wins compound and everyone feels fast. Then the company grows, headcount climbs, the number of experiments multiplies, and something shifts. The same AI activity that used to create leverage starts creating drag. Leaders look at a dozen running projects and assume they have momentum. What they actually have is a collection of disconnected experiments held together by a few motivated people and a lot of unwritten knowledge.

This is the second piece in our series on why AI adoption gets messy in fast-growing companies. The first failure mode is the one almost nobody names while it is happening: tool sprawl.

From pilot to sprawl a few clean wins multiply into a tangle of disconnected tools that all land on one tired operator

How sprawl begins

Sprawl rarely starts as a mistake. It starts as encouragement. Leadership says "everyone should be experimenting with AI," which is the right instinct. People respond. The ops analyst spins up one tool, the support lead builds a bot, the sales team buys a seat for a different platform, and three people independently write prompt libraries that do roughly the same thing.

No single decision here is wrong. The problem is that there is no shared layer underneath them. Each experiment is born inside one team, optimized for one person's workflow, and documented nowhere. The company is not adopting AI. It is accumulating it.

In a recruiting firm, this looks like four recruiters each running their own candidate-screening prompt, each with a slightly different definition of "qualified." In a logistics operation, it is two regional teams building separate tools to parse the same carrier documents, neither aware of the other. In a home services business, the scheduling team automates customer follow-ups while the sales team automates a near-identical sequence, and a customer ends up getting both.

Why scattered experiments feel productive

The reason sprawl is dangerous is that it feels like progress for a long time. Activity is easy to see. A leader can count the pilots, point to the prompt library, and name the people driving it. Velocity looks high.

But activity is not the same as leverage. Leverage means the organization can do more with the same effort, repeatably, without depending on who happens to be in the room. Most early AI experiments deliver the opposite. They speed up one person on one task, and they create a quiet dependency on that person to keep the thing running. The output looks like scale. The underlying structure is fragility.

Fast-growing companies are especially exposed here, because growth hides the cost. When revenue and headcount are climbing, a little inefficiency disappears into the noise. The mess is real, but the trend line covers it.

The hidden costs nobody put on the roadmap

Tool sprawl carries a bill that arrives late and lands on operations. A few line items show up in almost every company we see.

  • Duplicated workflows. The same problem gets solved three times by three teams who never compare notes. You pay for the build three times and you maintain it three times.
  • Unclear ownership. When the analyst who built the screening tool goes on leave or leaves the company, the tool keeps running until it breaks, and then nobody knows how it works. In a support operation, a single undocumented macro can quietly shape thousands of customer replies, and no one can say who is accountable for it.
  • Inconsistent outputs. Four versions of "qualified candidate" or "high-priority ticket" mean four standards. To a customer or a client, that reads as the company being inconsistent, because it is. Quality stops being a property of the organization and becomes a property of whichever tool touched the work.
  • Maintenance burden. Every prompt, script, and bot is a small piece of software. Models change, vendors change pricing, an API shifts, and someone has to notice and fix it. Ten experiments owned by no one is ten unscheduled fire drills waiting to happen.
  • Operator overwhelm. The hardest cost to see sits with the few people holding it all together. In most companies, two or three operators have quietly become the human glue between a dozen tools. They are the documentation. They are the integration layer. They are the on-call team. They are also a single point of failure, and they are tired.

Why more AI does not mean more leverage

Here is the counterintuitive part that trips up smart leaders. Past a certain point, adding AI projects reduces leverage instead of increasing it.

Every new disconnected tool adds surface area: another thing to maintain, another standard to reconcile, another dependency on tribal knowledge. The coordination cost of running many uncoordinated experiments grows faster than the value any single one delivers. You can have more AI in the building and less actual capability, because the operators who could be doing high-value work are instead keeping the patchwork alive.

This is why "how many AI initiatives do you have running" is the wrong scorecard. A company with three well-owned, standardized, documented capabilities has more real leverage than one with twenty experiments and no map.

The takeaway: structure before scale. Unstructured AI growth creates mess before it creates scale. The goal is not to stop experimenting. Experiments are how you find what works. The goal is to convert wins into shared capability before the count gets away from you. A practical way to get ahead of sprawl:

  1. Inventory what already exists. List every AI tool, prompt library, bot, and side project actually in use, and name the single person who owns each one. The list is almost always longer than leadership expects.
  2. Find the duplicates. Wherever two teams solve the same problem differently, that is your first consolidation target and your first standard to write down.
  3. Assign real ownership. Every capability that touches customers, clients, or revenue needs a named owner and basic documentation. If it breaks when one person is out, it is not a capability yet. It is a liability.
  4. Set the standard, then scale it. Pick one definition of "qualified," "high-priority," or "done," wire it into the shared tool, and retire the variants. Standardize first, expand second.
  5. Measure capability, not activity. Track the number of owned, documented, standardized capabilities, not the raw count of experiments. That number is the one that correlates with leverage.

The companies that win with AI are not the ones running the most experiments. They are the ones that turned a handful of experiments into infrastructure before the sprawl turned into drag.

Glossary

Get fluent in AI sprawl

The terms behind this note, in plain words. Handy the next time AI projects come up in a leadership meeting.

Maintenance burden

The ongoing work of keeping prompts, scripts, and bots running as models, vendors, and APIs change. Every experiment is a small piece of software that someone has to own.

Orchestration

Connecting separate AI tools and steps into one coordinated workflow, so the pieces work together instead of as scattered, standalone experiments.

Prompt library

A shared, reusable set of prompts a team relies on. Helpful when it is shared and owned, a source of inconsistency when three teams each keep their own.

Shadow AI

Unsanctioned AI use that no one approved or documented. Tools spun up inside one team and known only to the people who built them.

Single source of truth

One agreed place where a definition, standard, or capability lives, so everyone works from the same version instead of four competing ones.

Standardization

Agreeing on one definition of “qualified,” “high-priority,” or “done” and wiring it into the shared tool, so output quality belongs to the organization, not to whichever tool touched the work.

Tool sprawl

The unmanaged accumulation of disconnected AI tools, prompts, and bots across an organization, each built in isolation and documented nowhere.

Workflow

A repeatable sequence of steps that gets a piece of work done. The unit AI is meant to speed up, and the thing that gets duplicated when teams do not compare notes.

Adrian Cole
Written by
Adrian Cole
Founder & CEO, Impact Velocity Studio

Over a decade leading product, now building AI agents and AI-first systems for mid-market and fast-growing companies that want them rolled out right. Structure, clarity, and AI-first execution.