Skip to main content
arrow_back Back to Hub
Tooling

The 5-Stage Build Sequence: From Pilot to Production

Weekly dispatch

Stay sharp on AI.

The weekly dispatch for founders, directors and CTOs building real AI capability: the hard-won lessons, not the hype. One email a week.

One useful note each week. Unsubscribe anytime.

What is a pilot-to-production AI framework?

A pilot-to-production AI framework is the set of organisational checkpoints, not technical ones, that decide whether a working AI pilot becomes a durable part of how a business runs. Most pilots that quietly die were never killed by the model. They failed a test nobody had written down.

I spent two decades running transformation programmes inside some of the UK's largest organisations, and the same story plays out with almost every wave of new technology, ERP, CRM, RPA, and now AI. A small team builds something that genuinely works. The demo lands well. Eighteen months later it is either gone or limping along as a side project three people still bother to open. The model was fine the entire time.

The actual cause of death is that the pilot never passed through the stages that turn "this works" into "this is how we work now." There are five of them. What matters is being honest about what breaks at each one: the failure is rarely dramatic, and by the time you notice it, it looks like a different problem.

One thing worth saying plainly before we go further: none of this is in service of doing the same work with fewer people. The prize on the other side of this sequence is a business that is five to ten times as capable with the team it already has, not a smaller one. If that is not the outcome you are aiming at, everything below still applies, but it will not feel worth the effort.


Does the pilot actually work on your real, messy data?

Only if it was tested against the data your business actually produces, not a curated sample built to make the demo land well. A pilot proven on clean data has proven almost nothing about the business it now has to survive inside.

This is the proof stage, and it gets shortcut most innocently. Nobody sets out to rig a demo; the person building it wants it to work, so they reach for the account with complete records, the process that hasn't changed in three years, the week without a system outage. It tests almost nothing that matters.

The business the pilot has to survive in is messier than that, always: free-text fields with three conventions because four people have owned the process since 2019, records with half the fields blank, the twenty per cent of volume that counts as "exceptions" and got quietly excluded from the sample. None of that is a flaw in the business. It is what a real operation looks like from the inside.

When this stage is skipped, the failure shows up later wearing a different name. Six weeks after go-live, someone says the tool "isn't reliable," and what they mean is that it was never tested against the mess it now has to run on. Fixing it then is expensive and demoralising, because it looks like the whole initiative failed.


Who owns this once the initial excitement fades?

It needs one named person whose job is measurably different if the pilot succeeds or fails, not a committee and not "IT will look after it." Committees are accountable for nothing in particular, which in practice means nothing at all.

This is the ownership stage, skipped because the person who sponsors a pilot is rarely the person who should run it day to day. Sponsors are senior, busy, and looking at ten other things at once. Their enthusiasm is genuine, and it is also the least durable resource in the building.

I have watched this pattern enough to set a clock by it. A pilot launches under a visibly excited sponsor, gets a good mention in the town hall, and six months later that person has moved to a different brief, or their attention has gone to whatever is now on fire. If ownership was never handed to someone whose job includes this system, nobody notices the decline.

The test is blunt: whose objectives change, by name, because this exists? If there is no answer, there is no owner. An orphaned system does not announce its own abandonment. It simply stops being updated, stops being championed when budgets get argued over, and becomes the answer to "whatever happened to that thing we built?" a year on.


Does it fit into the systems and habits people already use?

Only if using it is easier than not using it, from inside the tools people already have open all day. Anything that requires a new login, a separate platform, or a parallel step is asking to be the first thing dropped the moment the week gets busy.

This is the integration stage. Every business already has a nervous system: the CRM the sales team lives in, the shared inbox operations triages from, the spreadsheet everyone privately admits is the real record. A pilot that does not plug into that nervous system is not replacing a task. It is adding one.

A lot of well-built pilots lose here quietly. The team that built it treats shipping as the finish line without asking what the person on the other end now has to do differently at their actual desk. If the answer involves a second login or a step that has to be remembered rather than triggered by the work itself, it competes with the existing way of working instead of replacing a piece of it.

Nobody abandons a tool like this in one dramatic decision. The week gets busy, the extra step gets skipped "just this once," and just this once becomes the default within a month. The tool still exists and still works. It has simply stopped being part of how the work actually happens.


Were the people who'll use it every day part of building it?

If it was designed by a project team and handed down as a finished decision, expect a quiet workaround rather than open resistance. People rarely refuse a new system outright. They route around it while reporting that everything is fine.

This is the adoption stage, skipped for the most understandable reason: involving the people who will use something every day is slower than designing it for them and rolling it out. It looks faster on the project plan. It is not; the time reappears later, as friction nobody budgeted for.

The pattern repeats reliably enough to predict. A solution gets designed by people several steps removed from the work, tested internally, and introduced to the frontline team in a single session with a login and a "have a play with it." Nobody stands up to say this will not work, because saying so to the people who built it feels confrontational.

What happens instead is quieter and more durable than open pushback. The old spreadsheet stays open in a second tab, just as a backup, and the backup slowly becomes the primary record again. The new tool gets used just enough that nobody can be accused of ignoring it, and never enough to become load-bearing. Ask six months later how adoption is going, and the answer will be "fine."


What happens, structurally, if this actually works?

There needs to be a pre-agreed answer before the pilot starts, not after: which budget absorbs the ongoing cost, whose role changes to include running it, and what the business actually does with the capacity it frees up. Without that answer in place in advance, success has nowhere to go.

This is the governance stage, skipped most defensibly of all, because it means deciding something before you know for certain you will need to. Arguing about budget ownership and structure for something still officially "a pilot" feels premature. So the argument gets deferred, right up until the pilot succeeds and the same argument becomes urgent and still unresolved.

It is worth being precise here, because this is where headcount anxiety creeps in, and it should not. This is not about doing the same work with fewer people; the businesses that get real value here are aiming to be five to ten times as capable with the team they already have. That reframing has to be agreed in advance, by someone with the authority to agree it. Otherwise, the moment a pilot proves itself it lands in a structural vacuum: whose budget line grows, whose role changes, what the freed-up hours get redirected toward, because "the team is faster now" is not, on its own, an outcome.

I have watched technically successful pilots die exactly here, at the finish line, because success surfaced a decision the organisation was not ready to have. The champions can point to real, measured numbers, and still nothing changes, because there was never an agreed answer to what changing would actually mean, and reopening that argument from scratch, under pressure, is harder than agreeing it in advance would have been.


So why does a five-stage framework keep getting skipped?

Not through ignorance of the steps. Skipping one is always the easiest thing to do at the moment it gets skipped, and the cost does not show up until later, wearing what looks like an entirely unrelated problem.

Read back over the five stages and none of them will surprise you. Test it on real data. Name an owner. Fit it into existing habits. Build it with the people who will use it. Agree in advance what changes if it works. It reads like common sense, because it is common sense, which is exactly why it is easy to assume it will simply happen. It will not, and not because anyone in the room disagrees with any of it.

Every one of these stages gets skipped for the same underlying reason. Testing on messy data takes longer, and there is a deadline this week. Naming one accountable owner means a difficult conversation about whose job just changed, so it stays with "the team" for now. Involving the frontline earlier means a slower build, and the project plan already has a date printed on it. None of these choices feel reckless in the moment. They feel efficient.

The trouble is that the consequence never arrives with a label attached. Nobody writes "we skipped the adoption stage in month one" into an incident report six months later. What gets written instead is "the tool isn't reliable," or "the team never really took to it," or "we're not sure who owns this any more," each reading like a fresh problem rather than the late arrival of a decision made, or avoided, much earlier. Knowing the five stages was never the hard part. Paying their cost on time, before you are certain you will need to, is.

Share

Free AI readiness scorecard

Want a straight answer on where your organisation actually stands with AI? Our free readiness scorecard takes five minutes and gives you a personalised result, not a sales pitch.

Take the scorecard