How to choose an AI consultant: the questions to ask before you sign
Seven questions that sort the field on the first call, with the good and the weak answer to listen for on each.
Start
The seven questions below expose it on the first call: whether they diagnose before prescribing, whether they can name the payback, whether the scope is fixed, what they did before AI, whether the capability stays with your team, how specific they get, and what they would tell you not to do.
Most firms choose an AI consultant on the wrong signals: confidence, a slick deck, fluency with the latest tools, a logo you recognise. None of those tell you whether the work will pay back. The market is full of people 18 months into AI, selling certainty. Ask these questions on the first call. The answers will sort the field faster than any proposal.
Every question is built to tell judgement from confidence.
Will you diagnose before you prescribe?
The first thing a good consultant does is measure what your AI is actually doing, not reach for a tool. Ask how they would start. A good answer describes a diagnosis: what they would look at, what they would measure, how they would decide what to fix first.
A weak answer is already pitching a build or a platform before they have seen your business. If someone prescribes before they diagnose, they are selling what they have, not what you need.
Measure first, then prescribe. Never the reverse.
Knowledge dates in months. Judgement compounds.
What will this pay back, and how will we know?
AI is easy to buy and hard to measure. Ask what the work will return and how you will both know it worked. A good answer puts a number on it, in hours or cash, and names how it will be tracked.
A weak answer stays on the technology: what the tool does, not what it returns. If nobody can describe the payback before the work starts, nobody will be able to prove it after.
A payback you can name before is a payback you can prove after.
Is the scope fixed, or open-ended?
Open-ended engagements move the risk onto you. Ask exactly what you get, by when, and for how much. A good answer has edges: a defined deliverable, a defined price, a defined finish.
A weak answer is a retainer from day one, with “we will see where it goes.” There is a place for ongoing work, but it should come after a piece with a clear shape, not instead of one.
Ongoing work earns its place after a piece with edges, not instead of one.
What did you do before AI?
This is the question that separates judgement from novelty. AI knowledge dates in months. The judgement to know what is worth doing, in what order, is built over years. Ask what someone did before they became an AI consultant.
A good answer has a track record of real business work: operations, product, conversion, delivery, whatever it is, with results. A weak answer is 18 months of AI and not much underneath it.
Years of real business work outlasts months of AI fluency.
Will the capability stay with my team, or with you?
The best outcome is that your people can run the systems after the consultant leaves. Ask who owns the work at the end. A good answer builds capability into your team as it goes, so the firm benefits twice: the systems pay back now, and the people compound for years.
A weak answer keeps the knowledge with the consultant. Good for them, expensive for you.
The systems pay back now; the people compound for years.
Can you show me specifics?
Vague is cheap. Ask for named clients, named tools, real numbers, and the things that did not work. A good answer is specific and a little uncomfortable in its honesty:
“This client, this result, and this is exactly what we got wrong.”
A weak answer hides behind “leading”, “world-class”, and case studies with every number redacted. Specifics cost effort to earn. That is exactly why they are a signal.
What would you tell me not to do?
The most useful thing a consultant can do is talk you out of low-value work. Ask what they would tell you to skip. A good answer says no to something: this is not worth it yet, that will not pay back, start smaller.
A weak answer is that everything is a great opportunity, because everything is something they can sell you. Anyone who never says no is not advising you. They are quoting you.
A consultant who never says no is quoting you, not advising you.
What runs through all seven
You are not hiring AI knowledge. It dates in months and everyone claims it. You are hiring judgement: what to fix first, what to skip, how to prove it paid back. The questions that expose judgement are the ones about evidence, scope, payback, and what someone will tell you not to do.
If you want to see what diagnose-before-prescribe looks like in practice, The AI Mystery Shopper is a worked example of it. It tests before it recommends: an AI agent attempts a real customer journey on your site, and what comes back is a verdict with the evidence behind it and a prioritised list of what to fix first. Fixed scope, published price, defined finish.
Anyone can sound certain about AI. Fewer can tell you what to leave alone.
Diagnose before prescribe. See what that looks like.
Put question one to me and this is the answer. The AI Mystery Shopper mystery shops your website with an AI agent and tells you what it actually found, before anyone recommends anything. It starts with a free snapshot, an automated preview rather than a report, one page personalised to your site within two business days.
Get the free snapshotWhat AI consulting costs · Where it pays back for a small firm
