← Back to work

Case Study · Customer Success & AI

9 failed runs. 100 answers.

Our client success bot failed nine runs in a row. The problem wasn't the bot. It was where its answers lived and how stale they had become. I rebuilt its knowledge base from scratch, with a clear rule on every entry: the bot can draft this one, or a human has to answer it.

Client

The AEA Institute

My role

Knowledge base rebuild, answer rules, review, and rollout with the bot's owner

When

November 2026

Built with

Claude, from the team's own coach guide

9
failed bot runs in a row before the rebuild
100
entries at launch, and 110 today as new questions come in
92
entries the bot may draft (Draft OK)
18
entries only a person answers (Human only)

Before and after

From a page it couldn't reach to a doc it reads every run

Before

Answers on a web pageAbout 73 entries, many out of date
↓
Bot fetches it over the webEvery unattended run stopped to ask for approval
↓
Run failsNine in a row, with "answers unreachable" reports

After

One shared knowledge doc100 entries, each tagged Draft OK or Human only
↓
Bot reads it through a connectorNo approval step, so unattended runs work
↓
Bot drafts, or hands offRules at the top decide which

A look inside

Six entries from the pack

Product names are made generic here. Every entry has the question, the approved answer, and how it's handled.

I can't find the app in the App Store. Where is it?

There's no app to download. The training app opens right in your phone's browser. Sign in with your email and the 6-digit code we send you, then tap Share and choose Add to Home Screen so it opens like an app.

Draft OK

A player forgot their PIN.

On your roster, click the player's name and press Reset PIN. Nothing is emailed. The player has 24 hours to use "Recover your spot" and choose a new 4-digit PIN. If 24 hours pass, reset it again.

Draft OK

I didn't get my 6-digit sign-in code.

Double-check the spelling of your email, then look in spam and promotions. Adding our client success address to your contacts helps. You can always request a fresh code, and if it still doesn't arrive, reply and we'll help you get in.

Draft OK

Can we change our camp start date?

Camp starts on a Monday and runs 28 days, with the retake on day 29. Tell us the Monday you want and our team will set it.

Human only

Account change. Start and retake dates are set by client success.

Can I add my assistant coach?

Yes. Send us their name and email and we'll add them. Your assistant then signs in and sees the same dashboard, roster, and reports.

Human only

Account change. A person adds the assistant on the back end.

How much does it cost? Can we get a discount or refund?

Thank you for asking. A member of our team will follow up with the right options for your program.

Human only

Pricing, quotes, discounts, and refunds always go to leadership.

What I did

Rules first, then answers

The result: the bot reads the pack on its own now, and it flags gaps (like a program with no entry yet) instead of failing. The pack has grown from 100 to 110 entries.

Contact

Let's talk.

Download résumé More work