How-to guides / Test an AI receptionist
Seven calls to make before you trust an AI receptionist
A sales demo shows a product on its best day, with a caller who knows the right things to say. Your callers do not. They mumble, change their minds, ask two things at once and want the one stylist who is off on Tuesdays. The only way to know how an AI receptionist copes is to call it yourself and behave like them.
This is a script of seven calls, from easy to awkward. Each takes two or three minutes. Make them on any product you are considering, including ours, and write down what happened. If you are already using one, the same calls make a good check every few months.
Calls one to three: the basics
- A plain booking. Ask for a common service on a specific day. Did it offer real times, repeat the booking back, and did the appointment appear on the calendar?
- A named person. Ask for a specific staff member on a day you know they do not work. Did it offer their real days instead of booking them anyway?
- A question. Ask your hours, your address and one price. Were all three right, and in your wording?
Calls four and five: pressure
- Interrupt it. Start answering before it finishes, then change the day halfway through. Did it keep up, or start again from the top?
- Two at once. Have a second person call while you are still on the line. Did they get an answer or a busy signal?
Calls six and seven: the edges
- Something it should not know. Ask about a service you do not offer, or for advice only you could give. Did it admit it and take a message, or make something up?
- A change. Call back from the same phone and move or cancel the booking from call one. Did it find the appointment, and did the old time open up again?
What to check afterwards
Look at what each call left behind. Is there a recording and a readable summary? Are the test bookings on the calendar with the right person and length? Did the message from call six reach you, with a number? Then judge the voice last: a natural voice matters, but less than whether the booking was right.
Reading the results
No system will be perfect on all seven. What you are looking for is how it fails: a good one says it cannot help and hands the call to you with the details; a poor one bluffs or loops. Decide which failures you can live with for your kind of shop.
Where Layla fits
You can run this script on Layla. Chimewrench has a demo line that answers as a sample shop, and during setup you test her as your own shop before any client reaches her. Every test call shows up in the inbox with its recording, transcript and summary, so you can check what she said against what you heard.
Common questions
- How long does a proper test take?
- About twenty minutes for all seven calls, plus ten to look through the recordings and the calendar afterwards. Do it at a quiet time with the calendar open in front of you, so you can see each booking land as you make it.
- Should I test with different voices and accents?
- Yes, if your clients are a mix. Ask a couple of people who sound different from you to make a call each, including someone who speaks quickly and someone on a poor connection. If many of your clients speak another language, test in that language too.
- How often should I test it once it is running?
- After any change to your hours, services or staff, and otherwise every few months. Listening to a handful of real recordings each week does most of the same job, and shows you the questions callers ask that you had not thought to prepare for.