Before you begin
- Add your main knowledge sources first, such as your website and fee schedules.
- Gather 20 to 50 questions residents really ask. Good places to look are call logs, the front counter, and email inboxes. Include a few questions you know the AI shouldn’t answer.
Add test questions
- Select Health Check under AI Front Desk in the left menu.
- Open the Questions tab.
- Select Add Questions.
- In Question, enter a question the way a resident would ask it, such as How much does it cost to register my dog?
- In Category, enter a group, such as Animal control.
- Optional: in Correct Answer, enter the answer you expect. This helps score the response.
- Optional: under Relevant Sources, select Add source and pick the page, document, or map layer the AI should use.
- Select Save.
Run a health check
- Select Run Health Check.
- Pick All questions or one Category.
- Optional: in Notes, describe what changed since the last run, such as Added 2027 fee schedule.
- Select Run.
See which answers need work
- Open the Results tab when the run finishes.
- Check the Pass Rate and Results by Category.
- Open any question marked Fail or Pass with Warnings.
- Select FAQ on a failed question to write the missing answer as an FAQ without leaving the results.
- Compare Expected Sources with Sources Used, and read the AI Judge Evaluation.
Try the widget and phone line yourself
- Select Settings, then Channels.
- On the Chat tab, select Open Chat in Test Mode.
- Ask several questions the way a resident would.
- On the Search tab, select Open Search in Test Mode and try the same questions.
- If you have an AI phone line, call it and ask a question that should transfer you to staff.