Assistant with big KnowledgeBase

Hi guys,

Im building an AI receptionist that is meant to handle missed calls during after-hours and answer common customer questions. As many businesses (I assume) get the same common X questions all the time, I have tried to put together a KB. It turned out that my business has about 5 different "areas" that have its own separate Q&As. My thinking process was the following:

Putting everything into one prompt is going to cause latency and makes it really hard to update.

I have decided to create 5 different KB documents and prompted the AI to use each KB based on the questions the caller asks. So now the latency is good, no big issues there, but now the AI is hallucinating a lot or using answers from the appropriate KB but only some. Some answers are clearly in the KB yet it says doesnt have answer for it.

I might have to mention that I sent the KB through chat GPT and asked it to convert to an easy-to-follow format for the voice assistant.

Do you have any helpful tips for me on how to handle this?

2 comments