Putting a Grounded RAG Assistant on a Real Phone Number
We gave our RAG-grounded, fine-tuned assistant a phone number — and then spent a marathon session cutting first-audio latency from ~7 seconds to ~4.5 while keeping every safety guarantee. The wins came from measuring, not guessing: the model's hidden thinking phase, a TTS stall, a timestamp read aloud as '597 Z', and a cache lookup that had no business being serial.
Read More about Putting a Grounded RAG Assistant on a Real Phone Number