Search blog posts, product pages, and docs by title, topic, or keyword. Try “RAG”, “compliance”, or “CI/CD”.
Posts in tags: "Latency" (2 posts)
We swapped a 70B chat classifier for a typed-decision model and got 7x the speed at higher accuracy. The result worth writing down was the one where both models scored exactly the majority-class baseline.
Read More about The Question a Classifier Cannot AnswerWe put our grounded assistant on a real phone number, then cut first-audio latency from ~7s to ~4.5s — by measuring the call path, not guessing at it.
Read More about Putting a Grounded Assistant on a Real Phone Number
