The Question a Classifier Cannot Answer
We swapped a 70B chat classifier for a typed-decision model and got 7x the speed at higher accuracy. The result worth writing down was the one where both models scored exactly the majority-class baseline.
Read More about The Question a Classifier Cannot Answer