AI Evaluation

Why I Did Not Switch to the Model That Scored Higher

A newer AI model beat my baseline on aggregate score. I kept the old one. Gated dimensions beat weighted averages when some failures are unrecoverable.