We built the fix for our worst weakness. Three checks made us warrant it.
Our failure taxonomy now ranks boundary instability first among the parser's weaknesses. We
16 posts tagged with "Evaluation"
Measuring the parser — metrics, golden sets, parity scorecards, calibration, and eval discipline.
View All TagsCan you fix order-blindness by turning up the volume?
Two days ago we retired a piece of decode-time implementation we'd been leaning on,
The model said P.O. Box all along. We weren't listening.
Last night our release check failed twice before it passed, and both failures had the
Four numbers tried to lie to us in 24 hours. We shipped anyway.
Yesterday we wrote about a lookup table that scored a perfect 100 and nearly talked us
A lookup table scored 100%. We shipped the model anyway.
This morning we published a post that ended with a tidy rule: some address tags don't
The right name in the wrong state
Our resolver scored 93.7% on the metric we'd been quoting for months. On the same addresses, its median answer was 326 kilometers from the truth. Both numbers were correct. Only one of them told the truth.