BlogBenchmarks8 min read
Measurement

Benchmarking insurance extraction

Insurance extraction benchmarks need document pass rate, required-field score, exact-label score, and evidence score. One aggregate number is not enough.

One score hides too much

An extraction can look successful while missing a required field or attaching weak evidence. A single aggregate score can hide the exact failure that matters in production.

PolDex tracks multiple dimensions: document pass rate, required-field score, exact-label score, evidence score, corpus count, evaluated documents, release-gate status, and publication state. Each dimension answers a different reliability question.

Labels must be source-verifiable

Gold labels are only useful if they can be tied to visible source text, tables, clauses, schedules, or declarations. If the label cannot be verified against the document, it should not become benchmark truth.

This is especially important for public proof. PolDex uses real public documents for release-gate corpora so the 99%+ benchmark story can be inspected without private-customer claims.

Benchmarks become release gates

A benchmark is not just a marketing page. It is a release gate. Every public schema cleared the 100+ document corpus before joining the 99%+ accuracy surface.

That turns regression testing into product discipline. Every schema must keep passing as FastScript gains new readers, rules, and normalizers.