Introducing s-1: Sievly’s new document reading model

All posts

Guides

Guide: how to evaluate document accuracy on your own files

Benchmarks are a starting point. This guide shows how to build a small, honest evaluation set from your own documents.

Lena Varga

·

Research Engineer

sievly

Evaluating accuracy

Public benchmarks rarely look like your documents. A small evaluation set built from your own files will tell you more in an afternoon.

Pick the hard pages

Choose the documents that cause problems today: scans, handwriting, nested tables, long contracts. Easy pages make every tool look the same.

Write down the truth

For each page, record the values a careful reviewer would expect. Keep it in a simple spreadsheet.

Compare field by field

Run each tool and compare values field by field, not by overall text similarity. Look at where answers came from, not only whether they match.

Repeat as you change

Keep the set and rerun it whenever you change models or schemas.

Start building with your own documents.

sievly

Sievly is the document platform for AI teams that need dependable accuracy on real-world files, at any volume.

Sievly, Inc. © 2026

Get Sievly updates by email

Product notes and new releases from the Sievly team, in your inbox.

Unsubscribe anytime. Privacy Policy

sievly

sievly

Sievly is the document platform for AI teams that need dependable accuracy on real-world files, at any volume.

Sievly, Inc. © 2026

Get Sievly updates by email

Product notes and new releases from the Sievly team, in your inbox.

Unsubscribe anytime. Privacy Policy

sievly

sievly

Sievly is the document platform for AI teams that need dependable accuracy on real-world files, at any volume.

Sievly, Inc. © 2026

Get Sievly updates by email

Product notes and new releases from the Sievly team, in your inbox.

Unsubscribe anytime. Privacy Policy

sievly

Create a free website with Framer, the website builder loved by startups, designers and agencies.