2026 In-the-Wild PDF Accessibility Benchmark: 31 Real Public PDFs, 228 Pages
Measured across real U.S. municipal portals (.gov), higher-education handbooks (.edu), interactive AcroForms, scanned city ordinances, and EU hardware datasheets using deterministic local auto-tagging (pdfa11y) and veraPDF 1.30.3.
Segment-by-Segment Benchmark Breakdown
| Segment | Corpus Category | Docs | Pages | Failed Rules (Before → After) | Visual Pixels Preserved |
|---|---|---|---|---|---|
| A | Municipal & State Portals (.gov) | 7 | 86 | 44 → 0 | 7 / 7 |
| B | Higher-Education Handbooks & Syllabi (.edu) | 7 | 59 | 49 → 0 | 7 / 7 |
| C | Interactive Fillable AcroForms (opm.gov, seattle.gov, .edu) | 7 | 11 | 58 → 0 | 7 / 7 |
| D | Scanned Raster Ordinances (RapidOCR 3 Tr) | 5 | 24 | 23 → 0 | 5 / 5 |
| E | Commercial / EU EAA Hardware Datasheets | 5 | 48 | 38 → 0 | 5 / 5 |
Expanded 124-Domain Public Crawl Corpus (774 PDFs, 19,022 Pages)
Across our broader baseline crawl of 124 public-sector and higher-education domains (28 .gov, 89 .edu, and 7 public-interest portals), veraPDF flagged 771 of 774 unique PDFs (99.61%) totaling 5,453 failed rule instances and 3,891,504 failed clause checks (225/225 failing on .gov; 524/527 failing on .edu). Crucially, 76.87% (595/774) already contained export tags yet 99.50% (592/595) still failed ISO 14289-1.
Within the expanded audit cohort of 15 U.S. digital agency public-sector client portfolios totaling 5,384 pages (oakwoodohio.gov, dublinohiousa.gov, cityofseaside.us, and peers), baseline scans flagged missing /StructTreeRoot, pdfuaid:part=1 XMP identifiers, table /Scope, and subset font CIDSet metrics across every sampled backlog. All 15 representative deliverables passed veraPDF 1.30.3 with 0 failed rules and 100% pixel preservation.
Honest Machine-vs-Human Scope Notice
Passing veraPDF 1.30.3 (0 failed rules) proves ISO 14289-1 machine syntax conformance—not full human semantic usability under WCAG 2.1 AA. Every Studio QA bundle initializes OPERATOR-QA.md with human_review: PENDING so your reviewer verifies reading order, descriptive <Figure> alt text, color contrast, and NVDA/PAC 2026 playback before publishing.