We benchmarked GPT-6 Astra on hard document parsing and extraction tasks. It is the best frontier m...
Jerry Liu(@jerryjliu0) · 人工智能
We benchmarked GPT-6 Astra on hard document parsing and extraction tasks. It is the best frontier model for one-shotting document extraction over short and medium-sized documents: 📊 97.2% over short documents, achieving a new SOTA on our benchmark 📊 90.6% over medium documents But a few caveats: * it's pricy! The average price per page is 11c which is 10x our cost-effective document extraction solution * one-shot performance over long documents is inherently tricky, it only achieves 31.7% * the native OCR capabilities of Astra isn't that much better than other frontier models (e.g. Fable 5.1, gpt-5.6-sol). It does very well on table understanding, but isn't great on charts, layout, and semantic formatting. Full results for document extraction on ExtractBench extractbench.ai c3 💬 3 🔄 1 ❤️ 21 👀 1523 📊 7 ⚡ Powered by xgo.ing