Hybrid OCR-LLM Framework for Enterprise-Scale Document Information Extraction Under Copy-heavy Task面向企业级文档信息提取的混合OCR-LLM框架:针对高重复性任务的优化
Abstract摘要
Information extraction from copy-heavy documents, characterized by massive volumes of structurally similar content, represents a critical yet understudied challenge in enterprise document processing. We present a systematic framework that strategically combines OCR engines with Large Language Models (LLMs) to optimize the accuracy-efficiency trade-off inherent in repetitive document extraction tasks. Unlike existing approaches that pursue universal solutions, our method exploits document-specific characteristics through intelligent strategy selection. We implement and evaluate 25 configurations across three extraction paradigms (direct, replacement, and table-based) on identity documents spanning four formats (PNG, DOCX, XLSX, PDF). Through table-based extraction methods, our adaptive framework delivers outstanding results: F1=1.0 accuracy with 0.97s latency for structured documents, and F1=0.997 accuracy with 0.6 s for challenging image inputs when integrated with PaddleOCR, all while maintaining sub-second processing speeds. The 54× performance improvement compared with multimodal methods over naive approaches, coupled with format-aware routing, enables processing of heterogeneous document streams at production scale. Beyond the specific application to identity extraction, this work establishes a general principle: the repetitive nature of copy-heavy tasks can be transformed from a computational burden into an optimization opportunity through structure-aware method selection.从高重复性文档中提取信息是企业文档处理中一个关键但研究不足的挑战,其特点是包含海量结构相似的内容。我们提出了一种系统性框架,通过战略性地结合OCR引擎与大语言模型(LLM),优化了重复性文档提取任务中准确性与效率之间的平衡。与追求通用解决方案的现有方法不同,我们的方法通过智能策略选择来挖掘文档的特定特征。我们在四种格式(PNG、DOCX、XLSX、PDF)的身份证明文档上,针对三种提取范式(直接提取、替换提取和基于表格的提取)实施并评估了25种配置。通过基于表格的提取方法,我们的自适应框架取得了卓越成果:在结构化文档中,F1准确率达到1.0,延迟仅为0.97秒;在集成PaddleOCR处理具有挑战性的图像输入时,F1准确率达到0.997,延迟仅为0.6秒,且全程保持亚秒级的处理速度。与多模态方法相比,该框架实现了54倍的性能提升,结合格式感知路由,能够实现生产规模下异构文档流的处理。除了在身份信息提取中的具体应用外,这项工作确立了一个通用原则:通过结构感知的策略选择,可以将高重复性任务的计算负担转化为优化机遇。
Hybrid OCR-LLM Framework for Enterprise-Scale Document Information Extraction Under Copy-heavy Task
Zilong Wang Ningbo Institute of Digital Twin Eastern Institute of Technology Ningbo, Zhejiang 315200, P.R. China zlw@idt.eitech.edu.cn Xiaoyu Shen††thanks: Corresponding Author Ningbo Institute of Digital Twin Eastern Institute of Technology Ningbo, Zhejiang 315200, P.R. China xyshen@eitech.edu.cn Zilong Wang 宁波数字孪生研究院 东方理工大学 中国浙江宁波 315200 zlw@idt.eitech.edu.cn Xiaoyu Shen††注:通讯作者 宁波数字孪生研究院 东方理工大学 中国浙江宁波 315200 xyshen@eitech.edu.cn
1 Introduction1 引言
Copy-heavy tasks, characterized by large-scale processing of highly repetitive and template-based documents, pose persistent challenges in enterprise environments. From insurance claims and government forms to financial reports and identity documents, as shown in Figure 1, enterprises routinely extract structured information from millions of similar documents daily Gagie et al. (2017); Navarro (2019); Cobas and Navarro (2019). While the structural redundancy offers potential for optimization, it also exacerbates issues of computational inefficiency, error propagation, and system brittleness.高重复性任务(Copy-heavy tasks)以大规模处理高度重复和基于模板的文档为特征,在企业环境中构成了持续的挑战。如图1所示,从保险理赔单、政府表格到财务报告和身份证明文件,企业每天都要从数百万份相似文档中提取结构化信息(Gagie et al., 2017; Navarro, 2019; Cobas and Navarro, 2019)。虽然这种结构冗余为优化提供了潜力,但也加剧了计算效率低下、错误传播和系统脆弱性等问题。
Traditional extraction systems rely heavily on rule-based or template-specific configurations Majumder et al. (2020); Xu et al. (2020). These approaches often perform well under controlled conditions but degrade rapidly with minor format changes, limiting their scalability across diverse enterprise settings Gunel et al. (2022); Zhang et al. (2024). Moreover, quality assurance remains difficult without labeled benchmarks Seitl et al. (2024), and integration with downstream systems is often ad hoc and fragile Tang et al. (2021).传统的提取系统严重依赖基于规则或特定模板的配置(Majumder et al., 2020; Xu et al., 2020)。这些方法在受控条件下通常表现良好,但随着格式的微小变化,性能会迅速下降,限制了其在不同企业环境中的可扩展性(Gunel et al., 2022; Zhang et al., 2024)。此外,在没有标注基准的情况下,质量保证仍然困难(Seitl et al., 2024),且与下游系统的集成往往是临时且脆弱的(Tang et al., 2021)。
Large Language Models (LLMs) offer new possibilities for zero-shot and instruction-based document understanding. However, their practical use for structured extraction remains limited by high latency, hallucination risks Li et al. (2024), and inefficiencies in handling repetitive or low-variance content. In copy-heavy tasks, latency is especially pronounced because generative models must decode output token by token; what an OCR/post-processing stack can copy in (near) constant time becomes hundreds or thousands of sequential generations. This generation-first workflow wastes time and budget on text that could be copied verbatim and increases exposure to stochastic errors. In production pipelines that demand sub-second response times and high precision—such as identity information extraction—these limitations can lead to unacceptable failure rates Cooney et al. (2023).大语言模型(LLM)为零样本和基于指令的文档理解提供了新的可能性。然而,它们在结构化提取中的实际应用仍受到高延迟、幻觉风险(Li et al., 2024)以及处理重复或低方差内容时效率低下的限制。在高重复性任务中,延迟尤为明显,因为生成模型必须逐个标记(token)解码输出;而OCR/后处理栈可以在(近乎)恒定的时间内完成复制的内容,却变成了数百或数千次顺序生成。这种“生成优先”的工作流不仅浪费了时间和预算,还增加了随机错误的风险。在要求亚秒级响应时间和高精度的生产流水线中(例如身份信息提取),这些限制可能导致不可接受的故障率(Cooney et al., 2023)。
Identity document processing exemplifies the core challenges of copy-heavy extraction. Fields such as names, dates, and ID numbers appear in consistent formats across documents, yet achieving 100% accurate, high-throughput extraction remains elusive. Minor OCR errors or model inconsistencies can introduce systematic faults across entire datasets, highlighting the need for robust, adaptive extraction frameworks.身份文档处理是高重复性提取核心挑战的典型代表。姓名、日期和身份证号等字段在不同文档中以一致的格式出现,但要实现100%准确、高吞吐量的提取仍然难以捉摸。微小的OCR错误或模型不一致都可能在整个数据集上引入系统性故障,这突显了对稳健、自适应提取框架的需求。
In this paper, we propose a fast and adaptive multi-method extraction framework that integrates traditional OCR engines with LLM-based strategies to process copy-heavy documents efficiently. Our contributions are as follows.在本文中,我们提出了一种快速且自适应的多方法提取框架,该框架集成了传统OCR引擎与基于LLM的策略,以高效处理高重复性文档。我们的贡献如下。
-
•
A hybrid extraction framework combining multiple OCR engines with four LLM-based paradigms—Direct, Replace, Table, and Multimodal—tailored to different document structures and modalities.一种混合提取框架,结合了多个OCR引擎与四种基于LLM的范式(直接、替换、表格和多模态),以适应不同的文档结构和模态。
-
•
A diverse empirical evaluation of 25 method combinations over documents spanning multiple formats (e.g., PNG, DOCX, XLSX, PDF), uncovering strategy-specific trade-offs in speed and accuracy.针对跨多种格式(如PNG、DOCX、XLSX、PDF)的文档,对25种方法组合进行了多元实证评估,揭示了不同策略在速度和准确性方面的权衡。
-
•
A document-aware method selection strategy that achieves perfect F1 scores (1.000) with sub-second latency (0.97s average) by matching extraction methods to document characteristics.一种文档感知的方法选择策略,通过将提取方法与文档特征相匹配,实现了完美的F1分数(1.000)和亚秒级延迟(平均0.97秒)。
-
•
Practical deployment insights including guidance on OCR engine selection, integration challenges, and system-level design for scalable enterprise deployment.实用的部署见解,包括OCR引擎选择指导、集成挑战以及面向可扩展企业部署的系统级设计。
Our work bridges the gap between LLM capabilities and production demands, providing a practical pathway for deploying high-performance extraction systems across repetitive document tasks in real-world enterprise settings.我们的工作弥合了LLM能力与生产需求之间的鸿沟,为在现实企业环境中的重复性文档任务中部署高性能提取系统提供了一条切实可行的路径。
2 Related Work2 相关工作
Traditional Paradigms in Document Information Extraction. Early systems for information extraction (IE) from structured or semi-structured documents were predominantly rule-based or template-driven Appelt (1999); Chiticariu et al. (2013). These methods offered high precision and interpretability without the need for annotated training data. However, they were notoriously brittle—any minor variation in layout, field order, or formatting could break the rules, leading to maintenance-heavy pipelines that scale poorly Li et al. (2020). To reduce rule authoring overhead, early work explored template induction Anick and Flynn (1992); Freitag (2000), and more recently, TWIX Lin et al. (2025) exploits redundancy across similar documents to automate extraction. Nonetheless, the lack of robustness to visual drift and document variation remains a limitation Majumder et al. (2020); Wang et al. (2020).文档信息提取的传统范式。早期用于结构化或半结构化文档的信息提取(IE)系统主要基于规则或模板驱动(Appelt, 1999; Chiticariu et al., 2013)。这些方法无需标注训练数据即可提供高精度和可解释性。然而,它们极其脆弱——布局、字段顺序或格式的任何微小变化都可能破坏规则,导致维护成本高昂且难以扩展的流水线(Li et al., 2020)。为了减少规则编写的开销,早期研究探索了模板归纳(Anick and Flynn, 1992; Freitag, 2000),最近,TWIX(Lin et al., 2025)利用相似文档间的冗余来自动化提取。尽管如此,对视觉漂移和文档变化的稳健性不足仍然是一个限制(Majumder et al., 2020; Wang et al., 2020)。
To address annotation costs, unsupervised techniques have been explored, such as pattern mining Etzioni et al. (2005) and structural clustering Allahyari et al. (2017), which infer field patterns across documents without labels. However, these approaches often yield noisy outputs and require significant post-processing Riedel et al. (2010). Feature-based supervised models Finkel et al. (2005); Ratinov and Roth (2009) introduced stronger learning capacity, but still relied heavily on handcrafted features and domain-specific engineering, with limited generalizability to new document layouts or types Yadav and Bethard (2019).为了解决标注成本问题,人们探索了无监督技术,如模式挖掘(Etzioni et al., 2005)和结构聚类(Allahyari et al., 2017),这些方法无需标签即可推断文档间的字段模式。然而,这些方法往往产生噪声输出,并需要大量的后处理(Riedel et al., 2010)。基于特征的监督模型(Finkel et al., 2005; Ratinov and Roth, 2009)引入了更强的学习能力,但仍严重依赖手工特征和领域特定的工程,对新文档布局或类型的泛化能力有限(Yadav and Bethard, 2019)。
Neural and Pretrained Architectures for Document Understanding. The advent of deep learning introduced a major shift. Sequence models like BiLSTM-CRF Lample et al. (2016); Ma and Hovy (2016); Shen et al. (2017) enabled end-to-end learning for token classification tasks, significantly reducing manual feature design. These were soon outpaced by pre-trained language models (PLMs) Devlin et al. (2019); Liu et al. (2019); Su et al. (2022), which provided strong contextual embeddings for text-based extraction. However, most PLMs ignore document structure, which is critical in forms, invoices, and tables.文档理解的神经架构与预训练架构。深度学习的出现带来了重大转变。BiLSTM-CRF等序列模型(Lample et al., 2016; Ma and Hovy, 2016; Shen et al., 2017)实现了标记分类任务的端到端学习,显著减少了手动特征设计。随后,预训练语言模型(PLMs)(Devlin et al., 2019; Liu et al., 2019; Su et al., 2022)迅速超越了它们,为基于文本的提取提供了强大的上下文嵌入。然而,大多数PLM忽略了文档结构,而这在表单、发票和表格中至关重要。
To incorporate visual and spatial cues, layout-aware PLMs such as LayoutLM Xu et al. (2020), LayoutLMv2/v3 Huang et al. (2022), and FormNet Lee et al. (2022) combine text, layout, and visual embeddings. More sophisticated multimodal transformers like DocFormer Appalaraju et al. (2021) further improve modality fusion and downstream accuracy. These models show strong performance on visually complex tasks but typically require finetuning and careful preprocessing (e.g., OCR + bounding boxes), and remain sensitive to layout noise and OCR errors.为了整合视觉和空间线索,LayoutLM(Xu et al., 2020)、LayoutLMv2/v3(Huang et al., 2022)和FormNet(Lee et al., 2022)等布局感知PLM结合了文本、布局和视觉嵌入。更复杂的DocFormer(Appalaraju et al., 2021)等多模态Transformer进一步改善了模态融合和下游准确性。这些模型在视觉复杂任务上表现出色,但通常需要微调和仔细的预处理(例如OCR + 边界框),并且对布局噪声和OCR错误依然敏感。
LLMs and Prompt-based Extraction. Large Language Models (LLMs) have introduced powerful new paradigms for document IE, particularly in zero-shot and few-shot settings. Prompt-based models like GPT Wang et al. (2023b); Wei et al. (2023) and InstructUIE Wang et al. (2023c) frame extraction tasks as natural language instruction following. Methods such as self-prompting Li et al. (2022) and chain-of-thought reasoning Wei et al. (2022) improve consistency and reasoning over complex inputs. Architecturally, two key approaches emerge: (1) OCR-to-LLM pipelines like LMDX Perot et al. (2023) and DocLLM Wang et al. (2023a), which linearize OCR text into prompts for token-level generation, and (2) multimodal LLMs Kim et al. (2022); Tang et al. (2023) that directly process document images, bypassing OCR and jointly modeling layout and content.LLM与基于提示的提取。大语言模型(LLM)为文档IE引入了强大的新范式,特别是在零样本和少样本设置中。GPT(Wang et al., 2023b; Wei et al., 2023)和InstructUIE(Wang et al., 2023c)等基于提示的模型将提取任务框架化为自然语言指令遵循。自提示(Li et al., 2022)和思维链推理(Wei et al., 2022)等方法提高了对复杂输入的连贯性和推理能力。在架构上,出现了两种关键方法:(1) LMDX(Perot et al., 2023)和DocLLM(Wang et al., 2023a)等OCR到LLM流水线,将OCR文本线性化为用于标记级生成的提示;(2) 直接处理文档图像的多模态LLM(Kim et al., 2022; Tang et al., 2023),绕过OCR并联合建模布局和内容。
While these models are flexible and powerful, they pose several practical challenges: inference latency, high compute cost, difficulty in debugging hallucinations Li et al. (2024); Zhang et al. (2023a), and limits in handling highly repetitive or deterministic document structures Cooney et al. (2023). Furthermore, most current benchmarks (e.g., FUNSD Jaume et al. (2019), DocVQA Mathew et al. (2021)) emphasize semantic diversity and visual clutter, underrepresenting production settings dominated by redundant, high-volume forms.虽然这些模型灵活且强大,但它们面临着几个实际挑战:推理延迟、高计算成本、难以调试幻觉(Li et al., 2024; Zhang et al., 2023a),以及在处理高度重复或确定性文档结构时的局限性(Cooney et al., 2023)。此外,大多数当前的基准测试(例如FUNSD(Jaume et al., 2019)、DocVQA(Mathew et al., 2021))强调语义多样性和视觉混乱,未能充分代表以冗余、大批量表单为主的生产环境。
Copy-heavy Extraction: A Distinct and Underexplored Setting. In many industrial scenarios, document extraction is not about semantic diversity but rather structural redundancy: processing millions of near-identical layouts (e.g., utility bills, ID cards, customs forms). We refer to this as copy-heavy extraction. In these settings, speed, fault tolerance, and robustness to minor OCR/model variance outweigh the need for general reasoning or layout flexibility. Even small errors can cascade into critical downstream failures in enterprise systems.高重复性提取:一个独特且未被充分探索的领域。在许多工业场景中,文档提取关心的不是语义多样性,而是结构冗余:处理数百万份近乎相同的布局(如水电费单、身份证、海关表格)。我们将其称为“高重复性提取”。在这些设置中,速度、容错能力以及对微小OCR/模型差异的稳健性,远比通用推理或布局灵活性重要。即使是微小的错误也可能在企业系统中级联成严重的下游故障。
Existing LLM and multimodal models are often over-engineered for such tasks, leading to inefficiencies. Meanwhile, rule-based or template systems are fast but brittle. This tension between generality and efficiency is not well captured in most academic benchmarks, and the trade-offs in copy-heavy settings remain poorly studied Seitl et al. (2024). These tasks demand tailored strategies that optimize for high-throughput, low-latency, and graceful degradation in the presence of noise.现有的LLM和多模态模型对于此类任务往往过度设计,导致效率低下。同时,基于规则或模板的系统虽然快速,但很脆弱。这种通用性与效率之间的矛盾在大多数学术基准测试中并未得到很好体现,高重复性场景下的权衡也研究不足(Seitl et al., 2024)。这些任务需要量身定制的策略,以优化高吞吐量、低延迟,并在存在噪声的情况下实现平稳降级。
Scalability Challenges and Emerging Optimizations. Recent work has started addressing these issues from a systems perspective. Techniques like batch prompting Cheng et al. (2023), prefix sharing (BatchLLM Zheng et al. (2024)), and intermediate caching (PromptCache Gim et al. (2024), AttentionStore Zhang et al. (2023b)) reduce redundant computation in LLM-based pipelines, particularly when input documents are similar. Lightweight architectures such as Donut Kim et al. (2021) and UDOP Tang et al. (2023) offer OCR-free alternatives that retain structured output formats. However, these models still suffer from trade-offs in latency, model size, and control granularity—key considerations for real-world deployments. Industrial settings also require interoperability with diverse file formats (PDF, DOCX, scanned images), graceful fallback mechanisms, and integration with legacy systems.可扩展性挑战与新兴优化。近期的工作已开始从系统角度解决这些问题。批处理提示(Cheng et al., 2023)、前缀共享(BatchLLM(Zheng et al., 2024))和中间缓存(PromptCache(Gim et al., 2024)、AttentionStore(Zhang et al., 2023b))等技术减少了基于LLM流水线中的冗余计算,尤其是在输入文档相似时。Donut(Kim et al., 2021)和UDOP(Tang et al., 2023)等轻量级架构提供了无需OCR的替代方案,并保留了结构化输出格式。然而,这些模型在延迟、模型大小和控制粒度方面仍存在权衡——这是现实部署中的关键考量。工业环境还需要与多种文件格式(PDF、DOCX、扫描图像)的互操作性、平稳的后备机制以及与遗留系统的集成。
Toward Modular, Hybrid, and Document-aware Pipelines. Copy-heavy document extraction tasks—common in industrial settings like invoices, IDs, and utility forms—prioritize speed, robustness, and consistency over general reasoning. Existing solutions either rely on brittle rules or overgeneralized LLMs, leading to inefficiencies in scalability, latency, or maintainability.迈向模块化、混合和文档感知的流水线。高重复性文档提取任务(常见于发票、身份证和公用事业表格等工业环境)优先考虑速度、稳健性和一致性,而非通用推理。现有解决方案要么依赖脆弱的规则,要么依赖过度泛化的LLM,导致在可扩展性、延迟或可维护性方面效率低下。
We propose a modular and hybrid pipeline that integrates OCR fusion, lightweight heuristics (e.g., field substitution, table-position extraction), and selective LLM invocation. A centralized, document-aware controller dynamically orchestrates these components based on document format, enabling fast, accurate, and scalable extraction. Unlike prior approaches that treat components in isolation, our system emphasizes integration and operational efficiency for real-world deployment.我们提出了一种模块化和混合流水线,集成了OCR融合、轻量级启发式算法(如字段替换、表格位置提取)和选择性LLM调用。一个集中的、文档感知的控制器根据文档格式动态编排这些组件,从而实现快速、准确和可扩展的提取。与以往孤立处理组件的方法不同,我们的系统强调集成和面向现实部署的运营效率。
3 Methodology3 方法论
3.1 System Architecture3.1 系统架构
Our extraction framework comprises two primary components: text extraction and LLM-based information extraction. Figure 2 presents an overview of the complete pipeline. Initially, various tools are employed to extract textual content from heterogeneous file formats, including Markdown, Word, Excel, PDF, and images. The extracted text is then passed to a large language model (LLM) to perform task-specific information extraction.我们的提取框架包含两个主要组件:文本提取和基于LLM的信息提取。图2展示了完整流水线的概览。最初,使用各种工具从异构文件格式(包括Markdown、Word、Excel、PDF和图像)中提取文本内容。提取的文本随后被传递给大语言模型(LLM)以执行特定任务的信息提取。
To support different document structures and information needs, we implement multiple extraction strategies. Specifically, our methods fall into three categories, as shown in Figure 3: direct extraction, replacement-based extraction, and table-based extraction, which will be described in detail later. Additionally, we incorporate a multimodal model to directly extract information from images, serving as a baseline for comparison with text-based pipelines.为了支持不同的文档结构和信息需求,我们实现了多种提取策略。具体而言,我们的方法分为三类,如图3所示:直接提取、基于替换的提取和基于表格的提取,稍后将详细描述。此外,我们还结合了一个多模态模型来直接从图像中提取信息,作为与基于文本的流水线进行比较的基准。
3.2 Text Extraction Tools3.2 文本提取工具
The quality of information extraction heavily depends on the accuracy and completeness of upstream text extraction. To support diverse input formats, we integrate a suite of specialized extraction tools, each selected based on its ability to handle specific file types and structural characteristics.信息提取的质量在很大程度上取决于上游文本提取的准确性和完整性。为了支持多样的输入格式,我们集成了一套专门的提取工具,每种工具的选择都基于其处理特定文件类型和结构特征的能力。
MarkItDown serves as a general-purpose parser for structured text formats, supporting Markdown, Word, Excel, and standard PDF documents. It preserves key structural features such as headings, tables, and semantic markers, enabling clean and semantically meaningful text extraction across multiple formats.MarkItDown作为一种通用的结构化文本格式解析器,支持Markdown、Word、Excel和标准PDF文档。它保留了标题、表格和语义标记等关键结构特征,能够在多种格式中实现清晰且具有语义意义的文本提取。
Docling is applied to both Word and PDF files, offering enhanced layout analysis and document hierarchy preservation. It is particularly effective in maintaining reading order and spatial layout, which are essential for downstream structure-aware tasks.Docling应用于Word和PDF文件,提供增强的布局分析和文档层次结构保留。它在保持阅读顺序和空间布局方面特别有效,这对于下游结构感知任务至关重要。
MinerU complements Docling by targeting complex PDF layouts, including multi-column formatting, dense tables, and embedded formulas. It provides fine-grained spatial structure recovery and is optimized for documents where layout fidelity is critical.MinerU通过针对复杂PDF布局(包括多栏格式、密集表格和嵌入式公式)来补充Docling。它提供细粒度的空间结构恢复,并针对布局保真度至关重要的文档进行了优化。
PaddleOCR and EasyOCR are employed for image-based documents. PaddleOCR is used as the primary engine due to its high accuracy in multilingual printed text, while EasyOCR acts as a fallback for cases involving handwritten content or degraded image quality.PaddleOCR和EasyOCR用于基于图像的文档。PaddleOCR因其在多语言印刷文本方面的高准确性而被用作主要引擎,而EasyOCR则作为涉及手写内容或图像质量下降情况下的后备方案。
The use of multiple tools for overlapping file types is intentional. Our goal is to systematically evaluate different extraction solutions on the same document type in order to identify the most effective extraction strategy. Evaluation focuses on two key dimensions: (1) the accuracy of extracted textual content, and (2) the fidelity of spatial and structural information preservation, which is crucial for position-aware downstream tasks such as table extraction or form understanding.为了重叠的文件类型使用多种工具是有意为之的。我们的目标是在同一文档类型上系统地评估不同的提取解决方案,以确定最有效的提取策略。评估侧重于两个关键维度:(1) 提取文本内容的准确性,以及 (2) 空间和结构信息保留的保真度,这对于表格提取或表单理解等位置感知下游任务至关重要。
3.3 Target Information Extraction Methods3.3 目标信息提取方法
Once the raw text is extracted, we apply LLM-based methods to retrieve the target information. To accommodate different document layouts and content patterns, we design three complementary extraction strategies, each tailored to specific structural characteristics.一旦提取出原始文本,我们就会应用基于LLM的方法来检索目标信息。为了适应不同的文档布局和内容模式,我们设计了三种互补的提取策略,每种策略都针对特定的结构特征进行了量身定制。
Direct extraction. This method applies LLMs or VLMs to perform end-to-end information extraction. In the text-based variant, raw text obtained from upstream extraction tools is passed to an LLM along with task-specific prompts. The vision-based variant bypasses OCR and directly uses document images as input to multimodal models, enabling better spatial understanding at the cost of higher inference overhead.直接提取。此方法应用LLM或VLM执行端到端的信息提取。在基于文本的变体中,从上游提取工具获得的原始文本与特定任务的提示一起传递给LLM。基于视觉的变体则绕过OCR,直接将文档图像作为输入提供给多模态模型,以更高的推理开销为代价实现了更好的空间理解。
Replace extraction. To address the challenges of repetitive pattern documents, we adopt a two-step approach. First, structured elements, such as identifiers, are replaced with unique placeholders. The LLM is then prompted to retrieve associated fields based on these placeholders. This design improves consistency, reduces ambiguity, and allows efficient batch processing through prompt reuse.替换提取。为了应对重复模式文档的挑战,我们采用了两步法。首先,将标识符等结构化元素替换为唯一占位符。然后,提示LLM根据这些占位符检索相关字段。这种设计提高了一致性,减少了歧义,并允许通过提示复用进行高效的批处理。
Table extraction. For documents with tabular layouts, we combine LLM-based structure recognition with deterministic parsing. The LLM identifies table regions and target cell coordinates, while a rule-based parser extracts the content. This approach minimizes hallucination and reduces generation cost by limiting model output to positional metadata.表格提取。对于具有表格布局的文档,我们将基于LLM的结构识别与确定性解析相结合。LLM识别表格区域和目标单元格坐标,而基于规则的解析器提取内容。这种方法通过将模型输出限制为位置元数据,最大限度地减少了幻觉并降低了生成成本。
To determine the optimal strategy for different document types, we systematically compare the performance of these methods when paired with various text extraction tools. This enables us to identify the most effective combination in terms of both content accuracy and time consumption, ensuring adaptability and robustness in real-world document scenarios.为了确定不同文档类型的最佳策略,我们系统地比较了这些方法与各种文本提取工具配对时的性能。这使我们能够识别在内容准确性和时间消耗方面最有效的组合,从而确保现实文档场景中的适应性和稳健性。
3.4 Model Selection3.4 模型选择
We adopt Qwen2.5-7B for text-based extraction and Qwen2.5-VL-7B for vision-language tasks, based on their strong balance between performance and efficiency. The 7B scale offers competitive extraction accuracy with significantly lower inference cost compared to larger models, enabling practical deployment on a single GPU.我们采用Qwen2.5-7B进行基于文本的提取,采用Qwen2.5-VL-7B进行视觉语言任务,这是基于它们在性能和效率之间取得的良好平衡。7B规模提供了具有竞争力的提取准确性,且推理成本远低于大型模型,从而能够在单块GPU上进行实际部署。
Qwen2.5 models also provide robust multilingual support—particularly for Chinese, Japanese, and Korean—and share a unified architecture across text and vision variants, simplifying prompt design and enabling consistent evaluation across modalities. Their strong instruction-following ability ensures reliable structured outputs (e.g., JSON, placeholders), reducing post-processing overhead. These capabilities make them well-suited for our production-oriented information extraction pipeline.Qwen2.5模型还提供了强大的多语言支持——特别是针对中文、日文和韩文——并在文本和视觉变体之间共享统一的架构,简化了提示设计并实现了跨模态的一致评估。它们强大的指令遵循能力确保了可靠的结构化输出(例如JSON、占位符),减少了后处理开销。这些能力使它们非常适合我们面向生产的信息提取流水线。
4 Experiments4 实验
4.1 Dataset4.1 数据集
To evaluate our multi-method extraction framework, we construct a large-scale synthetic dataset of Chinese identity documents using GPT-4. The dataset simulates real-world diversity in format and content while preserving perfect ground truth.为了评估我们的多方法提取框架,我们使用GPT-4构建了一个大规模的中文身份证明文档合成数据集。该数据集模拟了现实世界中格式和内容的多样性,同时保留了完美的真实标签(Ground Truth)。
Data Generation Pipeline. We generate 10–30 identity entries per document using the Faker library (zh_CN locale), producing realistic Chinese names and 18-digit ID numbers. These entries are embedded into semantically plausible documents (e.g., insurance forms, travel records, registration sheets) via GPT-4 prompts. Each document contains contextual information such as dates, headers, and auxiliary fields.数据生成流水线。我们使用Faker库(zh_CN区域设置)为每份文档生成10–30个身份条目,产生逼真的中文姓名和18位身份证号。这些条目通过GPT-4提示嵌入到语义合理的文档(如保险单、旅行记录、登记表)中。每份文档都包含日期、标题和辅助字段等上下文信息。
Document Formats. To evaluate cross-modality robustness, each generated Markdown document is converted into four formats:文档格式。为了评估跨模态稳健性,每份生成的Markdown文档都被转换为四种格式:
-
•
PNG (100): Rendered HTML to image (via imgkit), simulating scanned documentsPNG (100):通过imgkit将HTML渲染为图像,模拟扫描文档
-
•
DOCX (100): Word documents with tables and formatted sectionsDOCX (100):带有表格和格式化部分的Word文档
-
•
PDF (100): Generated using WeasyPrint, preserving layout and structurePDF (100):使用WeasyPrint生成,保留布局和结构
-
•
XLSX (100): Spreadsheets with tabular identity dataXLSX (100):带有表格化身份数据的电子表格
The final dataset comprises 400 documents with over 10,000 name-ID pairs.最终数据集包含400份文档,包含超过10,000对姓名-ID组合。
4.2 Evaluation Metrics4.2 评估指标
We evaluate extraction performance at the (name, ID number) pair level.我们在(姓名,身份证号)对级别评估提取性能。
Accuracy Metrics.准确性指标。
-
•
Precision: Ratio of correctly extracted pairs to all extracted pairs 精确率(Precision):正确提取的对数与所有提取的对数之比。
-
•
Recall: Ratio of correctly extracted pairs to total ground truth pairs召回率(Recall):正确提取的对数与真实标签总对数之比。
-
•
F1 Score: Harmonic mean of precision and recallF1分数:精确率和召回率的调和平均值。
Efficiency Metrics.效率指标。
-
•
Text Extraction Time: Time for text extraction using each tool (MarkItDown, PaddleOCR, EasyOCR, etc.)文本提取时间:使用每种工具(MarkItDown、PaddleOCR、EasyOCR等)进行文本提取的时间。
-
•
LLM Time: Inference time for the extraction model (excluding text extraction)LLM时间:提取模型的推理时间(不包括文本提取)。
-
•
Total Time: End-to-end latency from input to structured output总时间:从输入到结构化输出的端到端延迟。
Robustness Metrics.稳健性指标。
-
•
Success Rate: Percentage of documents processed without fatal errors成功率:无致命错误处理的文档百分比。
-
•
Per-Format Accuracy: Extraction metrics broken down by document type (PNG, DOCX, etc.)分格式准确率:按文档类型(PNG、DOCX等)细分的提取指标。
4.3 Results4.3 结果
We evaluate our multi-method extraction framework on a corpus of 400 synthetic Chinese identity documents spanning four formats (PNG, DOCX, XLSX, PDF), utilizing three extraction paradigms across 16 OCR-LLM configurations. Our findings underscore substantial variation in performance across both extraction strategies and document formats, with method efficacy closely aligned with the structural characteristics of each format.我们在包含四种格式(PNG、DOCX、XLSX、PDF)的400份合成中文身份文档语料库上评估了我们的多方法提取框架,利用了16种OCR-LLM配置下的三种提取范式。我们的研究结果强调了不同提取策略和文档格式之间的性能差异巨大,且方法的有效性与每种格式的结构特征密切相关。
Experimental Overview. The evaluation encompasses 16 extraction methods categorized into three distinct paradigms: (1) Direct extraction, which leverages document parsers or multimodal models; (2) Replace-based extraction, which employs rule-based template matching; and (3) Table-based extraction, which exploits spatial structure for field localization. Each method was evaluated on up to 100 documents per supported format, resulting in 2,500 test instances. We report precision, recall, F1 score, and processing latency, further decomposed into OCR and LLM inference time.实验概览。评估涵盖了分为三个不同范式的16种提取方法:(1) 直接提取,利用文档解析器或多模态模型;(2) 基于替换的提取,采用基于规则的模板匹配;(3) 基于表格的提取,利用空间结构进行字段定位。每种方法都在每种支持格式的最多100份文档上进行了评估,产生了2,500个测试实例。我们报告了精确率、召回率、F1分数和处理延迟,并进一步分解为OCR和LLM推理时间。
Table 1 summarizes the performance of the best and worst-performing methods for each document type. For structured formats (DOCX/XLSX), table-based methods achieve perfect scores (1.0), with docling_table and markitdown_table delivering 100% success rates while maintaining minimal latency (0.3–0.5s). In stark contrast, replace-based methods perform poorly on these formats, with markitdown_replace achieving only =0.969 for both DOCX and XLSX, representing the worst performance with perfect rates dropping to 59% and 54% respectively. For image-based formats (PNG), the multimodal approach outperforms all OCR-based methods with an score of 0.999, while easyocr_table catastrophically fails with =0.000 and 0% success rate despite minimal processing time (1.5s). PDF extraction exhibits the most extreme performance variance: docling_table maintains perfect accuracy (=1.0) with low latency (1.6s), whereas mineru_replace completely fails (=0.000, 0% success rate), highlighting severe method-format incompatibilities. Direct extraction methods consistently incur high LLM inference latency (13.4–13.6s), accounting for over 90% of total processing time, while table-based approaches achieve 40–50 speedup through minimal LLM usage.表1总结了每种文档类型表现最好和最差的方法的性能。对于结构化格式(DOCX/XLSX),基于表格的方法实现了完美的F1分数(1.0),其中docling_table和markitdown_table实现了100%的成功率,同时保持了极低的延迟(0.3–0.5秒)。相比之下,基于替换的方法在这些格式上表现不佳,markitdown_replace在DOCX和XLSX上仅达到F1=0.969,表现最差,完美率分别降至59%和54%。对于基于图像的格式(PNG),多模态方法以F1=0.999的得分优于所有基于OCR的方法,而easyocr_table尽管处理时间极短(1.5秒),却以F1=0.000和0%的成功率彻底失败。PDF提取表现出最极端的性能差异:docling_table保持了完美的准确性(F1=1.0)且延迟较低(1.6秒),而mineru_replace则完全失败(F1=0.000,成功率为0%),突显了严重的方法-格式不兼容性。直接提取方法始终会导致较高的LLM推理延迟(13.4–13.6秒),占总处理时间的90%以上,而基于表格的方法通过最少的LLM使用实现了40–50倍的加速。
| Format | Method | Prec. | Rec. | F1 | Succ. | Perf. | OCR | LLM | Total |
|---|---|---|---|---|---|---|---|---|---|
| Rate | Rate | (s) | (s) | (s) | |||||
| PNG | multimodal | .999 | .999 | .999 | 100% | 97% | — | — | 33.9 |
| paddleocr_table | .998 | .997 | .997 | 100% | 93% | 0.3 | 0.3 | 0.6 | |
| paddleocr_direct | .998 | .996 | .997 | 100% | 92% | 0.4 | 13.4 | 13.8 | |
| easyocr_table | .000 | .000 | .000 | 0% | 0% | 1.2 | 0.3 | 1.5 | |
| DOCX | docling_table | 1.00 | 1.00 | 1.00 | 100% | 100% | 0.1 | 0.3 | 0.3 |
| markitdown_table | 1.00 | 1.00 | 1.00 | 100% | 100% | 0.2 | 0.3 | 0.5 | |
| docling_direct | 1.00 | 1.00 | 1.00 | 100% | 99% | 0.1 | 13.6 | 13.7 | |
| markitdown_direct | 1.00 | .999 | 1.00 | 100% | 98% | 0.2 | 13.6 | 13.8 | |
| markitdown_replace | .969 | .969 | .969 | 100% | 59% | 0.2 | 0.5 | 0.7 | |
| XLSX | markitdown_table | 1.00 | 1.00 | 1.00 | 100% | 100% | 0.0 | 0.3 | 0.3 |
| markitdown_direct | 1.00 | 1.00 | 1.00 | 100% | 99% | 0.0 | 13.5 | 13.5 | |
| markitdown_replace | .969 | .969 | .969 | 100% | 54% | 0.0 | 0.5 | 0.5 | |
| docling_table | 1.00 | 1.00 | 1.00 | 100% | 100% | 1.3 | 0.3 | 1.6 | |
| docling_direct | 1.00 | 1.00 | 1.00 | 100% | 99% | 1.3 | 13.5 | 14.9 | |
| mineru_direct | 1.00 | 1.00 | 1.00 | 100% | 99% | 1.6 | 13.4 | 15.0 | |
| mineru_replace | .000 | .000 | .000 | 0% | 0% | 1.5 | 0.0 | 1.5 |
Figure 4 provides a holistic view of performance across all 16 methods and formats via dual heatmaps. The score heatmap reveals distinct performance patterns: table-based methods exhibit binary characteristics—either achieving near-perfect extraction () or complete failure (), indicating strong format dependency. Direct extraction methods demonstrate more consistent but suboptimal performance across formats (–), while replace-based methods show the highest variability, ranging from moderate success to total failure. The processing time heatmap complements these findings, showing that methods with perfect scores often achieve the fastest processing times (0.3–1.6s for table-based approaches), while direct methods consistently require 13–15s due to LLM overhead. The multimodal method presents an outlier with 33.9s processing time for PNG files, trading computational efficiency for extraction accuracy. Empty cells in both heatmaps denote unsupported format-method combinations, particularly evident for specialized parsers like mineru (PDF-only) and OCR-based methods (image formats only). The visualization conclusively demonstrates that no single method achieves universal optimality across all formats, necessitating format-specific extraction strategies for optimal performance.图4通过双热力图提供了所有16种方法和格式的整体性能概览。F1分数热力图揭示了明显的性能模式:基于表格的方法表现出二元特征——要么实现近乎完美的提取(F1≈1.0),要么完全失败(F1=0.0),表明了强烈的格式依赖性。直接提取方法在各种格式上表现出更一致但非最优的性能(F1≈0.77–0.99),而基于替换的方法表现出最高的变异性,从适度成功到完全失败不等。处理时间热力图补充了这些发现,显示出具有完美F1分数的方法往往实现最快的处理时间(基于表格的方法为0.3–1.6秒),而由于LLM开销,直接方法始终需要13–15秒。多模态方法是一个异常值,PNG文件的处理时间为33.9秒,以计算效率换取了提取准确性。热力图中的空白单元格表示不支持的格式-方法组合,这在像mineru(仅限PDF)和基于OCR的方法(仅限图像格式)这样的专用解析器中尤为明显。该可视化结论性地证明,没有任何单一方法能在所有格式上实现通用最优,因此需要针对特定格式的提取策略以获得最佳性能。
Image-based Documents (PNG). For scanned documents with identity cards, we observe stark contrasts between multimodal and OCR-based pipelines, as illustrated in Figure 5. The multimodal vision-language model demonstrates exceptional accuracy () through direct visual feature processing, effectively bypassing the cascading errors inherent in sequential OCR pipelines. However, this end-to-end approach incurs prohibitive computational costs, requiring seconds per document due to high-dimensional visual encoding and transformer-based attention mechanisms. Among OCR-based methods, we observe significant performance variations based on both the OCR engine and extraction strategy. PaddleOCR consistently outperforms EasyOCR across all extraction paradigms, achieving scores of 0.997, 0.961, and 0.997 for direct, replacement, and table-based extraction respectively, while EasyOCR exhibits substantially degraded performance (, , and ). This performance disparity stems fundamentally from EasyOCR’s inability to preserve document spatial structure during text extraction, which disrupts the positional relationships critical for accurate field identification in structured documents like identity cards.基于图像的文档(PNG)。对于带有身份证的扫描文档,我们观察到多模态流水线与基于OCR的流水线之间的强烈对比,如图5所示。多模态视觉语言模型通过直接处理视觉特征,展示了卓越的准确性(F1=0.999±0.007),有效地绕过了顺序OCR流水线中固有的级联错误。然而,这种端到端方法产生了昂贵的计算成本,由于高维视觉编码和基于Transformer的注意力机制,每份文档需要33.91±9.49秒。在基于OCR的方法中,我们观察到基于OCR引擎和提取策略的显著性能差异。PaddleOCR在所有提取范式中始终优于EasyOCR,直接、替换和基于表格的提取的F1分数分别为0.997、0.961和0.997,而EasyOCR表现出显著下降(F1分别为0.760、0.688和0.000)。这种性能差异从根本上源于EasyOCR在文本提取过程中无法保留文档空间结构,这破坏了在身份证等结构化文档中进行准确字段识别至关重要的位置关系。
The spatial information loss particularly impacts table-based extraction, where EasyOCR completely fails () as the LLM cannot generate valid coordinates without reliable spatial encoding. In contrast, PaddleOCR maintains precise spatial mappings, enabling the table-based extraction strategy to achieve optimal performance at seconds—a speedup over the multimodal baseline—while preserving near-perfect accuracy (). This method minimizes LLM inference to coordinate generation only, leveraging the preserved document structure to reduce computational overhead from 34 seconds to sub-second latency. The replacement method with PaddleOCR, employing regex patterns for standardized fields and batch processing for names, offers a middle ground at seconds (), while direct extraction requires seconds despite high accuracy () due to processing entire OCR outputs. The PaddleOCR table-based approach thus emerges as the optimal solution for production deployment, combining superior spatial preservation with minimal LLM computation. The marginal 0.2% accuracy trade-off compared to multimodal methods represents an acceptable compromise given the 54-fold efficiency gain crucial for large-scale document processing systems.空间信息丢失对基于表格的提取影响尤为严重,EasyOCR完全失败(F1=0.000),因为没有可靠的空间编码,LLM无法生成有效的坐标。相比之下,PaddleOCR保持了精确的空间映射,使基于表格的提取策略能够在0.63±0.24秒内实现最优性能——比多模态基准快54倍——同时保持近乎完美的准确性(F1=0.997±0.011)。该方法将LLM推理最小化为仅生成坐标,利用保留的文档结构将计算开销从约34秒降低到亚秒级延迟。结合PaddleOCR的替换方法,利用正则表达式处理标准化字段,并对姓名进行批处理,在0.72±0.28秒内提供了中间方案(F1=0.961±0.044),而直接提取尽管准确率很高(F1=0.997±0.010),但由于处理整个OCR输出,仍需要13.75±3.87秒。因此,基于PaddleOCR的表格方法成为生产部署的最佳解决方案,结合了卓越的空间保留与最小的LLM计算。与多模态方法相比,0.2%的准确率权衡在54倍的效率增益面前是可以接受的折衷,这对大规模文档处理系统至关重要。
Structured Office Documents (DOCX/XLSX). Our evaluation of structured office document extraction reveals fundamentally different performance characteristics compared to image-based formats, as illustrated in Figure 6. Native documents exhibit near-perfect accuracy across all extraction methodologies due to their inherent machine-readable structure and preserved spatial information. For DOCX files, both MarkItDown and Docling frameworks successfully extract the document’s spatial structure, enabling high-fidelity extraction across all paradigms. Docling’s table-based approach achieves optimal performance with perfect accuracy () and exceptional efficiency at seconds—a speedup compared to direct extraction ( seconds)—by leveraging structured table representations that minimize LLM processing to coordinate generation only. MarkItDown’s table method follows closely with identical accuracy () at seconds, representing a improvement over its direct counterpart.结构化办公文档(DOCX/XLSX)。我们对结构化办公文档提取的评估揭示了与基于图像的格式完全不同的性能特征,如图6所示。原生文档由于其固有的机器可读结构和保留的空间信息,在所有提取方法中表现出近乎完美的准确性。对于DOCX文件,MarkItDown和Docling框架都成功提取了文档的空间结构,实现了所有范式下的高保真提取。Docling的基于表格的方法实现了最优性能,准确率完美(F1=1.000),效率极高,为0.34±0.03秒——比直接提取(13.68±3.85秒)快41倍——通过利用结构化表格表示,将LLM处理最小化为仅生成坐标。MarkItDown的表格方法紧随其后,准确率相同(F1=1.000),时间为0.54±0.13秒,比其直接对应方法提高了26倍。
While replacement strategies offer competitive latency (Docling: s, MarkItDown: s), they sacrifice accuracy ( and respectively) due to the LLM’s occasional misidentification when matching ID numbers to corresponding names—a limitation stemming from the model’s reliance on contextual inference rather than explicit structural cues. This name-matching error could be mitigated through prompt engineering to provide more explicit matching instructions or fine-tuning the general-purpose LLM on document-specific extraction tasks. For XLSX spreadsheets, where only MarkItDown provides support, the inherent tabular structure amplifies these efficiency gains: table-based extraction achieves perfect accuracy () with remarkable seconds processing time—a acceleration over direct methods ( seconds). This dramatic improvement stems from the natural alignment between spreadsheet cell structures and table-based extraction paradigms, eliminating the need for complex content interpretation. The replacement method maintains reasonable efficiency (s) but exhibits similar accuracy degradation () as observed in DOCX processing, with errors predominantly occurring in name-ID association tasks. These results establish table-based extraction as the unequivocally superior approach for native office documents, where the preserved document structure enables both perfect accuracy and minimal computational overhead, making it ideal for enterprise-scale document processing pipelines requiring both precision and throughput.虽然替换策略提供了具有竞争力的延迟(Docling:0.59±0.13秒,MarkItDown:0.74±0.18秒),但它们牺牲了准确性(F1分别为0.972±0.038和0.969±0.044),原因是LLM在将身份证号与相应姓名匹配时偶尔会出现识别错误——这一局限性源于模型对上下文推理的依赖,而非显式的结构线索。这种姓名匹配错误可以通过提示工程来提供更明确的匹配指令,或在特定文档提取任务上微调通用LLM来缓解。对于仅有MarkItDown支持的XLSX电子表格,固有的表格结构放大了这些效率增益:基于表格的提取实现了完美的准确性(F1=1.000),处理时间仅为0.30±0.02秒——比直接方法(13.53±3.82秒)加速44倍。这种显著的改进源于电子表格单元格结构与基于表格的提取范式之间的自然对齐,消除了对复杂内容解释的需求。替换方法保持了合理的效率(0.51±0.11秒),但在DOCX处理中观察到了类似的准确性下降(F1=0.969±0.039),错误主要发生在姓名-ID关联任务中。这些结果确立了基于表格的提取是原生办公文档的绝对最优方法,其中保留的文档结构实现了完美的准确性和最小的计算开销,使其成为需要精度和吞吐量的企业级文档处理流水线的理想选择。
Portable Document Format (PDF). Our empirical analysis of PDF document processing reveals a fundamental trade-off between computational efficiency and extraction accuracy across different methodological approaches. MarkItDown prioritizes processing speed, achieving minimal OCR preprocessing overhead (0.056s), while Docling and MinerU adopt more computationally intensive strategies with OCR latencies of approximately 1.3–1.5s. However, this efficiency-accuracy trade-off manifests differently across extraction paradigms. MarkItDown’s lightweight approach, which employs symbolic markers for spatial structure representation, exhibits severely degraded performance across all extraction strategies: direct extraction (), replacement extraction (), and table-based extraction ().便携式文档格式(PDF)。我们对PDF文档处理的实证分析揭示了不同方法论在计算效率和提取准确性之间的根本权衡。MarkItDown优先考虑处理速度,实现了最小的OCR预处理开销(0.056秒),而Docling和MinerU采用了计算密集型策略,OCR延迟约为1.3–1.5秒。然而,这种效率-准确性权衡在不同的提取范式中表现不同。MarkItDown的轻量级方法使用符号标记来表示空间结构,在所有提取策略中表现出严重下降:直接提取(F1=0.772)、替换提取(F1=0.570)和表格提取(F1=0.070)。
The divergence in extraction efficacy between Docling and MinerU, despite their comparable preprocessing costs, underscores the critical importance of spatial representation strategies in document understanding. Docling maintains near-perfect accuracy across all extraction paradigms, with its table-based approach achieving optimal performance (). In stark contrast, MinerU’s reliance on HTML-style structural tags (e.g., <td>, <tr>) for encoding spatial relationships proves incompatible with text-based information extraction, resulting in catastrophic failure for replacement and table-based methods (). The framework only maintains competitive performance in direct extraction mode (), where spatial structure parsing is bypassed entirely. These empirical findings, illustrated in Figure 7, establish Docling’s table-based methodology as the optimal solution for PDF information extraction, successfully reconciling the competing demands of computational efficiency (1.61s total processing time) and extraction fidelity.尽管预处理成本相当,但Docling和MinerU在提取效能上的差异突显了空间表示策略在文档理解中的关键重要性。Docling在所有提取范式中保持了近乎完美的准确性,其表格方法实现了最优性能(F1=1.0)。相比之下,MinerU依赖HTML风格的结构标签(如<td>、<tr>)来编码空间关系,被证明与基于文本的信息提取不兼容,导致替换和表格方法的灾难性失败(F1=0.0)。该框架仅在直接提取模式下保持了竞争性性能(F1=0.9996),该模式完全绕过了空间结构解析。这些如图7所示的实证结果确立了Docling的基于表格的方法论是PDF信息提取的最优解决方案,成功调和了计算效率(1.61秒总处理时间)和提取保真度之间的竞争需求。
4.4 Discussion4.4 讨论
Our comprehensive evaluation reveals a fundamental insight: the optimal extraction strategy for copy-heavy documents is intrinsically tied to document modality and structure, challenging the prevailing one-size-fits-all approaches in production systems. The 54× performance differential between table-based methods (0.97s) and multimodal approaches (33.91s) underscores a critical trade-off—while end-to-end models offer superior robustness through direct visual understanding, their computational overhead remains prohibitive for high-throughput scenarios characteristic of copy-heavy tasks. This finding suggests that the field’s pursuit of universal extraction models may be misguided for repetitive document processing, where structural priors can be effectively exploited.我们的全面评估揭示了一个根本性洞察:针对大量重复性文档(copy-heavy documents)的最佳提取策略,本质上取决于文档的模态和结构,这挑战了生产系统中普遍存在的“一刀切”方法。基于表格的方法(0.97秒)与多模态方法(33.91秒)之间54倍的性能差异,凸显了一个关键的权衡——尽管端到端模型通过直接的视觉理解提供了卓越的鲁棒性,但其计算开销对于处理大量重复性文档任务所需的高吞吐量场景而言仍然过高。这一发现表明,在该领域追求通用提取模型,对于可以有效利用结构先验的重复性文档处理任务来说,可能方向有误。
The stark performance dichotomy between OCR engines (PaddleOCR F1=0.997 vs. EasyOCR F1=0.000 for table extraction) reveals that spatial structure preservation, rather than character recognition accuracy alone, determines extraction success. This challenges conventional OCR evaluation metrics and highlights the need for structure-aware benchmarks. Moreover, the consistent superiority of table-based methods across native formats (100% accuracy at <1s) demonstrates that explicit structural modeling outperforms both semantic understanding (direct extraction) and pattern matching (replacement extraction) when document layouts are predictable—a defining characteristic of copy-heavy scenarios.OCR引擎之间巨大的性能鸿沟(在表格提取任务中,PaddleOCR F1=0.997,而EasyOCR F1=0.000)表明,决定提取成功与否的关键在于对空间结构的保留,而非仅仅取决于字符识别的准确率。这挑战了传统的OCR评估指标,并突显了对结构感知基准测试的需求。此外,基于表格的方法在原生格式上始终保持卓越表现(<1秒内实现100%准确率),证明了在文档布局可预测的情况下(这是大量重复性文档场景的典型特征),显式的结构建模优于语义理解(直接提取)和模式匹配(替换提取)。
From a production standpoint, our results advocate for adaptive, format-aware architectures over monolithic solutions. The multimodal approach’s resilience to OCR failures positions it as an ideal fallback mechanism, while table-based extraction serves as the workhorse for structured documents. This hierarchical strategy—rapid format detection followed by method-specific routing—enables systems to process heterogeneous document streams at scale without sacrificing accuracy. The framework thus provides a blueprint for reconciling the competing demands of accuracy, efficiency, and robustness in real-world document processing pipelines.从生产角度来看,我们的研究结果主张采用自适应、感知格式的架构,而非单一的整体式解决方案。多模态方法对OCR故障的抵御能力使其成为理想的备选机制,而基于表格的提取则是处理结构化文档的主力。这种分层策略——先进行快速格式检测,再进行针对性的方法路由——使系统能够在大规模处理异构文档流的同时,无需牺牲准确性。因此,该框架为在实际文档处理流水线中协调准确性、效率和鲁棒性之间的竞争需求提供了一份蓝图。
5 Conclusion5 结论
We present a systematic framework for information extraction from copy-heavy documents, demonstrating that the repetitive nature of such tasks—rather than being a mere computational burden—can be strategically exploited through intelligent method selection. Our comprehensive evaluation of 25 method combinations across diverse documents reveals that optimal extraction strategies must align with document characteristics: table-based methods for structured formats (achieving perfect accuracy at sub-second latency), multimodal approaches for degraded images (F1=0.999), and adaptive routing for heterogeneous streams.我们提出了一个针对大量重复性文档进行信息提取的系统性框架,证明了此类任务的重复性并非单纯的计算负担,而是可以通过智能的方法选择加以策略性利用。我们对25种方法组合在各类文档上的全面评估表明,最佳提取策略必须与文档特性相匹配:针对结构化格式使用基于表格的方法(在亚秒级延迟下实现完美准确率),针对退化图像使用多模态方法(F1=0.999),并针对异构数据流采用自适应路由。
The core contribution lies not in proposing novel extraction techniques, but in establishing a principled approach to method selection for copy-heavy scenarios. By recognizing that document structure dictates optimal extraction paradigms, we achieve a 54× speedup while maintaining accuracy—a critical requirement for enterprise-scale deployment. This work challenges the field’s emphasis on universal models, showing that domain-specific solutions remain indispensable when processing millions of similar documents daily.本研究的核心贡献不在于提出全新的提取技术,而在于为大量重复性文档场景建立了一套原则性的方法选择方案。通过认识到文档结构决定了最佳提取范式,我们在保持准确性的前提下实现了54倍的速度提升——这对企业级部署而言是一项关键需求。这项工作挑战了该领域对通用模型的过度强调,表明在每天处理数百万份相似文档时,特定领域的解决方案仍然不可或缺。
For practitioners, our framework offers immediate value: implement table-based extraction as the default for structured documents, maintain multimodal models as robust fallbacks, and use format detection for intelligent routing. For researchers, we highlight unexplored opportunities in hybrid architectures that combine the efficiency of structural methods with the robustness of end-to-end models. As document processing increasingly underpins digital transformation, our work provides both theoretical insights and practical tools for building extraction systems that scale without compromising quality.对于从业者而言,我们的框架提供了直接的价值:将基于表格的提取作为结构化文档的默认方案,保留多模态模型作为鲁棒的备选方案,并利用格式检测进行智能路由。对于研究人员,我们指出了混合架构中尚未探索的机遇,即结合结构化方法的高效性与端到端模型的鲁棒性。随着文档处理日益成为数字化转型的基石,我们的工作为构建既能扩展又不失质量的提取系统提供了理论见解和实用工具。
References参考文献
- Allahyari et al. (2017) Mehdi Allahyari, Seyedamin Pouriyeh, Mehdi Assefi, Saied Safaei, Elizabeth D Trippe, Juan B Gutierrez, and Krys Kochut. 2017. A brief survey of text mining: Classification, clustering and extraction techniques. arXiv preprint arXiv:1707.02919. Allahyari 等人 (2017)↑ Mehdi Allahyari, Seyedamin Pouriyeh, Mehdi Assefi, Saied Safaei, Elizabeth D Trippe, Juan B Gutierrez, 和 Krys Kochut. 2017. 文本挖掘简述:分类、聚类与提取技术。 arXiv 预印本 arXiv:1707.02919.
- Anick and Flynn (1992) Peter G Anick and Rex A Flynn. 1992. Versioning a full-text information retrieval system. In Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, pages 98–111. Anick 和 Flynn (1992)↑ Peter G Anick 和 Rex A Flynn. 1992. 全文信息检索系统的版本控制。 收录于第15届ACM SIGIR信息检索研究与开发年度国际会议论文集,第98–111页。
- Appalaraju et al. (2021) Srikar Appalaraju, Bhavan Jasani, Bhargava Urala Kota, Yusheng Xie, and R. Manmatha. 2021. Docformer: End-to-end transformer for document understanding. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 993–1003. Appalaraju 等人 (2021)↑ Srikar Appalaraju, Bhavan Jasani, Bhargava Urala Kota, Yusheng Xie, 和 R. Manmatha. 2021. Docformer:用于文档理解的端到端 Transformer。 收录于IEEE/CVF国际计算机视觉大会 (ICCV) 论文集,第993–1003页。
- Appelt (1999) Douglas E Appelt. 1999. Introduction to information extraction. Ai Communications, 12(3):161–172. Appelt (1999)↑ Douglas E Appelt. 1999. 信息提取导论。 《人工智能通讯》(Ai Communications), 12(3):161–172.
- Cheng et al. (2023) Zhoujun Cheng, Jungo Kasai, and Tao Yu. 2023. Batch prompting: Efficient inference with large language model apis. arXiv preprint arXiv:2301.08721. Cheng 等人 (2023)↑ Zhoujun Cheng, Jungo Kasai, 和 Tao Yu. 2023. 批量提示:利用大语言模型API进行高效推理。 arXiv 预印本 arXiv:2301.08721.
- Chiticariu et al. (2013) Laura Chiticariu, Yunyao Li, and Frederick Reiss. 2013. Rule-based information extraction is dead! long live rule-based information extraction systems! In Proceedings of the 2013 conference on empirical methods in natural language processing, pages 827–832. Chiticariu 等人 (2013)↑ Laura Chiticariu, Yunyao Li, 和 Frederick Reiss. 2013. 基于规则的信息提取已死!基于规则的信息提取系统万岁! 收录于2013年自然语言处理经验方法会议论文集,第827–832页。
- Cobas and Navarro (2019) Dustin Cobas and Gonzalo Navarro. 2019. Fast, small, and simple document listing on repetitive text collections. In International Symposium on String Processing and Information Retrieval, pages 482–498. Springer. Cobas 和 Navarro (2019)↑ Dustin Cobas 和 Gonzalo Navarro. 2019. 重复文本集合上快速、小型且简单的文档列表。 收录于字符串处理与信息检索国际研讨会,第482–498页。Springer出版社。
- Cooney et al. (2023) Ciaran Cooney, Joana Cavadas, Liam Madigan, Bradley Savage, Rachel Heyburn, and Mairead O’Cuinn. 2023. End-to-end document classification and key information extraction using assignment optimization. arXiv preprint arXiv:2306.00750. Cooney 等人 (2023)↑ Ciaran Cooney, Joana Cavadas, Liam Madigan, Bradley Savage, Rachel Heyburn, 和 Mairead O’Cuinn. 2023. 利用分配优化进行端到端文档分类和关键信息提取。 arXiv 预印本 arXiv:2306.00750.
- Devlin et al. (2019) Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers), pages 4171–4186. Devlin 等人 (2019)↑ Jacob Devlin, Ming-Wei Chang, Kenton Lee, 和 Kristina Toutanova. 2019. Bert:用于语言理解的深度双向 Transformer 预训练。 收录于2019年北美计算语言学协会会议:人类语言技术论文集,第1卷(长论文和短论文),第4171–4186页。
- Etzioni et al. (2005) Oren Etzioni, Michael Cafarella, Doug Downey, Ana-Maria Popescu, Tal Shaked, Stephen Soderland, Daniel S Weld, and Alexander Yates. 2005. Unsupervised named-entity extraction from the web: An experimental study. Artificial intelligence, 165(1):91–134. Etzioni 等人 (2005)↑ Oren Etzioni, Michael Cafarella, Doug Downey, Ana-Maria Popescu, Tal Shaked, Stephen Soderland, Daniel S Weld, 和 Alexander Yates. 2005. 从网络进行无监督命名实体提取:一项实验研究。 《人工智能》(Artificial intelligence), 165(1):91–134.
- Finkel et al. (2005) Jenny Rose Finkel, Trond Grenager, and Christopher D Manning. 2005. Incorporating non-local information into information extraction systems by gibbs sampling. In Proceedings of the 43rd annual meeting of the association for computational linguistics (ACL’05), pages 363–370. Finkel 等人 (2005)↑ Jenny Rose Finkel, Trond Grenager, 和 Christopher D Manning. 2005. 通过吉布斯采样将非局部信息纳入信息提取系统。 收录于第43届计算语言学协会年度会议 (ACL’05) 论文集,第363–370页。
- Freitag (2000) Dayne Freitag. 2000. Machine learning for information extraction in informal domains. Machine learning, 39(2):169–202. Freitag (2000)↑ Dayne Freitag. 2000. 非正式领域信息提取的机器学习。 《机器学习》(Machine learning), 39(2):169–202.
- Gagie et al. (2017) Travis Gagie, Aleksi Hartikainen, Kalle Karhu, Juha Kärkkäinen, Gonzalo Navarro, Simon J Puglisi, and Jouni Sirén. 2017. Document retrieval on repetitive string collections. Information Retrieval Journal, 20:253–291. Gagie 等人 (2017)↑ Travis Gagie, Aleksi Hartikainen, Kalle Karhu, Juha Kärkkäinen, Gonzalo Navarro, Simon J Puglisi, 和 Jouni Sirén. 2017. 重复字符串集合上的文档检索。 《信息检索杂志》(Information Retrieval Journal), 20:253–291.
- Gim et al. (2024) In Gim, Guojun Chen, Seung-seob Lee, Nikhil Sarda, Anurag Khandelwal, and Lin Zhong. 2024. Prompt cache: Modular attention reuse for low-latency inference. Proceedings of Machine Learning and Systems, 6:325–338. Gim 等人 (2024)↑ In Gim, Guojun Chen, Seung-seob Lee, Nikhil Sarda, Anurag Khandelwal, 和 Lin Zhong. 2024. 提示缓存:用于低延迟推理的模块化注意力重用。 《机器学习与系统会议》(Proceedings of Machine Learning and Systems), 6:325–338.
- Gunel et al. (2022) Beliz Gunel, Navneet Potti, Sandeep Tata, James B Wendt, Marc Najork, and Jing Xie. 2022. Data-efficient information extraction from form-like documents. arXiv preprint arXiv:2201.02647. Gunel 等人 (2022)↑ Beliz Gunel, Navneet Potti, Sandeep Tata, James B Wendt, Marc Najork, 和 Jing Xie. 2022. 从表单类文档中进行数据高效的信息提取。 arXiv 预印本 arXiv:2201.02647.
- Huang et al. (2022) Yupan Huang, Tengchao Lv, Lei Cui, Yutong Lu, and Furu Wei. 2022. Layoutlmv3: Pre-training for document ai with unified text and image masking. In Proceedings of the 30th ACM international conference on multimedia, pages 4083–4091. Huang 等人 (2022)↑ Yupan Huang, Tengchao Lv, Lei Cui, Yutong Lu, 和 Furu Wei. 2022. Layoutlmv3:用于文档人工智能的统一文本和图像掩码预训练。 收录于第30届ACM国际多媒体会议论文集,第4083–4091页。
- Jaume et al. (2019) Guillaume Jaume, Hazim Kemal Ekenel, and Jean-Philippe Thiran. 2019. Funsd: A dataset for form understanding in noisy scanned documents. In 2019 International Conference on Document Analysis and Recognition Workshops (ICDARW), volume 2, pages 1–6. IEEE. Jaume 等人 (2019)↑ Guillaume Jaume, Hazim Kemal Ekenel, 和 Jean-Philippe Thiran. 2019. Funsd:用于嘈杂扫描文档中表单理解的数据集。 收录于2019年文档分析与识别国际会议研讨会 (ICDARW),第2卷,第1–6页。IEEE出版社。
- Kim et al. (2022) Geewook Kim, Teakgyu Hong, Moonbin Yim, JeongYeon Nam, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, and Seunghyun Park. 2022. Ocr-free document understanding transformer. In European Conference on Computer Vision, pages 498–517. Springer. Kim 等人 (2022)↑ Geewook Kim, Teakgyu Hong, Moonbin Yim, JeongYeon Nam, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, 和 Seunghyun Park. 2022. 无OCR的文档理解 Transformer。 收录于欧洲计算机视觉会议,第498–517页。Springer出版社。
- Kim et al. (2021) Geewook Kim, Teakgyu Hong, Moonbin Yim, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, and Seunghyun Park. 2021. Donut: Document understanding transformer without ocr. arXiv preprint arXiv:2111.15664, 7(15):2. Kim 等人 (2021)↑ Geewook Kim, Teakgyu Hong, Moonbin Yim, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, 和 Seunghyun Park. 2021. Donut:无需OCR的文档理解 Transformer。 arXiv 预印本 arXiv:2111.15664, 7(15):2.
- Lample et al. (2016) Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016. Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360. Lample 等人 (2016)↑ Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, 和 Chris Dyer. 2016. 命名实体识别的神经架构。 arXiv 预印本 arXiv:1603.01360.
- Lee et al. (2022) Chen-Yu Lee, Chun-Liang Li, Timothy Dozat, Vincent Perot, Guolong Su, Nan Hua, Joshua Ainslie, Renshen Wang, Yasuhisa Fujii, and Tomas Pfister. 2022. Formnet: Structural encoding beyond sequential modeling in form document information extraction. Preprint, arXiv:2203.08411. Lee 等人 (2022)↑ Chen-Yu Lee, Chun-Liang Li, Timothy Dozat, Vincent Perot, Guolong Su, Nan Hua, Joshua Ainslie, Renshen Wang, Yasuhisa Fujii, 和 Tomas Pfister. 2022. Formnet:表单文档信息提取中超越序列建模的结构编码。 预印本,arXiv:2203.08411.
- Li et al. (2024) J Li, J Chen, R Ren, X Cheng, WX Zhao, JY Nie, and JR Wen. 2024. The dawn after the dark: An empirical study on factuality hallucination in large language models. arxiv, article. arXiv preprint arXiv:2401.03205. Li 等人 (2024)↑ J Li, J Chen, R Ren, X Cheng, WX Zhao, JY Nie, 和 JR Wen. 2024. 黑暗之后的黎明:关于大语言模型中事实性幻觉的实证研究。arxiv,文章。 arXiv 预印本 arXiv:2401.03205.
- Li et al. (2020) Jing Li, Aixin Sun, Jianglei Han, and Chenliang Li. 2020. A survey on deep learning for named entity recognition. IEEE transactions on knowledge and data engineering, 34(1):50–70. Li 等人 (2020)↑ Jing Li, Aixin Sun, Jianglei Han, 和 Chenliang Li. 2020. 深度学习在命名实体识别中的应用综述。 《IEEE知识与数据工程汇刊》(IEEE transactions on knowledge and data engineering), 34(1):50–70.
- Li et al. (2022) Junlong Li, Jinyuan Wang, Zhuosheng Zhang, and Hai Zhao. 2022. Self-prompting large language models for zero-shot open-domain qa. arXiv preprint arXiv:2212.08635. Li 等人 (2022)↑ Junlong Li, Jinyuan Wang, Zhuosheng Zhang, 和 Hai Zhao. 2022. 用于零样本开放域问答的自提示大语言模型。 arXiv 预印本 arXiv:2212.08635.
- Lin et al. (2025) Yiming Lin, Mawil Hasan, Rohan Kosalge, Alvin Cheung, and Aditya G Parameswaran. 2025. Twix: Automatically reconstructing structured data from templatized documents. arXiv preprint arXiv:2501.06659. Lin 等人 (2025)↑ Yiming Lin, Mawil Hasan, Rohan Kosalge, Alvin Cheung, 和 Aditya G Parameswaran. 2025. Twix:从模板化文档中自动重构结构化数据。 arXiv 预印本 arXiv:2501.06659.
- Liu et al. (2019) Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692. Liu 等人 (2019)↑ Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, 和 Veselin Stoyanov. 2019. Roberta:一种稳健优化的BERT预训练方法。 arXiv 预印本 arXiv:1907.11692.
- Ma and Hovy (2016) Xuezhe Ma and Eduard Hovy. 2016. End-to-end sequence labeling via bi-directional lstm-cnns-crf. arXiv preprint arXiv:1603.01354. Ma 和 Hovy (2016)↑ Xuezhe Ma 和 Eduard Hovy. 2016. 通过双向LSTM-CNNs-CRF进行端到端序列标注。 arXiv 预印本 arXiv:1603.01354.
- Majumder et al. (2020) Bodhisattwa Prasad Majumder, Navneet Potti, Sandeep Tata, James Bradley Wendt, Qi Zhao, and Marc Najork. 2020. Representation learning for information extraction from form-like documents. In proceedings of the 58th annual meeting of the Association for Computational Linguistics, pages 6495–6504. Majumder 等人 (2020)↑ Bodhisattwa Prasad Majumder, Navneet Potti, Sandeep Tata, James Bradley Wendt, Qi Zhao, 和 Marc Najork. 2020. 表单类文档信息提取的表示学习。 收录于第58届计算语言学协会年度会议论文集,第6495–6504页。
- Mathew et al. (2021) Minesh Mathew, Dimosthenis Karatzas, and CV Jawahar. 2021. Docvqa: A dataset for vqa on document images. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 2200–2209. Mathew 等人 (2021)↑ Minesh Mathew, Dimosthenis Karatzas, 和 CV Jawahar. 2021. Docvqa:用于文档图像问答的数据集。 收录于IEEE/CVF冬季计算机视觉应用会议论文集,第2200–2209页。
- Navarro (2019) Gonzalo Navarro. 2019. Document listing on repetitive collections with guaranteed performance. Theoretical Computer Science, 772:58–72. Navarro (2019)↑ Gonzalo Navarro. 2019. 具有性能保证的重复集合上的文档列表。 《理论计算机科学》(Theoretical Computer Science), 772:58–72.
- Perot et al. (2023) Vincent Perot, Kai Kang, Florian Luisier, Guolong Su, Xiaoyu Sun, Ramya Sree Boppana, Zilong Wang, Zifeng Wang, Jiaqi Mu, Hao Zhang, and 1 others. 2023. Lmdx: Language model-based document information extraction and localization. arXiv preprint arXiv:2309.10952. Perot 等人 (2023)↑ Vincent Perot, Kai Kang, Florian Luisier, Guolong Su, Xiaoyu Sun, Ramya Sree Boppana, Zilong Wang, Zifeng Wang, Jiaqi Mu, Hao Zhang, 和 1 others. 2023. Lmdx:基于语言模型的文档信息提取与定位。 arXiv 预印本 arXiv:2309.10952.
- Ratinov and Roth (2009) Lev Ratinov and Dan Roth. 2009. Design challenges and misconceptions in named entity recognition. In Proceedings of the thirteenth conference on computational natural language learning (CoNLL-2009), pages 147–155. Ratinov 和 Roth (2009)↑ Lev Ratinov 和 Dan Roth. 2009. 命名实体识别中的设计挑战与误区。 收录于第13届计算自然语言学习会议 (CoNLL-2009) 论文集,第147–155页。
- Riedel et al. (2010) Sebastian Riedel, Limin Yao, and Andrew McCallum. 2010. Modeling relations and their mentions without labeled text. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2010, Barcelona, Spain, September 20-24, 2010, Proceedings, Part III 21, pages 148–163. Springer. Riedel 等人 (2010)↑ Sebastian Riedel, Limin Yao, 和 Andrew McCallum. 2010. 在没有标注文本的情况下对关系及其提及进行建模。 收录于机器学习与数据库知识发现:欧洲会议,ECML PKDD 2010,西班牙巴塞罗那,2010年9月20-24日,论文集,第III部分,第21卷,第148–163页。Springer出版社。
- Seitl et al. (2024) Filip Seitl, Tomáš Kovářík, Soheyla Mirshahi, Jan Kryštůfek, Rastislav Dujava, Matúš Ondreička, Herbert Ullrich, and Petr Gronat. 2024. Assessing the quality of information extraction. arXiv preprint arXiv:2404.04068. Seitl 等人 (2024)↑ Filip Seitl, Tomáš Kovářík, Soheyla Mirshahi, Jan Kryštůfek, Rastislav Dujava, Matúš Ondreička, Herbert Ullrich, 和 Petr Gronat. 2024. 评估信息提取的质量。 arXiv 预印本 arXiv:2404.04068.
- Shen et al. (2017) Xiaoyu Shen, Youssef Oualil, Clayton Greenberg, Mittul Singh, and Dietrich Klakow. 2017. Estimation of gap between current language models and human performance. In Proc. Interspeech 2017, pages 553–557. Shen 等人 (2017)↑ Xiaoyu Shen, Youssef Oualil, Clayton Greenberg, Mittul Singh, 和 Dietrich Klakow. 2017. 当前语言模型与人类表现之间差距的评估。 收录于2017年语音通讯会议 (Interspeech 2017),第553–557页。
- Su et al. (2022) Hui Su, Weiwei Shi, Xiaoyu Shen, Zhou Xiao, Tuo Ji, Jiarui Fang, and Jie Zhou. 2022. Rocbert: Robust chinese bert with multimodal contrastive pretraining. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 921–931. Su 等人 (2022)↑ Hui Su, Weiwei Shi, Xiaoyu Shen, Zhou Xiao, Tuo Ji, Jiarui Fang, 和 Jie Zhou. 2022. Rocbert:具有多模态对比预训练的稳健中文BERT。 收录于第60届计算语言学协会年度会议论文集(第1卷:长论文),第921–931页。
- Tang et al. (2021) Liyan Tang, Dhruv Rajan, Suyash Mohan, Abhijeet Pradhan, R Nick Bryan, and Greg Durrett. 2021. Making document-level information extraction right for the right reasons. arXiv preprint arXiv:2110.07686. Tang 等人 (2021)↑ Liyan Tang, Dhruv Rajan, Suyash Mohan, Abhijeet Pradhan, R Nick Bryan, 和 Greg Durrett. 2021. 以正确的原因进行正确的文档级信息提取。 arXiv 预印本 arXiv:2110.07686.
- Tang et al. (2023) Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, and Mohit Bansal. 2023. Unifying vision, text, and layout for universal document processing. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 19254–19264. Tang 等人 (2023)↑ Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, 和 Mohit Bansal. 2023. 统一视觉、文本和布局以实现通用文档处理。 收录于IEEE/CVF计算机视觉与模式识别会议论文集,第19254–19264页。
- Wang et al. (2023a) Dongsheng Wang, Natraj Raman, Mathieu Sibue, Zhiqiang Ma, Petr Babkin, Simerjot Kaur, Yulong Pei, Armineh Nourbakhsh, and Xiaomo Liu. 2023a. Docllm: A layout-aware generative language model for multimodal document understanding. arXiv preprint arXiv:2401.00908. Wang 等人 (2023a)↑ Dongsheng Wang, Natraj Raman, Mathieu Sibue, Zhiqiang Ma, Petr Babkin, Simerjot Kaur, Yulong Pei, Armineh Nourbakhsh, 和 Xiaomo Liu. 2023a. Docllm:一种用于多模态文档理解的布局感知生成式语言模型。 arXiv 预印本 arXiv:2401.00908.
- Wang et al. (2020) Liqiang Wang, Xiaoyu Shen, Gerard de Melo, and Gerhard Weikum. 2020. Cross-domain learning for classifying propaganda in online contents. arXiv preprint arXiv:2011.06844. Wang 等人 (2020)↑ Liqiang Wang, Xiaoyu Shen, Gerard de Melo, 和 Gerhard Weikum. 2020. 用于在线内容宣传分类的跨领域学习。 arXiv 预印本 arXiv:2011.06844.
- Wang et al. (2023b) Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, and Guoyin Wang. 2023b. Gpt-ner: Named entity recognition via large language models. arXiv preprint arXiv:2304.10428. Wang 等人 (2023b)↑ Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, 和 Guoyin Wang. 2023b. Gpt-ner:通过大语言模型进行命名实体识别。 arXiv 预印本 arXiv:2304.10428.
- Wang et al. (2023c) Xiao Wang, Weikang Zhou, Can Zu, Han Xia, Tianze Chen, Yuansen Zhang, Rui Zheng, Junjie Ye, Qi Zhang, Tao Gui, and 1 others. 2023c. Instructuie: Multi-task instruction tuning for unified information extraction. arXiv preprint arXiv:2304.08085. Wang 等人 (2023c)↑ Xiao Wang, Weikang Zhou, Can Zu, Han Xia, Tianze Chen, Yuansen Zhang, Rui Zheng, Junjie Ye, Qi Zhang, Tao Gui, 和 1 others. 2023c. Instructuie:用于统一信息提取的多任务指令微调。 arXiv 预印本 arXiv:2304.08085.
- Wei et al. (2022) Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824–24837. Wei 等人 (2022)↑ Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, 和 1 others. 2022. 思维链提示激发了大语言模型的推理能力。 《神经信息处理系统进展》(Advances in neural information processing systems), 35:24824–24837.
- Wei et al. (2023) Xiang Wei, Xingyu Cui, Ning Cheng, Xiaobin Wang, Xin Zhang, Shen Huang, Pengjun Xie, Jinan Xu, Yufeng Chen, Meishan Zhang, and 1 others. 2023. Zero-shot information extraction via chatting with chatgpt. arXiv e-prints, pages arXiv–2302. Wei 等人 (2023)↑ Xiang Wei, Xingyu Cui, Ning Cheng, Xiaobin Wang, Xin Zhang, Shen Huang, Pengjun Xie, Jinan Xu, Yufeng Chen, Meishan Zhang, 和 1 others. 2023. 通过与ChatGPT聊天实现零样本信息提取。 arXiv 预印本,第arXiv–2302页。
- Xu et al. (2020) Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, and Ming Zhou. 2020. Layoutlm: Pre-training of text and layout for document image understanding. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pages 1192–1200. Xu 等人 (2020)↑ Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, 和 Ming Zhou. 2020. Layoutlm:用于文档图像理解的文本和布局预训练。 收录于第26届ACM SIGKDD知识发现与数据挖掘国际会议论文集,第1192–1200页。
- Yadav and Bethard (2019) Vikas Yadav and Steven Bethard. 2019. A survey on recent advances in named entity recognition from deep learning models. arXiv preprint arXiv:1910.11470. Yadav 和 Bethard (2019)↑ Vikas Yadav 和 Steven Bethard. 2019. 深度学习模型在命名实体识别方面最新进展综述。 arXiv 预印本 arXiv:1910.11470.
- Zhang et al. (2024) Qintong Zhang, Victor Shea-Jay Huang, Bin Wang, Junyuan Zhang, Zhengren Wang, Hao Liang, Shawn Wang, Matthieu Lin, Conghui He, and Wentao Zhang. 2024. Document parsing unveiled: Techniques, challenges, and prospects for structured information extraction. arXiv preprint arXiv:2410.21169. Zhang 等人 (2024)↑ Qintong Zhang, Victor Shea-Jay Huang, Bin Wang, Junyuan Zhang, Zhengren Wang, Hao Liang, Shawn Wang, Matthieu Lin, Conghui He, 和 Wentao Zhang. 2024. 文档解析揭秘:结构化信息提取的技术、挑战与前景。 arXiv 预印本 arXiv:2410.21169.
- Zhang et al. (2023a) Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, and 1 others. 2023a. Siren’s song in the ai ocean: a survey on hallucination in large language models. arXiv preprint arXiv:2309.01219. Zhang 等人 (2023a)↑ Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, 和 1 others. 2023a. AI海洋中的塞壬之歌:大语言模型幻觉综述。 arXiv 预印本 arXiv:2309.01219.
- Zhang et al. (2023b) Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark Barrett, and 1 others. 2023b. H2o: Heavy-hitter oracle for efficient generative inference of large language models. Advances in Neural Information Processing Systems, 36:34661–34710. Zhang 等人 (2023b)↑ Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark Barrett, 和 1 others. 2023b. H2o:用于大语言模型高效生成推理的重击手预言机。 《神经信息处理系统进展》(Advances in Neural Information Processing Systems), 36:34661–34710.
- Zheng et al. (2024) Zhen Zheng, Xin Ji, Taosong Fang, Fanghao Zhou, Chuanjie Liu, and Gang Peng. 2024. Batchllm: Optimizing large batched llm inference with global prefix sharing and throughput-oriented token batching. arXiv preprint arXiv:2412.03594. Zheng 等人 (2024)↑ Zhen Zheng, Xin Ji, Taosong Fang, Fanghao Zhou, Chuanjie Liu, 和 Gang Peng. 2024. Batchllm:利用全局前缀共享和面向吞吐量的Token批处理优化大批量LLM推理。 arXiv 预印本 arXiv:2412.03594.