BPMN Assistant: An LLM-Based Approach to Business Process ModelingBPMN Assistant:一种基于大语言模型的业务流程建模方法
Abstract摘要
This paper presents BPMN Assistant, a tool that leverages Large Language Models (LLMs) for natural language-based creation and editing of BPMN diagrams. A specialized JSON-based representation is introduced as a structured alternative to the direct handling of XML to enhance the accuracy of process modifications. Process generation quality is evaluated using Graph Edit Distance (GED) and Relative Graph Edit Distance (RGED), while editing performance is evaluated with a binary success metric. Results show that JSON and XML achieve similar similarity scores in generation, but JSON offers greater reliability, faster processing, and significantly higher editing success rates. We discuss key trade-offs, limitations, and future improvements. The implementation is available at https://github.com/jtlicardo/bpmn-assistant.本文介绍了 BPMN Assistant,这是一款利用大语言模型(LLM)实现基于自然语言创建和编辑 BPMN 图的工具。为了增强流程修改的准确性,我们引入了一种专门的 JSON 表示法,作为直接处理 XML 的结构化替代方案。我们使用图编辑距离(GED)和相对图编辑距离(RGED)来评估流程生成的质量,并使用二元成功指标来评估编辑性能。结果表明,JSON 和 XML 在生成相似度得分上表现相当,但 JSON 具有更高的可靠性、更快的处理速度以及显著更高的编辑成功率。我们讨论了其中的关键权衡、局限性及未来的改进方向。该工具的实现代码可在 https://github.com/jtlicardo/bpmn-assistant 获取。
August 24, 20262026年8月24日
1 Introduction1 引言
Business Process Model and Notation (BPMN) has long served as a standard for modeling business processes, enabling organizations to visualize and optimize their workflows. However, the complexity inherent in creating, editing, and interpreting BPMN diagrams poses significant challenges, particularly for individuals without specialized training [1]. As Recker [2] demonstrates through extensive research, BPMN’s over-engineered nature and the prevalent lack of formal training among its users create substantial barriers to effective adoption. This bottleneck often results in inefficiencies and a reliance on experts, which can increase operational costs and delay decision-making.业务流程模型和标注(BPMN)长期以来一直是业务流程建模的标准,使组织能够可视化并优化其工作流。然而,创建、编辑和解读 BPMN 图所固有的复杂性带来了巨大挑战,尤其是对于缺乏专业培训的个人而言 [1]。正如 Recker [2] 通过大量研究所证明的那样,BPMN 的过度工程化性质及其用户普遍缺乏正规培训,构成了有效应用该标准的重大障碍。这种瓶颈往往导致效率低下并产生对专家的依赖,进而增加运营成本并延误决策。
A significant challenge in modern organizations is the communication gap between IT departments and business stakeholders. While IT professionals are comfortable with formal modeling notations and technical specifications, business users typically express processes in natural language and informal descriptions. A systematic review by [3] demonstrates that this disconnect leads to misunderstandings, requirements misalignment, and implementation delays, with communication barriers persisting despite significant investments in alignment initiatives. Furthermore, valuable process knowledge frequently remains trapped in the minds of domain experts or scattered across various informal documents, making it difficult to capture and formalize this expertise [4].现代组织面临的一个重大挑战是 IT 部门与业务利益相关者之间的沟通鸿沟。IT 专业人员习惯于使用正式的建模标注和技术规范,而业务用户通常以自然语言和非正式描述来表达流程。[3] 的一项系统性综述表明,这种脱节会导致误解、需求不匹配和实施延误,尽管组织在协同倡议上投入巨大,但沟通障碍依然存在。此外,宝贵的流程知识往往留存在领域专家的脑海中,或分散在各种非正式文档中,使得捕获和形式化这些专业知识变得困难 [4]。
The complexity of extracting process models from unstructured text remains a significant challenge, as highlighted by Bellan et al.’s qualitative analysis [5]. Their research reveals that current methodologies primarily rely on ad-hoc rule-based approaches, which struggle with the complexity of real-world documents. This challenge is further compounded by the limitations of traditional process elicitation methods, as demonstrated by Baião et al. [6], who propose a novel approach integrating group storytelling techniques with text mining to capture the nuances of human-centric activities in process modeling.从非结构化文本中提取流程模型的复杂性仍然是一项重大挑战,正如 Bellan 等人的定性分析所强调的那样 [5]。他们的研究揭示,当前的方法主要依赖于临时性的基于规则的方法,这些方法难以应对现实世界文档的复杂性。正如 Baião 等人 [6] 所展示的那样,传统流程获取方法的局限性进一步加剧了这一挑战,他们提出了一种将群体叙事技术与文本挖掘相结合的新颖方法,以捕获流程建模中以人为中心的活动细微差别。
Recent research has highlighted the cognitive challenges faced by modelers when creating process models, particularly regarding cognitive load and task complexity. Weber et al. [7] introduced a psycho-physiological approach to assess cognitive load during process modeling, utilizing real-time eye movement analysis to identify task-specific difficulties. Their findings emphasize that process modeling requires substantial cognitive effort, especially in naming activities and managing complex structures. These insights reinforce the need for tools like BPMN Assistant, which aim to reduce cognitive barriers and enhance accessibility.近期的研究强调了建模者在创建流程模型时所面临的认知挑战,特别是在认知负荷和任务复杂度方面。Weber 等人 [7] 引入了一种心理生理学方法来评估流程建模过程中的认知负荷,利用实时眼动分析来识别特定任务的困难。他们的研究结果强调,流程建模需要大量的认知投入,特别是在命名活动和管理复杂结构方面。这些见解强化了对 BPMN Assistant 这类工具的需求,旨在降低认知门槛并提高易用性。
The technical barrier to BPMN usage, when combined with the dispersed nature of process documentation, creates a significant barrier to effective process management. Organizations often find themselves in a situation where valuable process knowledge exists but remains underutilized due to its informal and distributed nature.BPMN 使用的技术门槛,加上流程文档的分散性,构成了有效流程管理的重大障碍。组织往往发现自己处于这样一种境地:宝贵的流程知识虽然存在,但由于其非正式和分散的性质而未得到充分利用。
Another critical issue is the dynamic nature of business processes in today’s rapidly evolving business environment. Organizations need to frequently update and modify their processes to remain competitive and adapt to changing market conditions [8]. However, the formal nature of BPMN and the expertise required to modify process models often create a bottleneck in implementing these changes, leading to a gap between actual business operations and their formal documentation. This challenge is evidenced by Leopold et al.’s analysis of 585 BPMN models from industry, which revealed persistent quality issues related to model complexity, particularly in areas such as splits and joins, message flows, and model decomposition, highlighting the technical expertise required for effective BPMN modeling [9].另一个关键问题是当今快速发展的商业环境中业务流程的动态性。组织需要频繁更新和修改其流程以保持竞争力并适应不断变化的市场条件 [8]。然而,BPMN 的形式化性质以及修改流程模型所需的专业知识往往成为实施这些变革的瓶颈,导致实际业务运营与其正式文档之间产生差距。Leopold 等人对工业界 585 个 BPMN 模型的分析证明了这一挑战,该分析揭示了与模型复杂性相关的持续性质量问题,特别是在分支与合并、消息流和模型分解等领域,突显了有效进行 BPMN 建模所需的技术专长 [9]。
The disconnect between formal process models and actual business operations is further exacerbated by the increasing complexity of modern business processes. These processes often span multiple departments, involve numerous stakeholders, and integrate with various systems and external partners. As van der Aalst and Weijters [10] demonstrate in their seminal work on process mining, organizations face significant challenges in accurately capturing and analyzing these complex processes, including issues with hidden tasks, duplicate activities, and non-free-choice constructs. The traditional modeling approaches struggle to address these challenges while maintaining accessibility for all stakeholders.现代业务流程日益增加的复杂性进一步加剧了正式流程模型与实际业务运营之间的脱节。这些流程通常跨越多个部门,涉及众多利益相关者,并与各种系统和外部合作伙伴集成。正如 van der Aalst 和 Weijters [10] 在他们关于流程挖掘的开创性著作中所展示的那样,组织在准确捕获和分析这些复杂流程时面临重大挑战,包括隐藏任务、重复活动和非自由选择结构等问题。传统的建模方法在试图解决这些挑战的同时,难以保持对所有利益相关者的易用性。
Prior to the emergence of Large Language Models (LLMs), numerous attempts were made to automate aspects of process modeling and bridge the natural language gap. Early work by Friedrich et al. [11] demonstrated the potential of rule-based approaches for extracting process models from natural language text, though these systems struggled with complex sentence structures and domain-specific terminology. The integration of natural language processing into process management faced significant challenges with semantic ambiguity and contextual understanding. Efforts by Leopold et al. [12] to automatically generate natural language descriptions from process models highlighted both the potential and limitations of traditional NLP approaches in process automation. These early automation attempts, while groundbreaking, were often constrained by their reliance on predefined rules and limited ability to handle variations in natural language expressions [13].在大语言模型(LLM)出现之前,人们曾多次尝试将流程建模的某些方面自动化,以弥合自然语言带来的鸿沟。Friedrich 等人 [11] 的早期工作展示了基于规则的方法从自然语言文本中提取流程模型的潜力,尽管这些系统在处理复杂句式和领域特定术语时显得吃力。将自然语言处理集成到流程管理中,面临着语义歧义和上下文理解方面的重大挑战。Leopold 等人 [12] 尝试从流程模型自动生成自然语言描述,这既突显了传统 NLP 方法在流程自动化方面的潜力,也暴露了其局限性。这些早期的自动化尝试虽然具有开创性,但往往受限于对预定义规则的依赖,且处理自然语言表达多样性的能力有限 [13]。
Advancements in artificial intelligence, particularly the emergence of LLMs, have opened new avenues for automating the creation and management of business process models [14, 15, 16]. These models have demonstrated exceptional capabilities in understanding and generating natural language, making them well-suited for bridging the gap between textual process descriptions and formal BPMN representations. Recent research by Klievtsova et al. [17] has shown that AI-assisted approaches to process modeling can be particularly effective, with AI-generated models often being preferred over those created by inexperienced human modelers. However, Rebmann et al. [18] highlight that while LLMs show promise in process-related tasks, their effectiveness often depends on proper fine-tuning and task-specific training, particularly for complex semantics-aware operations. This suggests significant potential for LLM-based tools in democratizing access to process modeling capabilities, while also emphasizing the importance of careful implementation and training approaches.人工智能的进步,特别是大语言模型(LLM)的出现,为自动化创建和管理业务流程模型开辟了新途径 [14, 15, 16]。这些模型在理解和生成自然语言方面表现出卓越的能力,非常适合弥合文本流程描述与正式 BPMN 表示之间的鸿沟。Klievtsova 等人 [17] 的近期研究表明,人工智能辅助的流程建模方法非常有效,人工智能生成的模型往往比缺乏经验的人类建模者创建的模型更受欢迎。然而,Rebmann 等人 [18] 强调,虽然 LLM 在流程相关任务中表现出前景,但其有效性往往取决于适当的微调和特定任务的训练,特别是在处理复杂的语义感知操作时。这表明基于 LLM 的工具在普及流程建模能力方面具有巨大潜力,同时也强调了谨慎实施和训练方法的重要性。
This work presents BPMN Assistant, a system that leverages Large Language Models to address the fundamental challenges in business process modeling. While recent research has demonstrated the potential of AI-assisted process modeling, the critical aspect of model modification and maintenance remains largely unexplored. Our work advances the state of the art by demonstrating the effectiveness of LLMs in editing existing BPMN diagrams through natural language instructions.本研究提出了 BPMN Assistant,这是一个利用大语言模型来解决业务流程建模中根本性挑战的系统。尽管近期的研究已经证明了人工智能辅助流程建模的潜力,但模型修改和维护这一关键环节在很大程度上仍未得到探索。我们的工作通过证明 LLM 在通过自然语言指令编辑现有 BPMN 图方面的有效性,推动了该领域的发展。
Our evaluation reveals significant improvements in editing success rates compared to baseline approaches, particularly when using structured representations for model manipulation. These results suggest that LLMs can effectively bridge the gap between informal process descriptions and formal models, offering a promising solution for maintaining and updating business process documentation.我们的评估显示,与基准方法相比,编辑成功率有了显著提高,特别是在使用结构化表示进行模型操作时。这些结果表明,LLM 可以有效地弥合非正式流程描述与正式模型之间的鸿沟,为维护和更新业务流程文档提供了一种有前景的解决方案。
The following sections detail our methodology, system implementation, and evaluation results, providing a foundation for future research in AI-assisted process modeling.接下来的章节将详细介绍我们的方法论、系统实现和评估结果,为人工智能辅助流程建模的未来研究奠定基础。
2 Related Work2 相关工作
The integration of Large Language Models (LLMs) into Business Process Management (BPM) has led to significant developments in process automation and modeling. The introduction of specialized tools like the BPMN-Chatbot [19] and ProMoAI [20] has demonstrated the practical applications of this technology. Initial explorations by Berti and Qafari [21] into using GPT-4 and Bard (Gemini) for process mining tasks showed promising results in interpreting both procedural and declarative models, highlighting the potential of LLMs in the BPM domain. These developments have led to comprehensive frameworks for process modeling with LLMs [22], showing promising results in both automation and model quality.将大语言模型(LLM)集成到业务流程管理(BPM)中,推动了流程自动化和建模的重大发展。BPMN-Chatbot [19] 和 ProMoAI [20] 等专用工具的推出,展示了该技术的实际应用。Berti 和 Qafari [21] 对使用 GPT-4 和 Bard (Gemini) 进行流程挖掘任务的初步探索显示了令人期待的结果,证明了它们在解释程序化和声明式模型方面的能力,突显了 LLM 在 BPM 领域的潜力。这些进展促成了基于 LLM 的流程建模综合框架 [22] 的诞生,在自动化和模型质量方面均取得了可观的成果。
In the area of process extraction, various approaches have demonstrated different methodologies and results. Ferreira et al. [23] developed a semi-automatic method for identifying business process elements from natural language texts, achieving 91.92% accuracy in their prototype implementation through carefully defined mapping rules. Taking a different approach, Neuberger et al. [24] introduced a universal prompting strategy that leverages LLMs for process model information extraction, demonstrating performance improvements of up to 8% F1 score over traditional machine learning methods.在流程提取领域,各种方法展示了不同的方法论和结果。Ferreira 等人 [23] 开发了一种从自然语言文本中识别业务流程元素的半自动方法,通过精心定义的映射规则,在其原型实现中达到了 91.92% 的准确率。Neuberger 等人 [24] 采取了不同的方法,引入了一种利用 LLM 进行流程模型信息提取的通用提示策略,与传统的机器学习方法相比,F1 分数提升了高达 8%。
The integration of prompt engineering in BPM has emerged as a promising direction, as discussed by Busch et al. [25]. Their research highlights how prompt engineering can effectively utilize pre-trained language models without extensive fine-tuning, addressing common challenges in process extraction and predictive monitoring. This approach is particularly valuable in scenarios with limited data availability, offering a computationally sustainable solution for BPM applications.正如 Busch 等人 [25] 所讨论的那样,将提示工程(Prompt Engineering)集成到 BPM 中已成为一个有前景的方向。他们的研究强调了提示工程如何能够在无需大量微调的情况下有效利用预训练语言模型,从而解决流程提取和预测性监控中的常见挑战。这种方法在数据可用性有限的情况下尤为宝贵,为 BPM 应用提供了一种计算上可持续的解决方案。
ProMoAI, introduced by Kourani et al. [20], represents a significant development in LLM-driven process modeling. While the tool incorporates prompt engineering and error handling techniques, it currently generates Graphviz graph visualizations rather than process models based on standardized BPMN notation. The tool’s effectiveness was thoroughly evaluated in a subsequent study [26], which demonstrated its capabilities when paired with different LLMs, with Claude 3.5 Sonnet emerging as the best-performing model for generating high-quality process models. Despite using non-standard notation, ProMoAI’s approach demonstrates strong potential for using LLMs to assist in process visualization tasks.Kourani 等人 [20] 引入的 ProMoAI 代表了 LLM 驱动的流程建模的一项重大发展。虽然该工具结合了提示工程和错误处理技术,但它目前生成的是 Graphviz 图可视化,而非基于标准化 BPMN 标注的流程模型。随后的研究 [26] 对该工具的有效性进行了全面评估,展示了其在配合不同 LLM 使用时的能力,其中 Claude 3.5 Sonnet 成为生成高质量流程模型表现最好的模型。尽管使用了非标准标注,ProMoAI 的方法仍展示了使用 LLM 辅助流程可视化任务的强大潜力。
Köpke and Safan [19] introduced the BPMN-Chatbot, a publicly available web-based tool designed for efficient LLM-based process modeling. The BPMN-Chatbot allows users to generate BPMN process models interactively using text or voice input. It achieved notable efficiency gains, reducing token usage by up to 94% compared to alternative tools like ProMoAI while maintaining a correctness rate of 95%, which surpassed the best competitor’s 86%. The authors emphasized the importance of user testing to evaluate the feedback loop’s capabilities, which are critical for interactive process design.Köpke 和 Safan [19] 推出了 BPMN-Chatbot,这是一款公开可用的基于 Web 的工具,专为高效的基于 LLM 的流程建模而设计。BPMN-Chatbot 允许用户通过文本或语音输入交互式地生成 BPMN 流程模型。它实现了显著的效率提升,与 ProMoAI 等替代工具相比,Token 使用量减少了高达 94%,同时保持了 95% 的正确率,超过了最强竞争对手的 86%。作者强调了用户测试对于评估反馈循环能力的重要性,这对于交互式流程设计至关重要。
While BPMN-Chatbot demonstrates notable strengths, particularly in token efficiency and correctness rates, its evaluation primarily focuses on the generation of process models. The editing capabilities, which are essential for iterative refinement and interactive process modeling, have not been rigorously evaluated. Addressing this gap could further validate its utility in real-world scenarios where users frequently modify and adapt process models.虽然 BPMN-Chatbot 展现出显著优势,特别是在 Token 效率和正确率方面,但其评估主要集中在流程模型的生成上。对于迭代优化和交互式流程建模至关重要的编辑功能,尚未经过严格评估。解决这一空白可以进一步验证其在用户频繁修改和调整流程模型的现实场景中的实用性。
In a comprehensive evaluation of process extraction approaches, Bellan et al. [27] analyzed ten state-of-the-art methods for extracting process models from textual descriptions. Their systematic comparison revealed significant variations in performance and methodology among existing tools, with no single approach achieving superior results across all evaluation metrics. This study highlighted the need for standardized evaluation frameworks and emphasized the challenges in automated process extraction that our work aims to address.在对流程提取方法的一项全面评估中,Bellan 等人 [27] 分析了十种从文本描述中提取流程模型的最先进方法。他们的系统比较揭示了现有工具在性能和方法论上的显著差异,没有哪一种方法在所有评估指标上都表现优异。这项研究强调了标准化评估框架的需求,并突显了自动化流程提取中我们旨在解决的挑战。
Kourani et al. [22] proposed a comprehensive framework leveraging LLMs to automate the generation and refinement of process models from textual descriptions. This framework demonstrated its ability to streamline process modeling tasks while maintaining sound and executable model outputs. The superiority of this approach was evident in its comparison with traditional methods, particularly in resolving errors and integrating user feedback effectively. GPT-4 showcased strong performance in generating process models, addressing errors, and adapting to user feedback, whereas Gemini struggled with similar tasks.Kourani 等人 [22] 提出了一个综合框架,利用 LLM 自动化从文本描述中生成和优化流程模型。该框架展示了在保持模型健全且可执行的同时简化流程建模任务的能力。与传统方法相比,这种方法的优越性显而易见,特别是在解决错误和有效整合用户反馈方面。GPT-4 在生成流程模型、纠错和适应用户反馈方面表现强劲,而 Gemini 在类似任务中则表现吃力。
Nivon et al. [28] introduced a novel approach to automating BPMN process generation from textual requirements, addressing the challenges faced by non-expert users in process modeling. Their methodology employs a three-step approach utilizing a fine-tuned GPT-3.5 model: first extracting tasks and ordering constraints from textual descriptions, then constructing an abstract syntax tree (AST) to represent task relationships, and finally converting the AST into a BPMN process. Their Java-based implementation achieved a 78.5% accuracy rate for valid BPMN processes in tests across 200 descriptions, demonstrating the viability of automated BPMN generation while highlighting areas for potential improvement through more advanced language models.Nivon 等人 [28] 引入了一种从文本需求中自动化生成 BPMN 流程的新颖方法,解决了非专家用户在流程建模中面临的挑战。他们的方法采用了一个利用微调后的 GPT-3.5 模型的三步走策略:首先从文本描述中提取任务和顺序约束,然后构建一个抽象语法树(AST)来表示任务关系,最后将 AST 转换为 BPMN 流程。他们在 200 个描述的测试中,基于 Java 的实现达到了 78.5% 的 BPMN 有效流程准确率,证明了自动化 BPMN 生成的可行性,同时也指出了通过更先进的语言模型进行改进的潜力。
These studies collectively illustrate the transformative potential of LLMs in business process modeling. Tools like BPMN-Chatbot, ProMoAI, and Nivon et al.’s automated BPMN generator demonstrate the feasibility of combining generative AI with domain-specific methodologies to achieve higher efficiency, accuracy, and accessibility. Moreover, the benchmarks and frameworks established by researchers provide a foundation for future advancements, emphasizing the importance of careful prompt design, user feedback integration, and domain-specific optimization in realizing the full potential of LLMs in BPM.这些研究共同说明了 LLM 在业务流程建模中的变革潜力。BPMN-Chatbot、ProMoAI 和 Nivon 等人的自动化 BPMN 生成器等工具,证明了将生成式 AI 与领域特定方法相结合以实现更高效率、准确性和易用性的可行性。此外,研究人员建立的基准和框架为未来的进步奠定了基础,强调了仔细的提示设计、用户反馈整合以及领域特定优化在实现 LLM 在 BPM 中全部潜力方面的重要性。
3 System Architecture3 系统架构
The BPMN Assistant system architecture, as illustrated in Figure 1, is designed to facilitate seamless interaction between users and BPMN models through natural language inputs. The system is composed of three primary components: the Python-based backend, the BPMN layout server, and the Vue.js frontend. Each component plays a critical role in ensuring the system’s functionality, efficiency, and usability.如图 1 所示,BPMN Assistant 系统架构旨在通过自然语言输入促进用户与 BPMN 模型之间的无缝交互。该系统由三个主要组件组成:基于 Python 的后端、BPMN 布局服务器和 Vue.js 前端。每个组件在确保系统的功能性、效率和易用性方面都发挥着关键作用。
3.1 Backend3.1 后端
The backend, implemented in Python, serves as the core computational engine of the system. Its primary responsibilities include handling user inputs, interacting with the Large Language Model (LLM), managing BPMN diagrams, and providing APIs for the frontend. The backend leverages the FastAPI framework, chosen for its performance and simplicity in developing RESTful APIs.后端使用 Python 实现,是系统的核心计算引擎。其主要职责包括处理用户输入、与大语言模型(LLM)交互、管理 BPMN 图以及为前端提供 API。后端利用 FastAPI 框架,因其在开发 RESTful API 方面的性能和简洁性而被选中。
The backend serves as the first point of contact for user inputs, analyzing these inputs to determine the user’s intent. This can include conversational queries, such as asking questions about BPMN concepts, or operational commands, such as creating or modifying BPMN diagrams. When a conversational intent is recognized, the backend communicates with the LLM to generate a natural language response. If the input requires an operational response, the backend constructs a prompt to instruct the LLM to generate or modify a BPMN diagram. These diagrams are initially represented in JSON format and subsequently converted to BPMN XML for compatibility with visualization tools. Additionally, the backend supports the uploading of BPMN files, enabling users to query or modify existing diagrams. The backend includes robust error handling and validation mechanisms to ensure that outputs from the LLM are accurate and reliable. If invalid JSON is generated, the backend retries the process or notifies the user of the error. By integrating with the BPMN layout server, the backend also ensures that diagrams are enriched with graphical information for enhanced visualization.后端作为用户输入的第一个接触点,负责分析这些输入以确定用户的意图。这可以包括对话式查询(例如询问有关 BPMN 概念的问题)或操作性命令(例如创建或修改 BPMN 图)。当识别出对话意图时,后端会与 LLM 通信以生成自然语言回复。如果输入需要操作性响应,后端会构建一个提示,指示 LLM 生成或修改 BPMN 图。这些图最初以 JSON 格式表示,随后转换为 BPMN XML,以便与可视化工具兼容。此外,后端支持上传 BPMN 文件,使用户能够查询或修改现有图表。后端包含稳健的错误处理和验证机制,以确保 LLM 的输出准确可靠。如果生成了无效的 JSON,后端会重试该过程或通知用户错误信息。通过与 BPMN 布局服务器集成,后端还确保图表被赋予图形信息以增强可视化效果。
Model Integration and Selection模型集成与选择
Our system integrates multiple models from different providers, each chosen for its specific strengths and use cases. Table 1 provides an overview of the supported models and their capabilities.我们的系统集成了来自不同提供商的多个模型,每个模型都因其特定的优势和用例而被选中。表 1 提供了所支持模型及其能力的概览。
| Provider | Model | Description |
|---|---|---|
| OpenAI | GPT-4o | Multimodal model capable of processing text, audio, image, and video [29]. |
| GPT-4o mini | Fast and affordable model optimized for simpler tasks | |
| o3-mini | Cost-efficient reasoning model for coding and science use-cases. | |
| Anthropic | Claude 3.5 Sonnet | Advanced model featuring a 200K token context window for enhanced reasoning. |
| Gemini 2.0 Flash | Multimodal model with with low latency and a 1M context window. | |
| Fireworks AI | Llama 3.3 70B | Meta’s latest open-source LLM [30]. |
| Qwen 2.5 72B | Alibaba’s open-source model with strong multilingual capabilities [31]. | |
| Deepseek V3 | Open-source model specialized in technical and scientific reasoning [32]. |
| Model | Input | Output |
|---|---|---|
| o3-mini | 1.10 | 4.40 |
| GPT-4o | 2.50 | 10.00 |
| GPT-4o mini | 0.15 | 0.60 |
| Claude 3.5 Sonnet | 3.00 | 15.00 |
| Gemini 2.0 Flash | 0.10 | 0.40 |
| Qwen 2.5 72B | 0.90 | 0.90 |
| Llama 3.3 70B | 0.90 | 0.90 |
| Deepseek V3 | 0.75 | 3.00 |
This diverse selection ensures flexibility and performance optimization across different AI-driven tasks.这种多样化的选择确保了在不同 AI 驱动任务中的灵活性和性能优化。
Supported BPMN Elements支持的 BPMN 元素
The backend facilitates operations on a variety of BPMN elements, including tasks, gateways, and events. These supported elements, detailed in Table 3, enable the system to cover a comprehensive range of BPMN functionalities, enhancing its applicability to diverse workflows.后端支持对多种 BPMN 元素进行操作,包括任务、网关和事件。这些支持的元素(详见表 3)使系统能够覆盖全面的 BPMN 功能,增强了其在多样化工作流中的适用性。
| Category | Elements |
|---|---|
| Tasks | General tasks, user tasks, service tasks |
| Gateways | Exclusive gateway, parallel gateway |
| Events | Start event, end event |
3.2 BPMN Layout Server3.2 BPMN 布局服务器
The BPMN layout server, implemented using Node.js with the Express.js framework, is dedicated to augmenting BPMN diagrams with graphical information. This server employs the bpmn-auto-layout npm library to generate DI (Diagram Interchange) information, which includes the graphical coordinates of BPMN elements.BPMN 布局服务器使用 Node.js 和 Express.js 框架实现,致力于为 BPMN 图添加图形信息。该服务器采用 bpmn-auto-layout npm 库来生成 DI(图表交换)信息,其中包括 BPMN 元素的图形坐标。
The layout server takes BPMN XML files from the backend and enhances them by adding graphical coordinates, which are essential for visual representation. Although the server efficiently enriches diagrams for most scenarios, it is currently limited in its ability to process multi-pool or multi-lane diagrams due to constraints in the bpmn-auto-layout library. The server is designed to work seamlessly with the backend, exchanging data through REST APIs to ensure smooth integration.布局服务器从后端获取 BPMN XML 文件,并通过添加图形坐标来增强它们,这对于可视化表示至关重要。尽管服务器能高效地为大多数场景丰富图表信息,但由于 bpmn-auto-layout 库的限制,目前在处理多池或多泳道图表方面存在局限。服务器旨在与后端无缝协作,通过 REST API 交换数据以确保平滑集成。
3.3 Frontend3.3 前端
The Vue.js-based frontend provides an intuitive graphical user interface (GUI) for user interaction. Its design focuses on accessibility, enabling non-experts to engage with BPMN modeling tasks effectively.基于 Vue.js 的前端为用户交互提供了直观的图形用户界面(GUI)。其设计侧重于易用性,使非专家用户能够有效地参与 BPMN 建模任务。
The frontend features a dual-panel design that facilitates interaction with both the LLM and BPMN diagrams. On the left, a chat interface allows users to submit natural language queries and view responses in real-time. Users can also select their preferred LLM for processing queries. On the right, a BPMN canvas, powered by bpmn.io (bpmn-js), displays the generated or modified BPMN diagrams. This canvas enables users to interact with the diagrams in a manner similar to traditional desktop tools. The frontend also provides feedback to users during diagram generation or modification, displaying status messages that indicate progress. Once a BPMN diagram is complete, users can download it for offline use or integration with other tools.前端采用双面板设计,便于与 LLM 和 BPMN 图进行交互。左侧的聊天界面允许用户提交自然语言查询并实时查看回复。用户还可以选择他们偏好的 LLM 来处理查询。右侧的 BPMN 画布由 bpmn.io (bpmn-js) 提供支持,显示生成或修改后的 BPMN 图。该画布使用户能够以类似于传统桌面工具的方式与图表进行交互。前端还在图表生成或修改过程中向用户提供反馈,显示指示进度的状态消息。一旦 BPMN 图完成,用户可以将其下载以供离线使用或集成到其他工具中。
The frontend bridges the gap between users and the underlying system, providing a user-friendly interface for BPMN modeling and interaction.前端架起了用户与底层系统之间的桥梁,为 BPMN 建模和交互提供了一个用户友好的界面。
3.4 Data Flow3.4 数据流
The system processes data through a series of well-defined steps to ensure efficient operation and user satisfaction. Initially, user inputs are submitted via the frontend and transmitted to the backend, where intent recognition determines the appropriate response. If the input is conversational, the backend queries the LLM to generate a natural language reply. For operational inputs, the backend prompts the LLM to produce BPMN diagrams in JSON format. This JSON is then converted into BPMN XML and sent to the BPMN layout server. The layout server enriches the XML with graphical information and returns it to the backend. Finally, the enriched BPMN diagram is sent to the frontend, where it is displayed in the BPMN canvas. Users can choose to continue interacting with the diagram or download it for their records.系统通过一系列定义明确的步骤处理数据,以确保高效运行和用户满意度。首先,用户输入通过前端提交并传输到后端,意图识别在此确定适当的响应。如果输入是对话式的,后端会查询 LLM 以生成自然语言回复。对于操作性输入,后端会提示 LLM 生成 JSON 格式的 BPMN 图。该 JSON 随后被转换为 BPMN XML 并发送到 BPMN 布局服务器。布局服务器用图形信息丰富 XML,并将其返回给后端。最后,丰富的 BPMN 图被发送到前端,并在 BPMN 画布中显示。用户可以选择继续与图表交互或将其下载以备记录。
3.5 JSON Representation of BPMN Diagrams3.5 BPMN 图的 JSON 表示法
The BPMN JSON representation uses a sequence of elements to describe the process. Each element is executed in order based on its position in the process array unless gateways (exclusive or parallel) specify branching paths. The following describes the structure of various BPMN elements supported by the system.BPMN JSON 表示法使用一系列元素来描述流程。除非网关(排他或并行)指定了分支路径,否则每个元素都会根据其在流程数组中的位置按顺序执行。以下描述了系统支持的各种 BPMN 元素的结构。
Tasks任务
Tasks represent activities within a process and are specified with the type field. The system supports three task types: general tasks, user tasks, and service tasks. When defining tasks, it is recommended to specify the specific task type (userTask or serviceTask) when possible.任务代表流程中的活动,通过 type 字段指定。系统支持三种任务类型:通用任务、用户任务和服务任务。定义任务时,建议尽可能指定具体的任务类型(userTask 或 serviceTask)。
{
"type": "task" | "userTask" | "serviceTask",
"id": String,
"label": String // short task description
}
Events事件
Events mark the beginning or end of a process. The system supports two event types: startEvent and endEvent. These events are critical for defining the boundaries of a workflow.事件标志着流程的开始或结束。系统支持两种事件类型:startEvent 和 endEvent。这些事件对于定义工作流的边界至关重要。
{
"type": "startEvent" | "endEvent",
"id": String,
"label": String // optional event label
}
Gateways网关
Gateways determine the flow of a process by introducing branching or parallel paths. Two types of gateways are supported: exclusive and parallel gateways.网关通过引入分支或并行路径来决定流程的流向。支持两种类型的网关:排他网关和并行网关。
Exclusive gateways allow for conditional branching based on specified conditions. Each branch contains a condition and an optional path array of elements executed if the condition is met.排他网关允许基于指定条件进行条件分支。每个分支包含一个条件和一个可选的路径数组,其中包含满足条件时执行的元素。
{
"type": "exclusiveGateway",
"id": String,
"label": String, // gateway label
"has_join": true | false, // whether the gateway merges branches
"branches": [
{
"condition": String, // condition for the branch
"path": [], // optional sequence of elements
"next": String // optional next element ID
}
]
}
Parallel gateways execute multiple branches simultaneously. Each branch is represented as an array of elements executed in parallel. Synchronization is automatically handled by the system, eliminating the need to define converging elements explicitly.并行网关同时执行多个分支。每个分支表示为一个并行执行的元素数组。同步由系统自动处理,无需显式定义收敛元素。
{
"type": "parallelGateway",
"id": String,
"branches": [
[], // branch 1 elements
[] // branch 2 elements
]
}
This structured JSON representation serves as the backbone of the BPMN Assistant, allowing for the accurate and efficient translation of user inputs into process models.这种结构化的 JSON 表示法是 BPMN Assistant 的骨干,允许将用户输入准确且高效地转换为流程模型。
For a more complete example of the BPMN JSON representation, please refer to the Appendix (Section A).有关 BPMN JSON 表示法的更完整示例,请参阅附录(A 节)。
3.6 Process Editing Functions3.6 流程编辑功能
The system supports a set of specialized functions for modifying BPMN diagrams. These functions, outlined in Table 4, enable precise control over process elements while maintaining the structural integrity of the diagram. When the LLM receives an editing request, it analyzes the natural language input and determines which function(s) to call to achieve the desired modifications.系统支持一组用于修改 BPMN 图的专用功能。这些功能(详见表 4)能够在保持图表结构完整性的同时,实现对流程元素的精确控制。当 LLM 收到编辑请求时,它会分析自然语言输入并确定调用哪些功能来实现所需的修改。
| Function | Parameters | Description |
| delete_element | element_id | Removes a specified element from the process |
| redirect_branch | branch_condition, next_id | Redirects a gateway branch to a new target element |
| add_element | element, before_id*, after_id* | Adds a new element at a specified position |
| move_element | element_id, before_id*, after_id* | Relocates an existing element within the process |
| update_element | new_element | Updates properties of an existing element |
| *Optional parameters, only one should be provided | ||
The LLM processes editing requests through a structured approach by first analyzing the user’s natural language request to understand the desired changes. It then identifies the affected elements in the current process and determines the appropriate editing functions required to achieve the requested modification. Once identified, the model generates the function calls with the correct parameters and ensures that the proposed changes maintain process integrity through validation.LLM 通过结构化方法处理编辑请求:首先分析用户的自然语言请求以理解所需更改,然后识别当前流程中受影响的元素,并确定实现请求修改所需的适当编辑功能。一旦识别出来,模型就会生成带有正确参数的函数调用,并通过验证确保所提出的更改保持流程的完整性。
Each editing function is designed to perform a specific type of modification while preserving the process’s logical flow. For example, when deleting an element, the system automatically handles the reconnection of surrounding elements to maintain process continuity. Similarly, when adding new elements, the system ensures proper integration with existing process flows.每个编辑功能都旨在执行特定类型的修改,同时保留流程的逻辑流。例如,在删除元素时,系统会自动处理周围元素的重新连接以保持流程的连续性。同样,在添加新元素时,系统会确保与现有流程流的正确集成。
The granular nature of these functions allows the LLM to decompose complex editing requests into a series of atomic operations. This approach enhances reliability and makes it easier to validate and verify changes before they are applied to the process model.这些功能的细粒度特性允许 LLM 将复杂的编辑请求分解为一系列原子操作。这种方法增强了可靠性,并使在将更改应用到流程模型之前更容易进行验证和核实。
4 Evaluation4 评估
The evaluation of BPMN Assistant focuses on assessing its accuracy through Graph Edit Distance (GED) and Relative Graph Edit Distance (RGED), two widely recognized metrics for measuring process model similarity [33, 34, 35]. Traditional GED methods often struggle with gateway semantics and execution probabilities, limiting their effectiveness in BPMN similarity measurements [36]. Schoknecht et al. [37] provide a comprehensive review of process model similarity techniques, emphasizing that hybrid approaches—integrating syntactic, semantic, and behavioral comparisons—tend to produce more reliable results. However, many of these methods require domain-specific adaptations to be effective for BPMN.BPMN Assistant 的评估重点是通过图编辑距离(GED)和相对图编辑距离(RGED)来评估其准确性,这两种指标是衡量流程模型相似度的公认标准 [33, 34, 35]。传统的 GED 方法通常难以处理网关语义和执行概率,限制了它们在 BPMN 相似度测量中的有效性 [36]。Schoknecht 等人 [37] 对流程模型相似度技术进行了全面综述,强调混合方法(整合句法、语义和行为比较)往往能产生更可靠的结果。然而,许多这些方法需要领域特定的适配才能对 BPMN 有效。
Our evaluation methodology deliberately focuses on structural and syntactic assessment through graph similarity measures. This approach was selected based on the research objectives of comparing intermediate representations for BPMN generation and modification. It is important to note that this evaluation does not encompass semantic evaluation approaches such as those based on Petri nets or conformance checking from process mining. Similarly, we do not focus on execution performance through simulation studies, nor do we conduct comprehensive usability evaluations. While these aspects represent valuable dimensions for assessing process modeling tools, they fall outside the scope of the current research, which primarily examines the efficacy of different representation approaches in generating structurally accurate BPMN diagrams from natural language descriptions. The selected evaluation metrics allow for direct comparison between JSON and XML approaches while providing insight into the structural correctness of the generated models.我们的评估方法论特意侧重于通过图相似度测量进行结构和句法评估。选择这种方法是基于比较 BPMN 生成和修改中间表示的研究目标。值得注意的是,此评估不包含基于 Petri 网或流程挖掘一致性检查等语义评估方法。同样,我们不侧重于通过模拟研究进行的执行性能评估,也不进行全面的易用性评估。虽然这些方面代表了评估流程建模工具的有价值维度,但它们超出了当前研究的范畴,本研究主要考察不同表示方法在从自然语言描述生成结构准确的 BPMN 图方面的功效。所选的评估指标允许在 JSON 和 XML 方法之间进行直接比较,同时深入了解生成模型的结构正确性。
4.1 Graph Edit Distance (GED) and Relative Graph Edit Distance (RGED)4.1 图编辑距离(GED)和相对图编辑距离(RGED)
GED quantifies the cost of transforming one BPMN diagram into another by counting the minimum number of graph edit operations (e.g., node insertion, deletion, or substitution) required. It is a fundamental metric for evaluating the accuracy of diagram generation and modifications.GED 通过计算将一个 BPMN 图转换为另一个图所需的最少图编辑操作(如节点插入、删除或替换)次数,来量化成本。它是评估图生成和修改准确性的基础指标。
RGED normalizes the GED by considering the complexity of the involved graphs. This metric allows for a relative comparison of diagram similarity, regardless of their absolute sizes, providing a more interpretable evaluation score.RGED 通过考虑相关图的复杂度对 GED 进行归一化。该指标允许对图的相似度进行相对比较,而无需考虑其绝对大小,从而提供了一个更具可解释性的评估分数。
| (1) |
| (2) |
To implement GED, we utilized the NetworkX Python library, which provides efficient algorithms for computing graph edit distance. Unlike prior approaches that rely on domain-specific heuristics or ML-based enhancements [35], our implementation applies standard GED operations to measure similarity between BPMN diagrams.为了实现 GED,我们利用了 NetworkX Python 库,它提供了计算图编辑距离的高效算法。与依赖领域特定启发式或基于机器学习增强的先前方法 [35] 不同,我们的实现应用标准 GED 操作来衡量 BPMN 图之间的相似度。
While our evaluation focuses on structural similarity using GED and RGED, these metrics inherently reflect aspects of usability and clarity when compared against human-generated BPMN models. However, they do not explicitly capture higher-level qualitative factors such as readability, model simplicity, or semantic coherence, which are emphasized in studies like those by Huang and Kumar [38] and Pavlicek et al. [39].虽然我们的评估侧重于使用 GED 和 RGED 的结构相似性,但当与人工生成的 BPMN 模型进行比较时,这些指标本质上反映了易用性和清晰度。然而,它们并没有明确捕捉到更高层面的定性因素,如可读性、模型简洁性或语义连贯性,这些因素在 Huang 和 Kumar [38] 以及 Pavlicek 等人 [39] 的研究中得到了强调。
4.2 Comparison with Baseline XML Editing4.2 与基准 XML 编辑的比较
To establish the effectiveness of BPMN Assistant, we conducted a comparative analysis between our JSON-based BPMN representation and direct XML manipulation through language model prompting. The baseline method involves prompting the model to directly generate or modify BPMN XML specifications, which are then rendered into diagrams.为了确定 BPMN Assistant 的有效性,我们对我们的 JSON 格式 BPMN 表示法与通过语言模型提示进行直接 XML 操作的方法进行了对比分析。基准方法涉及提示模型直接生成或修改 BPMN XML 规范,然后将其渲染为图表。
For this comparison, we selected a representative set of diagram modification tasks and executed them using both representations. We evaluated the approaches using RGED and its derived similarity score, as defined in Equations (1) and (2).为了进行此比较,我们选择了一组具有代表性的图修改任务,并使用两种表示法执行它们。我们使用 RGED 及其派生的相似度得分(如公式 (1) 和 (2) 所定义)评估了这些方法。
4.3 Generation Accuracy4.3 生成准确性
The comparative analysis revealed that our JSON-based representation achieved an average similarity score of 0.70 compared to 0.69 for direct XML generation. While this indicates a slight numerical advantage for JSON, the difference is minimal, suggesting that both representations perform similarly in terms of structural accuracy. However, JSON demonstrated greater reliability, with fewer total failures across models.对比分析显示,我们的 JSON 表示法实现了 0.70 的平均相似度得分,而直接 XML 生成为 0.69。虽然这表明 JSON 在数值上略有优势,但差异极小,表明两种表示法在结构准确性方面表现相当。然而,JSON 显示出更高的可靠性,模型总失败次数更少。
| Model | JSON | XML | Failures (JSON) | Failures (XML) |
|---|---|---|---|---|
| GPT-4o mini | 0.67 | 0.67 | 0 | 1 |
| GPT-4o | 0.71 | 0.68 | 0 | 0 |
| o3-mini | 0.72 | 0.69 | 0 | 0 |
| Claude 3.5 Sonnet | 0.72 | 0.72 | 0 | 0 |
| Gemini 2.0 Flash | 0.70 | 0.66 | 0 | 0 |
| Llama 3.3 70B Instruct | 0.68 | 0.70 | 0 | 4 |
| Qwen 2.5 72B Instruct | 0.69 | 0.72 | 2 | 6 |
| Deepseek V3 | 0.72 | 0.69 | 0 | 1 |
| Modality | Average Score | Total Failures |
|---|---|---|
| JSON | 0.70 | 2 |
| XML | 0.69 | 12 |
Beyond similarity scores, JSON also outperformed XML in terms of efficiency. As shown in Table 7 and illustrated in Figure 3, JSON-based BPMN generation was significantly faster, with a mean latency of 14.41 seconds compared to 24.07 seconds for XML. Additionally, as depicted in Figure 4, JSON required more input tokens (2604.34 vs. 466.79 on average) but produced more concise outputs (849.29 vs. 1834.55 tokens). This trade-off suggests that JSON requires a richer input prompt but benefits from reduced processing time and smaller outputs, making it more efficient overall.除了相似度得分外,JSON 在效率方面也优于 XML。如表 7 和图 3 所示,基于 JSON 的 BPMN 生成速度显著更快,平均延迟为 14.41 秒,而 XML 为 24.07 秒。此外,如图 4 所示,JSON 需要更多的输入 Token(平均 2604.34 vs. 466.79),但产生的输出更简洁(849.29 vs. 1834.55 Tokens)。这种权衡表明,JSON 需要更丰富的输入提示,但得益于更短的处理时间和更小的输出,总体效率更高。
| Metric | JSON | XML |
|---|---|---|
| Mean Latency (seconds) | 14.41 | 24.07 |
| Average Input Tokens | 2604.34 | 466.79 |
| Average Output Tokens | 849.29 | 1834.55 |
4.4 Editing Capabilities4.4 编辑能力
In addition to diagram generation, we evaluated the models’ ability to interpret natural language editing instructions and perform the requested modifications. For this evaluation, we used a binary success/fail metric, as editing tasks involve correctly understanding the request and applying appropriate modifications to an existing diagram.除了图生成外,我们还评估了模型解释自然语言编辑指令并执行请求修改的能力。在此评估中,我们使用了二元成功/失败指标,因为编辑任务涉及正确理解请求并将适当的修改应用于现有图表。
To determine validity, we implemented a Python-based validation function that checked whether the generated BPMN structure adhered to syntactic constraints. If a modification resulted in an invalid BPMN diagram, it was automatically marked as a failure. For valid outputs, an additional verification step assessed whether the requested edit had been correctly applied. This evaluation involved both automated checks and manual review to ensure accuracy.为了确定有效性,我们实现了一个基于 Python 的验证函数,用于检查生成的 BPMN 结构是否符合句法约束。如果修改导致 BPMN 图无效,则自动标记为失败。对于有效输出,额外的验证步骤会评估请求的编辑是否已正确应用。此评估涉及自动化检查和人工审查,以确保准确性。
The results, summarized in Table 8, show that models consistently achieved higher success rates when using our JSON-based approach compared to direct XML manipulation. JSON-based edits were more reliably executed across all tested models, likely due to the structured nature of JSON, which facilitates clearer representation of modifications.如表 8 所示,结果表明,与直接 XML 操作相比,模型在使用我们基于 JSON 的方法时始终实现了更高的成功率。基于 JSON 的编辑在所有测试模型中执行得更可靠,这可能是因为 JSON 的结构化特性促进了对修改的更清晰表示。
| Model | JSON | XML |
|---|---|---|
| GPT-4o mini | 0.45 | 0.05 |
| GPT-4o | 0.55 | 0.30 |
| o3-mini | 0.65 | 0.53 |
| Claude 3.5 Sonnet | 0.68 | 0.65 |
| Gemini 2.0 Flash | 0.45 | 0.33 |
| Llama 3.3 70B Instruct | 0.38 | 0.30 |
| Qwen 2.5 72B Instruct | 0.38 | 0.25 |
| Deepseek V3 | 0.50 | 0.08 |
Figure 5 provides a visual representation of these results, reinforcing the observed performance gap between JSON and XML approaches.图 5 提供了这些结果的直观表示,强化了 JSON 和 XML 方法之间观察到的性能差距。
Our performance analysis also revealed substantial differences between JSON and XML approaches across both latency and token utilization metrics. As shown in Table 9, the JSON-based approach demonstrated significantly faster average processing times, requiring 21.46 seconds compared to 46.98 seconds for XML generation.我们的性能分析还揭示了 JSON 和 XML 方法在延迟和 Token 利用率指标上的巨大差异。如表 9 所示,基于 JSON 的方法表现出显著更快的平均处理时间,需要 21.46 秒,而 XML 生成需要 46.98 秒。
Token usage patterns showed an inverse relationship between input and output requirements for the two approaches. JSON-based generation demanded higher input token counts, averaging 19,567.70 tokens compared to XML’s 5,102.74 tokens. However, this was offset by more compact outputs, with JSON generating an average of 364.14 tokens compared to XML’s 2,665.32 tokens.Token 使用模式显示,两种方法的输入和输出需求之间存在反比关系。基于 JSON 的生成需要更高的输入 Token 计数,平均为 19,567.70 个,而 XML 为 5,102.74 个。然而,这被更紧凑的输出所抵消,JSON 平均生成 364.14 个 Token,而 XML 为 2,665.32 个。
| Metric | JSON | XML |
|---|---|---|
| Average Latency (s) | 21.46 | 46.98 |
| Average Input Tokens | 19,567.70 | 5,102.74 |
| Average Output Tokens | 364.14 | 2,665.32 |
These performance characteristics suggest a clear trade-off between the approaches: while JSON requires more substantial input context, it achieves faster processing times and produces more concise outputs. The higher input token requirement of the JSON approach is offset by its reduced latency and more manageable output sizes, potentially offering better responsiveness in real-world BPMN editing scenarios. When combined with the higher editing success rates previously discussed, these performance metrics further support the advantages of the JSON-based approach for practical BPMN manipulation tasks.这些性能特征表明两种方法之间存在明确的权衡:虽然 JSON 需要更实质性的输入上下文,但它实现了更快的处理时间并产生更简洁的输出。JSON 方法较高的输入 Token 需求被其减少的延迟和更易于管理的输出大小所抵消,这可能在现实世界的 BPMN 编辑场景中提供更好的响应能力。结合前面讨论的更高的编辑成功率,这些性能指标进一步支持了 JSON 方法在实际 BPMN 操作任务中的优势。
5 Discussion5 讨论
Our evaluation demonstrates that the JSON-based representation consistently outperforms direct XML manipulation across multiple metrics. Higher success rates in editing tasks (Table 8) suggest that structured intermediate representations are particularly valuable for complex model modifications. Performance differences between models indicate that model selection significantly impacts system effectiveness, with Claude 3.5 Sonnet and o3-mini showing particularly strong performance.我们的评估表明,基于 JSON 的表示方法在多项指标上均持续优于直接操作 XML。在编辑任务中更高的成功率(表 8)表明,结构化的中间表示对于复杂的模型修改尤为重要。模型间的性能差异显示,模型选择对系统效能有着显著影响,其中 Claude 3.5 Sonnet 和 o3-mini 表现尤为出色。
The inverse relationship between input and output token usage in the JSON versus XML approaches (Table 9) reveals interesting trade-offs that likely favor the JSON approach. Although the JSON approach requires more context in the prompts, it produces more concise output and faster processing times. This combination is particularly advantageous since input tokens typically cost less than output tokens, making the JSON approach potentially more cost-effective despite using more prompt tokens.JSON 方法与 XML 方法在输入和输出 Token 使用量上的反向关系(表 9)揭示了有趣的权衡,且结果很可能更有利于 JSON 方法。尽管 JSON 方法在提示词中需要更多的上下文,但它能生成更简洁的输出并缩短处理时间。这种组合优势明显,因为输入 Token 的成本通常低于输出 Token,这使得 JSON 方法尽管使用了更多的提示词 Token,但在成本上可能更具优势。
Importantly, BPMN Assistant is designed to make business process modeling more accessible to users without a technical background. Instead of requiring knowledge of specialized diagramming tools or technical formats like XML, users can simply describe a process in natural language. The system then automatically generates a professional diagram based on this description. This reduces the need for technical expertise, allowing business professionals to contribute directly to process design and updates, which can lead to more accurate and timely documentation.重要的是,BPMN Assistant 的设计初衷是让没有技术背景的用户也能更轻松地进行业务流程建模。用户无需掌握专业的绘图工具或 XML 等技术格式,只需用自然语言描述流程即可。系统会根据该描述自动生成专业的图表。这降低了对技术专长的需求,使业务专业人员能够直接参与流程的设计与更新,从而获得更准确、更及时的文档。
The system’s ability to handle natural language editing commands has significant implications for process modeling workflows. The high success rates for editing tasks suggest that BPMN Assistant could reduce the technical barriers to process model maintenance, potentially leading to more accurate and up-to-date process documentation in practice.系统处理自然语言编辑指令的能力对流程建模工作流具有重要意义。编辑任务的高成功率表明,BPMN Assistant 可以降低流程模型维护的技术门槛,从而在实践中实现更准确、更及时的流程文档化。
Unlike previous tools such as BPMN-Chatbot [19] and ProMoAI [20], our system emphasizes model modification capabilities in addition to generation. A structured JSON representation offers advantages over both direct XML manipulation and alternative graph representations, such as the Graphviz DOT language 11 1 https://graphviz.org/doc/info/lang.html, particularly in maintaining BPMN standard compliance and supporting complex editing operations.与 BPMN-Chatbot [19] 和 ProMoAI [20] 等过往工具不同,我们的系统在强调模型生成的同时,也突出了模型修改的能力。结构化的 JSON 表示形式相比直接操作 XML 或其他图表表示形式(如 Graphviz DOT 语言)具有明显优势,尤其是在保持 BPMN 标准合规性和支持复杂编辑操作方面。
Although our approach shows promise, several challenges remain. The dependency on LLM quality affects system reliability, and the current implementation’s limited support for BPMN elements restricts its application in complex scenarios. Additionally, the higher input token requirements of our JSON-based approach may impact costs in high-volume applications.尽管我们的方法前景广阔,但仍面临诸多挑战。对大语言模型(LLM)质量的依赖影响了系统的可靠性,且当前实现对 BPMN 元素的支持有限,限制了其在复杂场景中的应用。此外,基于 JSON 的方法对输入 Token 的高需求可能会影响在大规模应用中的成本。
6 Limitations and Future Work6 局限性与未来工作
BPMN Assistant, while demonstrating promising results, has several limitations that should be acknowledged. A key limitation is the support for only a subset of BPMN elements (general tasks, user tasks, service tasks, exclusive gateways, parallel gateways, start events, and end events), which restricts the complexity of processes that can be modeled. However, since the focus of this work is on executable process models rather than collaboration diagrams, the absence of pools and lanes does not significantly impact our primary research objectives.虽然 BPMN Assistant 展现了令人期待的结果,但仍存在一些应予以承认的局限性。一个主要局限是对 BPMN 元素的支持仅限于子集(常规任务、用户任务、服务任务、排他网关、并行网关、开始事件和结束事件),这限制了可建模流程的复杂度。然而,由于本研究的重点在于可执行流程模型而非协作图,因此缺乏池(Pool)和泳道(Lane)并不显著影响我们的主要研究目标。
Due to the lack of semantic evaluation, the results should be considered experimental, as there is no guarantee that the business logic will be correctly integrated into the generated models. This limitation is particularly relevant when assessing the practical applicability of the generated diagrams in real-world scenarios.由于缺乏语义评估,研究结果应被视为实验性的,因为无法保证业务逻辑能被正确集成到生成的模型中。在评估生成图表在现实场景中的实际适用性时,这一局限性尤为关键。
The performance of BPMN Assistant is heavily dependent on the underlying LLM. Our evaluation revealed significant variations in performance across different models, with Claude 3.5 Sonnet and o3-mini showing particularly strong results. Further investigation into the specific capabilities and limitations of different LLMs in the context of process modeling would provide valuable insights for future improvements.BPMN Assistant 的性能在很大程度上取决于底层 LLM。我们的评估显示,不同模型间的性能差异显著,其中 Claude 3.5 Sonnet 和 o3-mini 的表现尤为强劲。深入探究不同 LLM 在流程建模背景下的具体能力与局限性,将为未来的改进提供宝贵的见解。
Human-computer interaction (HCI) studies would be necessary to properly evaluate the usability of the system for non-technical users. While BPMN Assistant aims to lower the barrier to process modeling through natural language interaction, comprehensive user studies would be required to validate this claim.若要恰当评估系统对非技术用户的易用性,人机交互(HCI)研究是必不可少的。尽管 BPMN Assistant 旨在通过自然语言交互降低流程建模的门槛,但仍需进行全面的用户研究来验证这一主张。
Another area of concern is the reliance on clear and unambiguous natural language input. Users might encounter difficulties in achieving this clarity, especially in multilingual or context-specific scenarios where language and terminology nuances can introduce ambiguity.另一个令人关注的领域是对清晰且无歧义的自然语言输入的依赖。用户在实现这种清晰度时可能会遇到困难,特别是在多语言或特定上下文的场景中,语言和术语的细微差别可能会引入歧义。
It is important to note that this work deliberately does not focus on semantic evaluation (e.g., using Petri nets) or conformance checking (e.g., process mining techniques), performance and execution time analysis (e.g., simulation studies), or comprehensive usability evaluation. The approach used in this research was selected considering the research objectives, the method of model generation, and existing evaluation methods cited in the literature. Future work could address these limitations by expanding the range of supported BPMN elements, incorporating semantic evaluation techniques, conducting usability studies, and optimizing the system for specific LLMs based on their strengths in process modeling tasks.需要指出的是,本研究特意未将重点放在语义评估(例如使用 Petri 网)、一致性检查(例如流程挖掘技术)、性能与执行时间分析(例如模拟研究)或全面的易用性评估上。本研究采用的方法是基于研究目标、模型生成方式以及文献中引用的现有评估方法而选定的。未来的工作可以通过扩展所支持的 BPMN 元素范围、结合语义评估技术、开展易用性研究,以及根据不同 LLM 在流程建模任务中的优势进行针对性优化,来解决这些局限性。
7 Conclusion7 结论
This paper presented BPMN Assistant, a novel approach to business process modeling that leverages Large Language Models to bridge the gap between natural language descriptions and formal BPMN representations. Through comprehensive evaluation, we demonstrated that our JSON-based representation for BPMN diagrams outperforms direct XML manipulation across multiple key metrics. In generation tasks, the JSON approach achieved lower latency with an average processing time of 14.41 seconds compared to 24.07 seconds for XML generation, while maintaining comparable model quality with an average similarity score of 0.70.本文介绍了 BPMN Assistant,这是一种利用大语言模型弥合自然语言描述与正式 BPMN 表示之间差距的业务流程建模新方法。通过全面评估,我们证明了基于 JSON 的 BPMN 图表表示方法在多项关键指标上均优于直接操作 XML。在生成任务中,JSON 方法实现了更低的延迟,平均处理时间为 14.41 秒,而 XML 生成则为 24.07 秒,同时保持了相当的模型质量,平均相似度得分为 0.70。
The evaluation results particularly highlight the effectiveness of our JSON-based representation in editing tasks, where it achieved consistently higher success rates across all tested models compared to XML-based editing, with editing operations taking an average of 21.46 seconds compared to 46.98 seconds for XML manipulation. While the JSON approach requires higher input token counts, this is offset by significantly more compact outputs, averaging 364.14 tokens compared to XML’s 2,665.32 tokens. These findings suggest that structured intermediate representations can enhance the reliability and efficiency of LLM-based process modeling tools.评估结果尤为突出了基于 JSON 的表示方法在编辑任务中的有效性。在所有测试模型中,该方法在编辑任务上的成功率均持续高于基于 XML 的编辑,且编辑操作平均耗时 21.46 秒,而 XML 操作则需 46.98 秒。尽管 JSON 方法需要更多的输入 Token,但其输出明显更为紧凑,平均为 364.14 个 Token,而 XML 则为 2,665.32 个 Token。这些发现表明,结构化的中间表示可以提升基于 LLM 的流程建模工具的可靠性和效率。
Despite these achievements, our work also reveals important areas for future research. The current limitations in supporting only a subset of BPMN elements indicate opportunities for expanding the system’s capabilities, particularly for modeling more complex executable processes. Additionally, the varying performance across different LLMs suggests potential benefits from model-specific optimization approaches.尽管取得了这些成就,我们的研究也揭示了未来研究的重要领域。目前对 BPMN 元素支持不足的局限性表明,在扩展系统功能方面仍有空间,特别是在建模更复杂的可执行流程方面。此外,不同 LLM 之间性能的差异表明,采用模型特定的优化方法可能带来潜在益处。
In broader terms, this research represents a significant step toward making business process modeling more accessible to a wider audience. By enabling natural language interaction with process modeling tools, BPMN Assistant reduces the technical knowledge required to create and modify business process diagrams. This accessibility has potential implications beyond technical efficiency gains, as it could foster better communication between technical and non-technical stakeholders in organizations. When business experts can directly interact with modeling tools using everyday language, they may become more engaged in the process modeling activities, potentially leading to more accurate process documentation and improved alignment between business needs and implemented processes. The natural language approach also opens possibilities for process modeling in educational contexts, where students can focus on understanding process concepts rather than mastering technical modeling interfaces.从更广泛的角度来看,这项研究代表了向大众普及业务流程建模迈出的重要一步。通过支持流程建模工具的自然语言交互,BPMN Assistant 降低了创建和修改业务流程图所需的技术知识要求。这种易用性带来的影响不仅限于技术效率的提升,还可能促进组织内技术人员与非技术利益相关者之间的沟通。当业务专家能够使用日常语言直接与建模工具交互时,他们可能会更积极地参与流程建模活动,从而可能带来更准确的流程文档,并改善业务需求与已实施流程之间的一致性。自然语言方法也为教育场景中的流程建模开启了可能性,学生可以专注于理解流程概念,而非纠结于掌握复杂的技术建模界面。
Looking ahead, future work could focus on expanding support for additional BPMN elements to enable modeling of more complex executable processes. The significant performance variations observed across different LLMs also suggest opportunities for developing specialized prompt engineering techniques for process modeling tasks. These improvements would further enhance the practical applicability of LLM-based process modeling tools in enterprise settings.展望未来,后续工作可聚焦于扩展对更多 BPMN 元素的支持,以实现对更复杂可执行流程的建模。在不同 LLM 中观察到的显著性能差异也表明,开发针对流程建模任务的专业提示工程技术大有可为。这些改进将进一步增强基于 LLM 的流程建模工具在企业环境中的实际适用性。
References参考文献
- [1] Michael Rosemann. Potential pitfalls of process modeling: Part A. Business Process Management Journal, 12:377–384, May 2006. [1] Michael Rosemann. 流程建模的潜在陷阱:A 部分。《业务流程管理杂志》,12:377–384,2006 年 5 月。
- [2] Jan Recker. Opportunities and constraints: The current struggle with BPMN. Business Process Management Journal, 16(1):181–201, 2010. [2] Jan Recker. 机遇与约束:当前 BPMN 面临的困境。《业务流程管理杂志》,16(1):181–201,2010 年。
- [3] Samgwa Quintine Njanka, Godavari Sandula, and Ricardo Colomo-Palacios. IT-Business Alignment: A Systematic Literature Review. Procedia Computer Science, 181:333–340, January 2021. [3] Samgwa Quintine Njanka, Godavari Sandula, and Ricardo Colomo-Palacios. IT 与业务对齐:系统性文献综述。《计算机科学评论》,181:333–340,2021 年 1 月。
- [4] Han van der Aa, Henrik Leopold, Felix Mannhardt, and Hajo A. Reijers. On the Fragmentation of Process Information: Challenges, Solutions, and Outlook. In Khaled Gaaloul, Rainer Schmidt, Selmin Nurcan, Sérgio Guerreiro, and Qin Ma, editors, Enterprise, Business-Process and Information Systems Modeling, pages 3–18, Cham, 2015. Springer International Publishing. [4] Han van der Aa, Henrik Leopold, Felix Mannhardt, and Hajo A. Reijers. 关于流程信息的碎片化:挑战、解决方案与展望。收录于:Khaled Gaaloul 等编辑,《企业、业务流程与信息系统建模》,第 3–18 页,Cham,2015 年。Springer International Publishing 出版。
- [5] Patrizio Bellan, M. Dragoni, and Chiara Ghidini. A Qualitative Analysis of the State of the Art in Process Extraction from Text. In DP@AI*IA, pages 19–30, 2020. [5] Patrizio Bellan, M. Dragoni, and Chiara Ghidini. 文本流程提取技术现状的定性分析。收录于:DP@AI*IA,第 19–30 页,2020 年。
- [6] Fernanda Araujo Baião, Flávia Maria Santoro, and João Carlos de A. R. Gonçalves. Let Me Tell You a Story - On How to Build Process Models. Journal of Universal Computer Science, 2011. [6] Fernanda Araujo Baião, Flávia Maria Santoro, and João Carlos de A. R. Gonçalves. 让我给你讲个故事——关于如何构建流程模型。《通用计算机科学杂志》,2011 年。
- [7] Barbara Weber, Manuel Neurauter, Jakob Pinggera, Stefan Zugal, Marco Furtner, Markus Martini, and Pierre Sachse. Measuring Cognitive Load During Process Model Creation. In Fred D. Davis, René Riedl, Jan vom Brocke, Pierre-Majorique Léger, and Adriane B. Randolph, editors, Information Systems and Neuroscience, pages 129–136, Cham, 2015. Springer International Publishing. [7] Barbara Weber 等. 流程模型创建过程中的认知负荷测量。收录于:Fred D. Davis 等编辑,《信息系统与神经科学》,第 129–136 页,Cham,2015 年。Springer International Publishing 出版。
- [8] Eskedar Gizat Desalegn, Maria João Coelho Guedes, Jorge Filipe Da Silva Gomes, and Shiferaw Mitiku Tebeka. Disentangling organizational agility from flexibility, adaptability, and versatility: A systematic review. Future Business Journal, 10(1):117, November 2024. [8] Eskedar Gizat Desalegn 等. 将组织敏捷性与灵活性、适应性和通用性区分开来:系统性综述。《未来商业杂志》,10(1):117,2024 年 11 月。
- [9] Henrik Leopold, Jan Mendling, and Oliver Günther. Learning from Quality Issues of BPMN Models from Industry. IEEE Software, 33(4):26–33, July 2016. [9] Henrik Leopold, Jan Mendling, and Oliver Günther. 从工业 BPMN 模型的质量问题中学习。《IEEE 软件》,33(4):26–33,2016 年 7 月。
- [10] W.M.P. Van Der Aalst and A.J.M.M. Weijters. Process mining: A research agenda. Computers in Industry, 53(3):231–244, April 2004. [10] W.M.P. Van Der Aalst and A.J.M.M. Weijters. 流程挖掘:研究议程。《工业计算机》,53(3):231–244,2004 年 4 月。
- [11] Fabian Friedrich, Jan Mendling, and Frank Puhlmann. Process Model Generation from Natural Language Text. In Haralambos Mouratidis and Colette Rolland, editors, Advanced Information Systems Engineering, pages 482–496, Berlin, Heidelberg, 2011. Springer. [11] Fabian Friedrich, Jan Mendling, and Frank Puhlmann. 从自然语言文本生成流程模型。收录于:Haralambos Mouratidis 和 Colette Rolland 编辑,《高级信息系统工程》,第 482–496 页,柏林/海德堡,2011 年。Springer 出版。
- [12] Henrik Leopold, Jan Mendling, and Artem Polyvyanyy. Generating Natural Language Texts from Business Process Models. In Jolita Ralyté, Xavier Franch, Sjaak Brinkkemper, and Stanislaw Wrycza, editors, Advanced Information Systems Engineering, pages 64–79, Berlin, Heidelberg, 2012. Springer. [12] Henrik Leopold, Jan Mendling, and Artem Polyvyanyy. 从业务流程模型生成自然语言文本。收录于:Jolita Ralyté 等编辑,《高级信息系统工程》,第 64–79 页,柏林/海德堡,2012 年。Springer 出版。
- [13] Jan Mendling, Henrik Leopold, and Lucineia Heloisa Thom. Natural Language Processing with Process Models (NLP4RE Report Paper). In REFSQ Workshops 2019, pages 1–5, 2019. [13] Jan Mendling, Henrik Leopold, and Lucineia Heloisa Thom. 流程模型的自然语言处理(NLP4RE 报告论文)。收录于:REFSQ 研讨会 2019,第 1–5 页,2019 年。
- [14] Michael Grohs, Luka Abb, Nourhan Elsayed, and Jana-Rebecca Rehse. Large Language Models Can Accomplish Business Process Management Tasks. In Jochen De Weerdt and Luise Pufahl, editors, Business Process Management Workshops, pages 453–465, Cham, 2024. Springer Nature Switzerland. [14] Michael Grohs 等. 大语言模型可以完成业务流程管理任务。收录于:Jochen De Weerdt 和 Luise Pufahl 编辑,《业务流程管理研讨会》,第 453–465 页,Cham,2024 年。Springer Nature Switzerland 出版。
- [15] Timotheus Kampik, Christian Warmuth, Adrian Rebmann, Ron Agam, Lukas N. P. Egger, Andreas Gerber, Johannes Hoffart, Jonas Kolk, Philipp Herzig, Gero Decker, Han van der Aa, Artem Polyvyanyy, Stefanie Rinderle-Ma, Ingo Weber, and Matthias Weidlich. Large Process Models: Business Process Management in the Age of Generative AI. KI – Künstliche Intelligenz, 2024. [15] Timotheus Kampik 等. 大型流程模型:生成式 AI 时代的业务流程管理。《KI – 人工智能》,2024 年。
- [16] Ahmed Ali Linkon, Mujiba Shaima, Md Shohail Uddin Sarker, Badruddowza, Norun Nabi, Md Nasir Uddin Rana, Sandip Kumar Ghosh, Mohammad Anisur Rahman, Hammed Esa, and Faiaz Rahat Chowdhury. Advancements and Applications of Generative Artificial Intelligence and Large Language Models on Business Management: A Comprehensive Review. Journal of Computer Science and Technology Studies, 6(1):225–232, March 2024. [16] Ahmed Ali Linkon 等. 生成式人工智能和大语言模型在业务管理中的进展与应用:综合综述。《计算机科学与技术研究杂志》,6(1):225–232,2024 年 3 月。
- [17] Nataliia Klievtsova, Janik-Vasily Benzin, Timotheus Kampik, Juergen Mangler, and Stefanie Rinderle-Ma. Conversational process modeling: Can generative AI empower domain experts in creating and redesigning process models? arXiv preprint arXiv:2304.11065, 2023. [17] Nataliia Klievtsova 等. 对话式流程建模:生成式 AI 能否赋能领域专家创建和重新设计流程模型?arXiv 预印本 arXiv:2304.11065,2023 年。
- [18] Adrian Rebmann, Fabian David Schmidt, Goran Glavaš, and Han Van Der Aa. Evaluating the Ability of LLMs to Solve Semantics-Aware Process Mining Tasks. 2024 6th International Conference on Process Mining (ICPM), pages 9–16, October 2024. [18] Adrian Rebmann 等. 评估 LLM 解决语义感知流程挖掘任务的能力。2024 年第六届国际流程挖掘会议 (ICPM),第 9–16 页,2024 年 10 月。
- [19] Julius Köpke and Aya Safan. Introducing the BPMN-Chatbot for Efficient LLM-Based Process Modeling. In International Conference on Business Process Management, pages 1–5, 2024. [19] Julius Köpke and Aya Safan. 引入用于高效 LLM 驱动流程建模的 BPMN-Chatbot。收录于:《国际业务流程管理会议》,第 1–5 页,2024 年。
- [20] Humam Kourani, Alessandro Berti, Daniel Schuster, and Wil M.P. Van Der Aalst. ProMoAI: Process Modeling with Generative AI. In Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence, pages 8708–8712, Jeju, South Korea, August 2024. International Joint Conferences on Artificial Intelligence Organization. [20] Humam Kourani 等. ProMoAI:基于生成式 AI 的流程建模。收录于:《第三十三届国际人工智能联合会议论文集》,第 8708–8712 页,韩国济州,2024 年 8 月。国际人工智能联合会议组织。
- [21] Alessandro Berti and Mahnaz Sadat Qafari. Leveraging Large Language Models (LLMs) for Process Mining (Technical Report), July 2023. [21] Alessandro Berti and Mahnaz Sadat Qafari. 利用大语言模型 (LLM) 进行流程挖掘(技术报告),2023 年 7 月。
- [22] Humam Kourani, Alessandro Berti, Daniel Schuster, and Wil M. P. van der Aalst. Process Modeling With Large Language Models. In Enterprise, Business-Process and Information Systems Modeling, volume 511, pages 229–244. Springer, Cham, 2024. [22] Humam Kourani 等. 使用大语言模型进行流程建模。收录于:《企业、业务流程与信息系统建模》,第 511 卷,第 229–244 页。Springer, Cham,2024 年。
- [23] Renato César Borges Ferreira, Lucinéia Heloisa Thom, and Marcelo Fantinato. A Semi-automatic Approach to Identify Business Process Elements in Natural Language Texts:. In Proceedings of the 19th International Conference on Enterprise Information Systems, pages 250–261, Porto, Portugal, 2017. SCITEPRESS - Science and Technology Publications. [23] Renato César Borges Ferreira 等. 一种识别自然语言文本中业务流程元素的半自动方法。收录于:《第 19 届国际企业信息系统会议论文集》,第 250–261 页,葡萄牙波尔图,2017 年。SCITEPRESS - 科学与技术出版。
- [24] Julian Neuberger, Lars Ackermann, Han van der Aa, and Stefan Jablonski. A Universal Prompting Strategy for Extracting Process Model Information from Natural Language Text using Large Language Models. In Conceptual Modeling: 43rd International Conference, ER 2024, pages 38–55, 2025. [24] Julian Neuberger 等. 使用大语言模型从自然语言文本中提取流程模型信息的通用提示策略。收录于:《概念建模:第 43 届国际会议,ER 2024》,第 38–55 页,2025 年。
- [25] Kiran Busch, Alexander Rochlitzer, Diana Sola, and Henrik Leopold. Just Tell Me: Prompt Engineering in Business Process Management, April 2023. [25] Kiran Busch 等. 告诉我:业务流程管理中的提示工程,2023 年 4 月。
- [26] Humam Kourani, Alessandro Berti, Daniel Schuster, and Wil M. P. van der Aalst. Evaluating Large Language Models on Business Process Modeling: Framework, Benchmark, and Self-Improvement Analysis. Software and Systems Modeling, 2024. [26] Humam Kourani 等. 评估大语言模型在业务流程建模中的表现:框架、基准与自我改进分析。《软件与系统建模》,2024 年。
- [27] Patrizio Bellan, Mauro Dragoni, Chiara Ghidini, Han van der Aa, and Simone Paolo Ponzetto. Process Extraction from Text: Benchmarking the State of the Art and Paving the Way for Future Challenges, October 2023. [27] Patrizio Bellan 等. 从文本中提取流程:基准测试现状并为未来挑战铺平道路,2023 年 10 月。
- [28] Quentin Nivon and Gwen Salaün. Automated Generation of BPMN Processes from Textual Requirements. In Walid Gaaloul, Michael Sheng, Qi Yu, and Sami Yangui, editors, Service-Oriented Computing, pages 185–201, Singapore, 2025. Springer Nature. [28] Quentin Nivon and Gwen Salaün. 从文本需求中自动生成 BPMN 流程。收录于:Walid Gaaloul 等编辑,《面向服务的计算》,第 185–201 页,新加坡,2025 年。Springer Nature 出版。
- [29] OpenAI et al. GPT-4o System Card, October 2024. [29] OpenAI 等. GPT-4o 系统卡,2024 年 10 月。
- [30] Aaron Grattafiori and et al. The Llama 3 Herd of Models, November 2024. [30] Aaron Grattafiori 等. Llama 3 模型系列,2024 年 11 月。
- [31] Qwen et al. Qwen2.5 Technical Report, January 2025. [31] Qwen 等. Qwen2.5 技术报告,2025 年 1 月。
- [32] DeepSeek-AI et al. DeepSeek-V3 Technical Report, December 2024. [32] DeepSeek-AI 等. DeepSeek-V3 技术报告,2024 年 12 月。
- [33] Josip Tomo Licardo, Nikola Tanković, and Darko Etinger. A Method for Extracting BPMN Models from Textual Descriptions Using Natural Language Processing. Procedia Computer Science, 239:483–490, January 2024. [33] Josip Tomo Licardo 等. 使用自然语言处理从文本描述中提取 BPMN 模型的方法。《计算机科学评论》,239:483–490,2024 年 1 月。
- [34] Remco Dijkman, Marlon Dumas, and Luciano García-Bañuelos. Graph Matching Algorithms for Business Process Model Similarity Search. In Umeshwar Dayal, Johann Eder, Jana Koehler, and Hajo A. Reijers, editors, Business Process Management, volume 5701, pages 48–63, Berlin, Heidelberg, 2009. Springer Berlin Heidelberg. [34] Remco Dijkman 等. 用于业务流程模型相似性搜索的图匹配算法。收录于:Umeshwar Dayal 等编辑,《业务流程管理》,第 5701 卷,第 48–63 页,柏林/海德堡,2009 年。Springer Berlin Heidelberg 出版。
- [35] Abid Sohail, Ammar Haseeb, Mobashar Rehman, Dhanapal Durai Dominic, and Muhammad Arif Butt. An Intelligent Graph Edit Distance-Based Approach for Finding Business Process Similarities. Computers, Materials & Continua, 69(3):3603–3618, 2021. [35] Abid Sohail 等. 一种基于智能图编辑距离的业务流程相似性查找方法。《计算机、材料与连续体》,69(3):3603–3618,2021 年。
- [36] Indra Waspada and Riyanarto Sarno. An Improved Method of Graph Edit Distance for Business Process Model Similarity Measurement. In 2020 4th International Conference on Informatics and Computational Sciences (ICICoS), pages 1–6, November 2020. [36] Indra Waspada and Riyanarto Sarno. 一种改进的业务流程模型相似性度量图编辑距离方法。收录于:2020 年第四届信息与计算科学国际会议 (ICICoS),第 1–6 页,2020 年 11 月。
- [37] Andreas Schoknecht, Tom Thaler, Peter Fettke, Andreas Oberweis, and Ralf Laue. Similarity of Business Process Models—A State-of-the-Art Analysis. ACM Computing Surveys, 50(4):1–33, July 2018. [37] Andreas Schoknecht 等. 业务流程模型的相似性——现状分析。《ACM 计算调查》,50(4):1–33,2018 年 7 月。
- [38] Zan Huang and Akhil Kumar. New Quality Metrics for Evaluating Process Models. In Danilo Ardagna, Massimo Mecella, and Jian Yang, editors, Business Process Management Workshops, volume 17, pages 164–170. Springer Berlin Heidelberg, Berlin, Heidelberg, 2009. [38] Zan Huang and Akhil Kumar. 评估流程模型的新质量指标。收录于:Danilo Ardagna 等编辑,《业务流程管理研讨会》,第 17 卷,第 164–170 页。Springer Berlin Heidelberg, 柏林/海德堡,2009 年。
- [39] Josef Pavlicek, Radek Hronza, Petra Pavlickova, and Klara Jelinkova. The Business Process Model Quality Metrics. In Robert Pergl, Russell Lock, Eduard Babkin, and Martin Molhanec, editors, Enterprise and Organizational Modeling and Simulation, volume 298, pages 134–148, Cham, 2017. Springer International Publishing. [39] Josef Pavlicek 等. 业务流程模型质量指标。收录于:Robert Pergl 等编辑,《企业与组织建模与仿真》,第 298 卷,第 134–148 页,Cham,2017 年。Springer International Publishing 出版。
Appendix A Appendix: Process Example附录 A 附录:流程示例
The following is an example process modeled using the BPMN Assistant based on the textual description:以下是基于文本描述使用 BPMN Assistant 建模的流程示例:
Textual description:
"The manager sends the mail to the supplier and prepares the documents. At the same time, the customer searches for the goods and picks up the goods."文本描述:
“经理将邮件发送给供应商并准备文件。与此同时,客户搜索商品并提货。”
JSON Representation:JSON 表示:
{
"process": [
{
"type": "startEvent",
"id": "start",
},
{
"type": "parallelGateway",
"id": "parallel1",
"branches": [
[
{
"type": "serviceTask",
"id": "task1",
"label": "Send mail to supplier",
},
{
"type": "task",
"id": "task2",
"label": "Prepare the documents",
}
],
[
{
"type": "task",
"id": "task3",
"label": "Search for the goods",
},
{
"type": "task",
"id": "task4",
"label": "Pick up the goods",
}
]
]
},
{
"type": "endEvent",
"id": "end1",
}
]
}