Quality evaluation framework of business process concept drift detection algorithm

doi:10.13196/j.cims.2021.0917

Computer Integrated Manufacturing System ›› 2024, Vol. 30 ›› Issue (8): 2722-2734.DOI: 10.13196/j.cims.2021.0917

Previous Articles Next Articles

Quality evaluation framework of business process concept drift detection algorithm

LI Ting^1,2,LIU Cong^1,3,4+,XU Xingrong¹,ZHANG Shuaipeng¹,WEN Lijie⁵,LIN Leilei⁵,ZENG Qingtian⁴

1.School of Computer Science and Technology,Shandong University of Technology
2.School of Preschool Education,Zibo Normal College
3.The Key Laboratory of Embedded System and Service Computing,Ministry of Education,Tongji University
4.School of Computer Science and Engineering,Shandong University of Science and Technology
5.School of Software,Tsinghua University

Online:2024-08-31 Published:2024-09-04
Supported by:
Project supported by the National Natural Science Foundation,China(No.62472264),the Taishan Scholars Program of Shandong Province,China(No.ts20190936,tsqn201909109),the Natural Science Excellent Youth Foundation of Shandong Province,China(No.ZR2021YQ45),the Youth Innovation Science and Technology Team Foundation of Shandong Provincial Universities,China(No.2021KJ031),and the Open Project of the Key Laboratory of Embedded System and Service Computing of Ministry of Education(Tongji University),China(No.ESSCKF 2021-06).

业务过程概念漂移检测算法的质量评估框架

李婷^1,2,刘聪^1,3,4+,徐兴荣¹,张帅鹏¹,闻立杰⁵,林雷蕾⁵,曾庆田⁴

1.山东理工大学计算机科学与技术学院
2.淄博师范高等专科学校学前教育学院
3.同济大学嵌入式系统与服务计算教育部重点实验室
4.山东科技大学计算机科学与工程学院
5.清华大学软件学院

作者简介:
李婷(1996-),女,山东济宁人,助教,硕士,研究方向:过程挖掘等,E-mail:Ltingoo@163.com;

+刘聪(1990-),男,山东淄博人,教授,博士,研究方向:过程挖掘、Petri网理论与应用等,通讯作者,E-mail:liucongchina@163.com;

徐兴荣(1995-),男,山东济南人,硕士研究生,研究方向:业务过程管理等,E-mail:Nick_xu0522@163.com;

张帅鹏(1997-),男,河南许昌人,硕士研究生,研究方向:过程挖掘等,E-mail:15994069715@163.com;

闻立杰(1977-),男,河北唐山人,副教授,博士,研究方向:过程数据管理与挖掘、自然语言处理等,E-mail:wenlj@tsinghua.edu.cn;

林雷蕾(1989-),男,海南万宁人,讲师,博士,研究方向:过程大数据分析等,E-mail:leilei_lin@126.com;

曾庆田(1976-),男,山东高密人,教授,博士,研究方向:业务过程管理、过程挖掘等,E-mail:qtzeng@sdust.edu.cn。
基金资助:
国家自然科学基金资助项目(62472264);山东省泰山学者工程专项基金资助项目(ts20190936,tsqn201909109);山东省自然科学基金优秀青年基金资助项目(ZR2021YQ45);山东省高等学校青创科技计划创新团队资助项目(2021KJ031);嵌入式系统与服务计算教育部重点实验室(同济大学)开放基金资助项目(ESSCKF 2021-06)。

Abstract

Abstract: Most of the existing research work focuses on the detection of concept drift,and lacks the quality evaluation of the existing drift detection algorithms.Therefore,to better evaluate the impact of the dynamic changes of the process model on the business process,a general framework for evaluating the quality of concept drift detection algorithm was proposed in the business process,and four evaluation indicators for different application requirements was proposed.Through the public data set and four mainstream drift detection algorithms,the proposed evaluation framework and four evaluation indicators were compared and analyzed,and the results showed that the framework had a certain pertinence and effectiveness,which could meet the actual needs of the current business process.

Key words: concept drift, drift detection, process model, general framework, evaluation index

摘要： 现有研究工作大多关注概念漂移的检测,缺少对已有漂移检测算法的质量评估。因此,为更好评估过程模型的动态变更对业务过程的影响,提出了一个用于评估业务过程中概念漂移检测算法质量的通用框架,并针对不同应用需求提出了4种评价指标。通过公开数据集和4种主流的漂移检测算法对所提评估框架以及四种评价指标进行比较分析,表明该框架具备一定的针对性与有效性,能够满足当前业务过程的实际需求。

关键词: 概念漂移, 漂移检测, 过程模型, 通用框架, 评价指标

CLC Number:

TP301
TP311

LI Ting, LIU Cong, XU Xingrong, ZHANG Shuaipeng, WEN Lijie, LIN Leilei, ZENG Qingtian. Quality evaluation framework of business process concept drift detection algorithm[J]. Computer Integrated Manufacturing System, 2024, 30(8): 2722-2734.

李婷, 刘聪, 徐兴荣, 张帅鹏, 闻立杰, 林雷蕾, 曾庆田. 业务过程概念漂移检测算法的质量评估框架[J]. 计算机集成制造系统, 2024, 30(8): 2722-2734.

[1]	SUN Jinyong, XU Qian, WEN Lijie, SUN Zhigang, DENG Wenwei. Business process anomaly detection based on concept drifting discovery [J]. Computer Integrated Manufacturing System, 2024, 30(8): 2708-2721.
[2]	LIN Leilei, XIAO Liwen, WEI Daisen, XU Yusong, WANG Jingqi, WEN Lijie, LI Mengkun. Process concept drift detection based on graph convolutional network [J]. Computer Integrated Manufacturing System, 2024, 30(8): 2735-2744.
[3]	WANG Jiaojiao, MA Xiaoyu, LIU Chang, YU Dingguo, YU Dongjin, ZHANG Yinzhu. Incremental outcome-oriented predictive process monitoring based on XGBoost [J]. Computer Integrated Manufacturing System, 2024, 30(8): 2756-2775.
[4]	HUANG Fenglan, NI Feng, LIU Jiang, TAO Mengyi, ZHOU Yining, LI Yexun. Data flow modeling and verification of complex BPMN collaboration models based on HCPN [J]. Computer Integrated Manufacturing System, 2024, 30(5): 1754-1769.
[5]	ZHANG Binqiao, SHU Yong, JIANG Yu. Bearing fault diagnosis based on improved variational mode decomposition and optimized stacked denoising autoencoder [J]. Computer Integrated Manufacturing System, 2024, 30(4): 1408-1421.
[6]	WANG Falin, GUO Yaowen, GONG Jianhua, CHENG Shiming. Dynamic construction method of cable assembly process model for complex mechatronic products based on digital twin [J]. Computer Integrated Manufacturing System, 2023, 29(6): 2047-2061.
[7]	ZHANG Li, YANG Zitian, GE Ning, LIU Yi. Production plan analysis oriented collaborative manufacturing process modeling language and modeling/simulation system [J]. Computer Integrated Manufacturing System, 2023, 29(5): 1415-1428.
[8]	FU Yan, WANG Liming, LI Fangyi, KONG Lin, WANG Geng. Generation method of green design scheme for mechatronic products based on FSMP model [J]. Computer Integrated Manufacturing System, 2023, 29(4): 1301-1312.
[9]	ZHANG He, ZHANG Ling, GE Xiaobo, SHAO Xiaodong. Automatic generation method of casting blank model and process models for disc and sleeve parts [J]. Computer Integrated Manufacturing System, 2023, 29(1): 36-50.
[10]	. Multi-level structured representation method of process data based on process design intent [J]. Computer Integrated Manufacturing System, 2022, 28(6): 1735-1745.
[11]	. Automatic generation method of process model of shaft parts based on volume decomposition [J]. Computer Integrated Manufacturing System, 2022, 28(5): 1293-1305.
[12]	HUANG Yue, ZHU Rui, LI Tong, WANG Jishu, TANG Yahui, LYU Changlong. Structure abstraction and behavior retention method for business process model based on complete finite prefix [J]. Computer Integrated Manufacturing System, 2022, 28(11): 3673-3690.
[13]	DENG Yafang, LIN Leilei, WEN Lijie, LIU Aiwei, QIAN Chen, WANG Jianmin. Calculating the number of unique paths in an unstructured process model [J]. Computer Integrated Manufacturing System, 2022, 28(10): 3100-3114.
[14]	NI Ke, YU Dongjin, SUN Xiaoxiao, HU Hua. Local log sampling method for process discovery [J]. Computer Integrated Manufacturing System, 2022, 28(10): 3166-3174.
[15]	YANG Qingtao, GUO Wenyan, NI Weijian, ZENG Qingtian. Automatic extraction method and implementation of BPMN model for emergency plan response process [J]. Computer Integrated Manufacturing System, 2022, 28(10): 3212-3224.

Quality evaluation framework of business process concept drift detection algorithm

业务过程概念漂移检测算法的质量评估框架

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics