计算机集成制造系统 ›› 2023, Vol. 29 ›› Issue (12): 3974-3984.DOI: 10.13196/j.cims.2021.0459

• • 上一篇    下一篇

基于Attention-BLSTM的复杂产品制造质量预测方法

房鑫洋1,张洁2,3+,吕佑龙2,3,左丽玲1,刘骁佳4   

  1. 1.东华大学机械工程学院
    2.东华大学人工智能研究院
    3.上海工业大数据与智能系统工程技术研究中心
    4.上海航天精密机械研究所
  • 出版日期:2023-12-31 发布日期:2024-01-09
  • 基金资助:
    国防基础科研资助项目(JCKY2019203C017);国家自然科学基金资助项目(No.51905092);国家重点研发计划资助项目(2018YFB1703200);上海市科技计划资助项目(20DZ2251400)。

Attention-BLSTM based quality prediction for complex products

FANG Xinyang1,ZHANG Jie2,3+,LYU Youlong2,3,ZUO Liling1,LIU Xiaojia4   

  1. 1.College of Mechanical Engineering,Donghua University
    2.Institute of Artificial Intelligence,Donghua University
    3.Shanghai Engineering Research Center of Industrial Big Data and Intelligent System
    4.Shanghai Spaceflight Precision Machinery Institute
  • Online:2023-12-31 Published:2024-01-09
  • Supported by:
    Project supported by the National Defense Basic Scientific Research Program,China(No.JCKY2019203C017),the National Natural Science Foundation,China(No.51905092),the National Key Research and Development Program,China(No.2018YFB1703200),and the Science and Technology Program of Shanghai Municipality,China(No.20DZ2251400).

摘要: 复杂产品制造过程中工艺数据的高维特性以及工艺数据间的复杂关联特性,使得工艺数据中的深层次关键工艺特征难以挖掘,限制了产品质量的准确预测。鉴于此,提出一种基于注意力机制(Attention)与双向长短期记忆网络(BLSTM)的复杂产品质量预测方法。首先,设计数据预处理环节进行工艺数据清洗以及互信息特征筛选。然后,运用BLSTM网络模拟产品制造过程误差的复杂传递特性,挖掘上下游工艺参数的关联关系,输出BLSTM所有时刻提取的关联化工艺特征;同时,设计了Self-Attention网络,自学习各时刻关联化工艺特征对最终产品质量贡献的差异,对不同时刻工艺特征分配不同注意力权值,以强化关键特征。通过以上两阶段特征处理方式,实现深层次关键工艺特征的挖掘。最后,以关键特征作为输入层,通过反向传播神经网络(BPNN)实现复杂产品质量的准确预测。实验表明,相较于BPNN、长短期记忆神经网络(LSTM)、BLSTM以及XGBoost、基于粒子群优化的支持向量(PSO-SVR)、随机森林-贝叶期优化(BO-RF)等主流质量预测方法,所提方法有效提高了预测精度。

关键词: 复杂产品, 质量预测, 双向长短期记忆网络, 注意力机制

Abstract: Due to the high-dimensional characteristics of process data and complex correlation between process data in the manufacturing process of complex products,it is difficult to explore the deep-level key process features in the process data,thus limiting the improvement of the accuracy of complex product quality prediction.Thus,a complex product quality prediction method based on attention mechanism and Bidirectional Long Short-Term Memory(BLSTM)network was proposed.A data pre-processing link for process data cleaning and mutual information feature screening was designed.The BLSTM network was used to simulate the complex transmission characteristics of errors in the product manufacturing process to mine the correlation between upstream and downstream process parameters,and to output the correlated process features extracted by BLSTM at all moments.The self-attention mechanism was designed to self-learn the differences in the contribution of correlated process features to final product quality at each moment,and assign different attention weights to process features at different moments to reinforce key features.Through the above two-stage feature processing method,the mining of deep-level key process features was achieved.Finally,the key features were used as the input layer to achieve accurate prediction of complex product quality through BPNN.Experiments showed that the proposed method had the best performance compared with the mainstream quality prediction methods such as BPNN,LSTM,BLSTM and so on.

Key words: complex product, quality prediction, bidirectional long short-term memory, attention mechanism

中图分类号: