Computer Integrated Manufacturing System ›› 2023, Vol. 29 ›› Issue (12): 3951-3963.DOI: 10.13196/j.cims.2022.0671

Previous Articles     Next Articles

Real-time detection algorithm of steel plate defects integrating MobileNetv3 and Transformer

ZHANG Lin1,XIE Gang1,2+,XIE Xinlin1,2,ZHANG Taoyuan1   

  1. 1.School of Electronic Information Engineering,Taiyuan University of Science and Technology
    2.Shanxi Provincial Key Laboratory of Advanced Control and Equipment Intelligentization
  • Online:2023-12-31 Published:2024-01-09
  • Supported by:
    Project supported by the Key Research and Development Program Shanxi Province,China(No.202102020101005),the Natural Science Foundation of Shanxi Province,China(No.202103021224056),the Shanxi Provincial Scholarship Council,China(No.2021-046),and the Outstanding Innovation Project Foundation for Postgraduates in Shanxi Province,China(No.2022Y694).

融合MobileNetv3与Transformer的钢板缺陷实时检测算法

张林1,谢刚1,2+,谢新林1,2,张涛源1   

  1. 1.太原科技大学电子信息工程学院
    2.先进控制与装备智能化山西省重点实验室
  • 基金资助:
    山西省重点研发计划资助项目(202102020101005);山西省自然科学基金资助项目(202103021224056);山西省回国留学人员科研资助项目(2021-046);山西省研究生优秀创新项目(2022Y694)。

Abstract: The defect detection on the surface of the steel plate is the basis and key to analyze and judge the quality of the steel plate.Aiming at the problems of low detection efficiency and poor accuracy of small defects such as cracks on the surface of steel plates,a real-time detection algorithm for surface defects of steel plates integrated with Transformer was proposed.By integrating the Coordinate Attention(CA)module and the Dynamic Shift Max(DY)activation function,the CA-Bneck module was constructed to improve the representation ability of defect features.The MobileNetV3,CA-Bneck and Transformer were encoded,and the modules were integrated to build a new backbone feature extraction network MobileNetV3-CATr,which was used to reduce the complexity of the model.A BiFPN-Lite module was proposed to fuse more defect features without increasing the complexity of the model,and the defect information was output through YOLO Head.The experimental results on the open data set NEU-DET of hot rolled steel showed that the proposed algorithm achieved a balance between performance and speed.Compared with YOLOv4,the mAP value was increased by 5.96%,and the speed reached 20.1FPS,which could effectively complete the real-time and high-precision detection of steel plate surface defects.

Key words: machine vision, defect detection, MobileNetv3, Transformer block

摘要: 钢板表面的缺陷检测是分析和判断钢板质量的基础和关键。针对钢板表面龟裂等小缺陷检测效率低、精度差的问题,提出一种融合Transformer的钢板表面缺陷实时检测算法。首先,融合协调注意力(CA)模块以及最大动态转移(DY)激活函数构建CA-Bneck模块,提高缺陷特征的表示能力;其次,将MobileNetV3、CA-Bneck以及Transformer编码模块相融合,构建一种新的主干特征提取网络MobileNetV3-CATr,用于减轻模型的复杂度;最后,提出一种BiFPN-Lite模块,使得模型复杂度不增加的条件下融合更多缺陷特征;并通过YOLO Head输出缺陷的信息。在热轧钢公开数据集NEU-DET上实验结果表明,所提算法在性能和速度之间取得了平衡,mAP值相较于YOLOv4提升了5.96%,速度达到了20.1FPS,能够有效地完成钢板表面缺陷的实时和高精度检测。

关键词: 机器视觉, 缺陷检测, MobileNetv3网络, Transformer模块

CLC Number: