计算机集成制造系统 ›› 2023, Vol. 29 ›› Issue (10): 3440-3449.DOI: 10.13196/j.cims.2023.10.019

• • 上一篇    下一篇

云边协同外观质量人工智能检测系统的设计与实现

张明强1,2,3,6,高华1,3,6,袁东风3,6+,张海霞3,4,6,孙广源5,马睿3,4,6,翟华振3,4,6,张寻政1,3,6   

  1. 1.山东大学信息科学与工程学院
    2.曲阜师范大学网络空间安全学院
    3.山东大学先进信息技术研究院
    4.山东大学控制科学与工程学院
    5.海尔集团海尔空调全球供应链
    6.山东省无线通信技术重点实验室
  • 出版日期:2023-10-31 发布日期:2023-11-09
  • 基金资助:
    山东省重点研发计划重大科技创新工程资助项目(2019TSLH0202,2019JZZY01011);广东省基础与应用基础研究基金资助项目(2021B1515120066)。

Design and implementation of cloud-edge collaborative system for appearance quality detection with artificial intelligence

ZHANG Mingqiang1,2,3,6,GAO Hua1,3,6,YUAN Dongfeng3,6+,ZHANG Haixia3,4,6,SUN Guangyuan5,MA Rui3,4,6,ZHAI Huazhen3,4,6,ZHANG Xunzheng1,3,6   

  1. 1.School of Information Science and Engineering,Shandong University
    2.School of Cyber Science and Engineering,Qufu Normal University
    3.Institute of Advanced Information Technology,Shandong University
    4.School of Control Science and Engineering,Shandong University
    5.Global Supply Chain of Haier Air Conditioner,Haier Group
    6.Shandong Provincial Key Laboratory of Wireless Communication Technologies
  • Online:2023-10-31 Published:2023-11-09
  • Supported by:
    Project supported by the Major Scientific and Technological Innovation Project of Shandong Province,China (No.2019TSLH0202,2019JZZY01011),and the Guangdong Basic and Applied Basic Research Foundation,China(No.2021B1515120066).

摘要: 传统的产品外观质量检测过程需要人工干预,较低的检测精度和自动化程度阻碍了产线节拍加速,成为提升效率的瓶颈。为充分挖掘工业场景数据的潜在价值,建立了空调外观质量检测图像公开数据集SDU-Haier-AQD,并在IEEE DataPort网站予以公开。基于该数据集,提出一种改进的快速精简的目标检测模型FT-Yolo,在11个空调机型、16个外观质量标注类别检测任务的识别准确率超过97%,产品外观检测时间可缩减90%以上,实现了对外观质量关键点的自动检测与精准快速识别。进一步研发新型云边协同模式产品外观质量人工智能检测系统,依托云边协同机制完成系统边缘节点和底层生产线线体与云端工业互联网平台的高效互联交互,实现了空调外观质量数据的实时采集、传输、智能检测和云端存储管理。

关键词: 外观质量检测, 目标检测, 云边协同, 公开数据集

Abstract: Traditional appearance quality detection methods need manual intervention,and their detection accuracy and automation level are very low,which has become a serious bottleneck hindering the acceleration of production rhythm and the improvement of work efficiency.To fully tap the potential value of industrial data,an appearance quality detection image dataset was collated and annotated,which had been published as an open dataset named with SDU-Haier-AQD on the IEEE Data Port website.Based on the open dataset,a Fast Tiny Yolo model (FT-Yolo)was proposed to conduct the appearance quality detection tasks,which achieved more than 97% recognition accuracy in the detection tasks of 11 types of air conditioners and 16 categories of appearance quality features.The detection time could be reduced by more than 90%,and the automatic detection and accurate and fast recognition of appearance quality features were realized.An intelligent system for product appearance quality detection based on cloud-edge collaboration mechanism was developed,which could interact with the production lines and cloud platform efficiently,and realize the real-time collection,transmission,intelligent detection and cloud storage and management of the appearance quality data.

Key words: appearance quality detection, object detection, cloud-edge collaboration, open datasets

中图分类号: