计算机集成制造系统 ›› 2023, Vol. 29 ›› Issue (1): 169-191.DOI: 10.13196/j.cims.2023.01.015

• • 上一篇    下一篇

基于视觉感知的表面缺陷检测综述

苏虎1,张家斌1,2,张博豪1,邹伟1,2+   

  1. 1.中国科学院自动化研究所
    2.中国科学院大学人工智能学院
  • 出版日期:2023-01-31 发布日期:2023-02-15
  • 基金资助:
    国家重点研发计划资助项目(2018YFB1306303);国家自然科学基金资助项目(61702323,61773374);山东省自然科学基金重大基础研究资助项目(ZR2019ZD07)。

Review of surface defect inspection based on visual perception

SU Hu1,ZHANG Jiabin1,2,ZHANG Bohao1,ZOU Wei1,2+   

  1. 1.Institute of Automation,Chinese Academy of Sciences
    2.School of Artificial Intelligence,University of Chinese Academy of Science
  • Online:2023-01-31 Published:2023-02-15
  • Supported by:
    Project supported by the National Key Research and Development Program,China(No.2018YFB1306303),the National Natural Science Foundation,China(No.61702323,61773374),and the Major Basic Research Projects of Natural Science Foundation of Shandong Province,China(No.ZR2019ZD07).

摘要: 基于视觉感知的表面缺陷检测,具有高效、可防止二次损伤等优点,被广泛应用于各种工业场景中。近年来深度学习技术的快速发展进一步推动了视觉缺陷检测的进步与应用。以特征的显式提取与自动提取为思路,对基于视觉感知的缺陷检测方法进行综述和分析。首先,简要描述了视觉缺陷检测系统的基本构成,将缺陷检测中的视觉感知归为分类、目标检测和分割3个层次。然后,将现有的视觉检测方法分为基于显式特征提取的(传统方法)和基于自动特征提取的(深度学习方法)。进一步,将基于显式特征提取的方法分为统计法、谱方法和模型法3类,将基于自动特征提取的方法分为整图分类的、目标检测的和像素分割的方法。对每一类方法的特点和适用场景进行了归纳总结与分析。同时,针对工业应用中数据获取成本高的问题,介绍了近年来出现的弱监督缺陷检测方法与异常检测方法,并介绍了具有较大影响力的工业表面缺陷数据集。最后,针对如何减少对大量标注数据的依赖和如何提高检测方法在工业现场的适用性两个关键问题展开讨论,展望了该领域下一步的研究方向。

关键词: 视觉感知, 缺陷检测, 显式特征提取, 自动特征提取, 深层神经网络

Abstract: With the advantage of high efficiency and preventing secondary injury,inspection of surface defects based on visual perception has been widely used in various industry scenarios.The recent development of deep-learning technology contributes further to the progress and the application of vision-based defect inspection.The existing vision inspection methods under the track of explicit feature extraction and automatic feature extraction were reviewed.The basic structure of vision-based automatic inspection system was briefly introduced,and the visual perception involved in defect inspection was classified into three levels of classification,object detection and segmentation.Subsequently,existing defect inspection methods were divided into two categories that were the methods based on explicit feature extraction and the ones based on automatic feature extraction.Further,the former was categorized into statistical,spectrum and model-based methods while the later was categorized into classification-based,object detection-based and segmentation-based inspection networks.The representative methods of each class were reviewed,and the characteristics and the application scenarios of the methods were summarized.Aiming at the high cost of data collection and annotation,weakly-supervised inspection methods and anomaly inspection methods were introduced in recent years as well.Several well influential data sets for industrial surface defects were mentioned.Two key issues were discussed,which were how to alleviate the dependency on large amounts of annotated data and how to improve the adaptability of inspection methods in industrial applications.On this basis,several potentially development topics to be further investigated were suggested.

Key words: vision perception, defect inspection, explicit feature extraction, automatic feature extraction, deep convolutional neural network

中图分类号: