计算机集成制造系统 ›› 2020, Vol. 26 ›› Issue (第2): 300-311.DOI: 10.13196/j.cims.2020.02.003

• 当期目次 • 上一篇    下一篇

基于深度图像的零件识别及装配监测

田中可1,陈成军1,李东年1+,赵正旭1,洪军2   

  1. 1.青岛理工大学机械与汽车工程学院
    2.西安交通大学机械制造系统工程国家重点实验室
  • 出版日期:2020-02-29 发布日期:2020-02-29
  • 基金资助:
    国家自然科学基金资助项目(51705273,51475251)。

Part recognition and assembly monitoring based on depth images

  • Online:2020-02-29 Published:2020-02-29
  • Supported by:
    Project supported by the National Natural Science Foundation,China(No.51705273,51475251).

摘要: 针对机械产品装配中零件和装配体的识别、监测问题,提出一种基于深度图像和像素分类的装配体零件识别及装配监测方法。首先构建装配体深度图像标记样本集,包括合成标记样本集和真实标记样本集;然后提取深度差分特征,利用随机森林分类器对深度图像的像素进行分类,获取像素预测图像;最后通过对比像素预测图像和颜色标签图像对装配体各零件进行识别,并对比待测状态像素预测图像和正确装配像素预测图像,实现对装配过程的监测。为了提高边缘像素点的分类准确率,引入边缘因子。实验结果表明,该方法不但准确率高,而且兼具一定实时性和鲁棒性,在装配维修诱导、装配监测和自动化装配领域具有一定应用价值。

关键词: 零件识别, 装配监测, 像素分类, 深度图像, 随机森林分类器

Abstract: Aiming at the problem of parts and assemblies identification and monitoring in mechanical product assembly,a method of parts recognition and assembly monitoring based on depth image and pixel classification was proposed.The assembly depth image labeling sample set was constructed,including the synthetic labeling sample set and the real labeling sample set.The depth difference feature was extracted and the pixel classification of the depth image was realized by using the random forest classifier to obtain the pixel prediction image.By comparing the pixel prediction image with color label image,the parts of the assembly could be identified;by comparing the pixel prediction image of state to be measured with the correct assembly pixel prediction image,the assembly process could be monitored.To improve the classification accuracy of pixel points on the edge,the edge factor was introduced.The experimental results showed that the method had high accuracy,real-time performance and robustness,and had certain application value in the field of assembly maintenance guidance,assembly monitoring and automatic assembly.

Key words: part recognition, assembly monitoring, pixel classification, depth image, random forest classifier

中图分类号: