Computer Integrated Manufacturing System ›› 2025, Vol. 31 ›› Issue (8): 2816-2828.DOI: 10.13196/j.cims.2023.0196

Previous Articles     Next Articles

Robot weld seam milling guidance based on surface structured light visual inspection

GONG Yefei1,CHENG Yanhua1+,ZHAO Guangzhi1,LIU Jicheng1,XIE Yuxin1,2,YU Mingling1,3,GU Xinhao1,3   

  1. 1.School of Electrical and Automation,Suzhou University of Technology
    2.College of Information and Control Engineering,China University of Mining and Technology
    3.College of Physics and Electronic Engineering,Northeast Petroleum University
  • Online:2025-08-31 Published:2025-09-04
  • Supported by:
    Project supported by the Jiangsu Provincial Industry University Research Cooperation Fund in 2021,China(No.BY2021258).

基于面结构光视觉检测的机器人焊缝铣削导引

龚烨飞1,程艳花1+,赵广志1,刘继承1,谢雨欣1,2,余明岭1,3,谷心浩1,3   

  1. 1.苏州工学院电气与自动化学院
    2.中国矿业大学信息与控制工程学院
    3.东北石油大学物理与电子工程学院
  • 作者简介:
    龚烨飞(1982-),男,江苏昆山人,副教授,博士,研究方向:机器视觉三维重建、2D/3D图像处理、人工智能视觉处理基于3D视觉的机器人导引、工业机器人柔性控制等,E-mail:gong_yf@cslg.edu.cn;

    +程艳花(1983-),女,山西祁县人,高级工程师,硕士,研究方向:图像处理与机器视觉等,通讯作者,E-mail:cheng_yh@cslg.edu.cn;

    赵广志(1983-),男,满族,黑龙江海林人,高级工程师,硕士,研究方向:工业机器人等,E-mail:517187209@qq.com;

    刘继承(1970-),男,黑龙江明水人,教授,博士,研究方向:非平稳信号分析及处理、生产过程自动化等,E-mail:201600084@cslg.edu.cn;

    谢雨欣(1999-),女,江苏扬州人,硕士研究生,研究方向:机器视觉,E-mail:TS21060195P31LP@cumt.edu.cn;

    余明岭(1998-),男,云南昭通人,硕士研究生,研究方向:设备状态检测与故障诊断,E-mail:minglingyu@163.com;

    谷心浩(1998-),男,山西大同人,硕士研究生,研究方向:设备状态检测与故障诊断,E-mail:song0714@qq.com。
  • 基金资助:
    2021江苏省产学研合作资助项目(BY2021258)。

Abstract: To meet the needs of welded seam milling automation,a robotic welded seam milling guidance method based on surface structured light vision detection was proposed.The point cloud data and grayscale image were processed accordingly to extract the 3D and 2D contour volumes in the field of the vision,and completes the segmentation and recognition of the weld butt joint and the welded seam body by combining 2D/3D geometric constraints and 2D image HOG+SVM methods.Further,the welded seam path was calculated based on the welded seam body point cloud data,the final robot milling path was generated through the hand-eye calibration relationship calculated based on the correspondence of point sets and the process requirements of welded seam milling.The experiments showed that the proposed method could adapt to welded seam detection under various adverse conditions such as joint mismatch and base metal deformation,and could better complete robot automatic milling of actual welds.It had the characteristics of fast extraction speed,high detection accuracy and strong applicability of path planning.

Key words: surface structured light visual inspection, weld seam inspection, milling path planning, automatic milling

摘要: 为满足焊缝铣削自动化的需要,提出了一种基于面结构光视觉检测的机器人焊缝铣削导引方法。该方法首先对面结构光视觉采集的点云数据和灰度图进行处理以提取视野中的3D和2D轮廓体,并通过结合2D/3D几何约束以及2D图像HOG+SVM方法完成焊缝对接接头与焊缝本体的分割识别,进一步基于焊缝本体点云数据计算焊缝路径,并通过基于点集对应性计算的手眼标定关系和焊缝铣削的工艺要求生成最终机器人铣削路径。实验表明,该方法能够适应接头错位和母材变形等多种不良工况下的焊缝检测,并能够较好的完成实际焊缝的机器人自动铣削,具有提取速度快,检测精度高,路径规划适用性强等特点。

关键词: 面结构光视觉检测, 焊缝检测, 铣削路径规划, 自动铣削

CLC Number: