Computer Integrated Manufacturing System ›› 2024, Vol. 30 ›› Issue (9): 3061-3070.DOI: 10.13196/j.cims.2022.0069

Previous Articles     Next Articles

Design of bolt automatic assembly system guided by binocular structured light vision

ZHANG Liangan1,LI Pengfei1,XIE Shenglong2,3+   

  1. 1.School of Mechanical Engineering,Anhui University of Technology
    2.School of Mechanical and Electrical Engineering,China Jiliang University
    3.Anhui Engineering Laboratory for Intelligent Applications and Security of Industrial Internet,Anhui University of Technology
  • Online:2024-09-30 Published:2024-10-08
  • Supported by:
    Project supported by the Science and Technology Plan of Huzhou City,China(No.2021GN03),the Basic Science Research Fund of Zhejiang Province,China(No.2022YW43),and the Open Foundation for Industrial Internet Intelligent Application and Safety Laboratory of Anhui Province,China(No.IASII21-04).

双目结构光视觉引导的螺栓自动装配系统设计

张良安1,李鹏飞1,谢胜龙2,3+   

  1. 1.安徽工业大学机械工程学院
    2.中国计量大学机电工程学院
    3.安徽省工业互联网智能应用与安全工程实验室
  • 作者简介:
    张良安(1981-),男,浙江杭州人,教授,博士,研究方向:机器人技术及运用,E-mail:robotlab@qq.com;

    李鹏飞(1999-),男,安徽铜陵人,硕士研究生,研究方向:机器人技术及运用,E-mail:3398373232@qq.com;

    +谢胜龙(1988-),男,安徽安庆人,讲师,博士,硕士生导师,研究方向:机器人控制与数字孪生,通讯作者,E-mail:xieshenglong68@163.com。
  • 基金资助:
    湖州市科技计划资助项目(2021GN03);浙江省基本科研业务费资助项目(2022YW43);安徽省工业互联网智能应用与安全工程实验室开放基金资助项目(IASII21-04)。

Abstract: To solve the problems of rapid acquisition of parts positions in automatic bolt assembly process and accurate positioning in complex scenes such as weak texture and reflection,an automatic bolt assembly system was developed based on the binocular structured light vision principle.The 3D information of the workpiece scene was obtained by binocular structured light vision system,which involved the grating fringe pattern acquisition,binocular calibration,multi-frequency heterodyne method to solve the absolute phase,phase correction,polar line correction and stereo matching.The reconstructed point cloud data was segmented by European clustering,and the 3D point cloud clustering of single bolt was obtained.Then,the pose transformation matrix from template point cloud to target point cloud was estimated by ICP algorithm,and the pose of the connecting bolt in space was identified.Finally,the end of the manipulator was automatically assembled and tightened.The experimental results showed that the whole assembly process could be completed automatically,and the assembly time of a single bolt was about 10 s.The average axle hole alignment error of the system test was less than 1.20 mm,and the standard deviation of the error was less than 0.11 mm.

Key words: automatic assembly, machine vision, binocular structured light, ICP algorithm, multi-frequency heterodyne method

摘要: 为解决螺栓自动化装配过程中存在的零件位姿快速获取和在弱纹理、反光等复杂场景中实现精确定位等难题,基于双目结构光视觉原理,研制了一套螺栓自动装配系统。首先,通过双目结构光视觉系统获取工件场景的三维信息,涉及光栅条纹图案的获取、双目标定、多频外差法求解绝对相位、相位校正、极线校正、立体匹配,接着采用欧式聚类对重建的点云数据进行分割,获取单个螺栓的三维点云聚类,然后利用迭代最近点(ICP)算法估计模板点云到目标点云的位姿变换矩阵,识别连接螺栓在空间中的位姿,最后结合机械臂末端进行自动装配拧紧。实验结果表明,整个装配过程可自动完成,单个螺栓拧紧装配时间约为10 s,系统测试平均轴孔对中误差不超过1.20 mm,误差标准差不超过0.11 mm。

关键词: 自动装配, 机器视觉, 双目结构光, ICP算法, 多频外差法

CLC Number: