Computer Integrated Manufacturing System ›› 2024, Vol. 30 ›› Issue (12): 4246-4258.DOI: 10.13196/j.cims.2023.0222

Previous Articles     Next Articles

Region-based 3D tracking method for textureless parts

XU Yicheng1,2,3,4,LI Peng1,2,3+,LI Shuai1,2,3,YU Huidong1,2,3   

  1. 1.Key Laboratory of Networked Control Systems,Chinese Academy of Sciences
    2.Shenyang Institute of Automation,Chinese Academy of Sciences
    3.Institutes for Robotics and Intelligent Manufacturing,Chinese Academy of Sciences
    4.University of Chinese Academay of Sciences
  • Online:2024-12-31 Published:2025-01-06
  • Supported by:
    Project supported by the National Key R&D Program,China (No.2019YFB1706202),and the Applied Basic Research Program of Liaoning Province,China (No.2022JH2/101300255).

基于区域的弱纹理零件三维跟踪方法

徐一成1,2,3,4,里鹏1,2,3+,李帅1,2,3,于慧东1,2,3   

  1. 1.中国科学院网络化控制系统重点实验室
    2.中国科学院沈阳自动化研究所
    3.中国科学院机器人与智能制造创新研究院
    4.中国科学院大学
  • 作者简介:
    徐一成(1997-),男,浙江绍兴人,硕士研究生,研究方向:增强现实、三维跟踪等,E-mail:xuyicheng@sia.cn;

    +里鹏(1982-),男,满族,辽宁抚顺人,研究员,博士,研究方向:数字化建模、企业自动化系统集成技术等,通讯作者,E-mail:pengli@sia.cn;

    李帅(1988-),男,辽宁锦州人,副研究员,博士,研究方向:故障诊断、大数据、智能制造等,E-mail:lishuai@sia.cn;

    于慧东(1993-),男,蒙古族,辽宁阜新人,工程师,硕士,研究方向:工业数字孪生、增强现实、虚拟现实等,E-mail:yuhuidong@sia.cn。
  • 基金资助:
    国家重点研发计划资助项目(2019YFB1706202);辽宁省应用基础研究计划资助项目(2022JH2/101300255)。

Abstract: To enhance the tracking performance of textureless parts in the augmented reality assembly system,a region-based 3D tracking method was proposed.A new smooth step function was used to optimize the image segmentation method based on level-set function,which improved the segmentation effect of contour edges.Then,a pixel foreground and background color posterior probability statistical model was designed to enhance the time consistency between continuous frames and improve the robustness and accuracy against motion blur.Finally,the Gauss-Newton method was used for pose optimization,with its fast convergence and numerical stability ensuring real-time and stability of the algorithm.Experimental results demonstrated that the proposed 3D tracking method could accurately track textureless parts.Meanwhile,the image segmentation and pose estimation exhibit stronger robustness against disturbances such as motion blur or cluttered backgrounds,meeting the requirements of tracking textureless parts in industrial scenarios.

Key words: augmented assembly, foreground and background region, image segmentation, pose estimation, 3D object tracking

摘要: 为提升增强现实装配系统中对于弱纹理零件的跟踪效果,提出一种基于区域的三维跟踪方法。首先,采用全新的平滑阶跃函数优化基于水平集函数的图像分割方法,提高了轮廓边缘的分割效果;然后,设计了像素前背景颜色后验概率统计模型,增强了连续帧之间的时间一致性,提高了对运动模糊的鲁棒性和准确性;最后,采用高斯牛顿方法进行姿态优化,利用其快速收敛和数值稳定的性质,保证算法的实时性和稳定性。实验结果表明,所提出的三维跟踪方法能对弱纹理零件进行精确的跟踪。同时,在面对运动模糊或背景杂乱等干扰时,图像分割与位姿估计表现出更强的鲁棒性,满足了工业场景中对弱纹理零件跟踪的要求。

关键词: 增强装配, 前背景区域, 图像分割, 姿态估计, 三维目标跟踪

CLC Number: