计算机集成制造系统 ›› 2021, Vol. 27 ›› Issue (5): 1281-1291.DOI: 10.13196/j.cims.2021.05.004

• 当期目次 • 上一篇    下一篇

基于图像匹配的增强现实装配系统跟踪注册方法

张昊鹏,郭宇,汤鹏洲,黄少华,刘道元,李晗   

  1. 南京航空航天大学机电学院
  • 出版日期:2021-05-31 发布日期:2021-05-31
  • 基金资助:
    国防基础科研资助项目(JCKY2016203B083,JCKY2016605B006,JCKY2017203B071)。

Tracking and registration method based on image matching for augmented reality aided assembly system

  • Online:2021-05-31 Published:2021-05-31
  • Supported by:
    Project supported by the National Defense Basic Scientific Research Foundation,China(No.JCKY 2016203B083,JCKY 2016605B006,JCKY 2017203B071).

摘要: 为了改善跟踪注册方法面向弱纹理零件增强现实装配引导的鲁棒性与适用性,提出一种基于图像匹配的跟踪注册方法。采用图像边缘倾角对距离图像的像素值进行加权,提高图像匹配度计算的准确性;准确的初始帧相机位姿是保证跟踪注册准确性的前提,采用差分进化策略与禁忌搜索策略对遗传算法进行改进,提高初始帧相机位姿跟踪的准确性与搜索效率;采用禁忌搜索算法连续跟踪相机位姿,保证跟踪注册的准确性与实时性。实验结果表明,所提跟踪注册方法相对于基于ORB的跟踪注册方法具有较好的精度,能够对弱纹理零件进行跟踪注册,对杂乱环境具有较好的鲁棒性,满足跟踪注册的实时性的要求。

关键词: 增强装配, 跟踪注册, 图像匹配, 遗传算法, 差分进化, 禁忌搜索

Abstract: To improve the robustness and applicability of tracking and registration method for textureless parts in augmented reality assembly guidance system,a tracking and registration method based on image matching was proposed.Edge orientation was used to weight the pixel value of distance image to improve the calculation accuracy of image matching degree.Accurate camera pose of initial frame was premise to ensure the tracking and registration accuracy.The differential evolution strategy and the tabu search strategy were used to modify the genetic algorithm,which improved the accuracy and search efficiency for tracking the camera pose.To ensure the accuracy and real-time of tracking and registration,tabu search algorithm was used to continuously track camera pose.Experimental results showed that the proposed method had better precision than ORB-based method in textureless parts tracking and registration,and had better robustness to messy environment,which could meet the real-time requirements of tracking and registration.

Key words: augmented assembly, tracking and registration, image matching, genetic algorithms, differential evolution, tabu search

中图分类号: