Abstract: The existing AR cabling mainly focuses on superimposing virtual auxiliary information on the workbench,and it is difficult to achieve the deep integration between visual wiring instructions,operator intentions and physical sites,restricting the AR cable laying efficiency and human factors comfort to a certain extent.Therefore,an intelligent mobile AR wiring method was proposed by integrating audio-visual perception,which realized closed-loop monitoring and active operation instruction pushing for the whole process of complex cable assembly.To achieve accurate identification of line numbers in a complex AR cabling environment,a lightweight cable character recognition network model was established,and an active speech recognition correction strategy was integrated to form an audio-visual perception method.A closed-loop monitoring method for the whole process state of complex cables that integrated AR perception interaction was proposed,which could realize the automatic identification of complex cable numbers and the active push of AR visual instructions,alleviating the cognitive load of workers in the wiring process.Finally,a markerless mobile AR intelligent wiring hardware and software prototype system was established,and extensive experiments were carried out in complex train cable assembly.Experimental results demonstrated that the proposed method could improve the wiring efficiency of complex products and alleviate the cognitive load of operators,promoting the realization of human-centric intelligent cabling.

Key words: augmented reality, intelligent cabling, audio-visual fusion, perceptual interaction, visual guidance

摘要： 现有增强现实(AR)布线主要侧重于将虚实辅助信息叠加在作业现场,难以实现可视化布线指令、作业人员意图及物理现场间的深度融合,在一定程度上制约了AR线缆敷设效率和人因舒适性。为此,本文提出一种融合视听感知交互的智能移动AR布线方法,以实现AR布线过程的闭环管控与作业指令主动推送。首先,针对复杂AR布线环境下线号的准确辨识问题,构建了轻量化线缆字符识别网络模型,融合主动语音识别修正策略,形成了一种适应于手持式移动AR系统的视听感知方法;其次,建立了融合AR感知交互的复杂线缆全流程装配状态监控策略,实现了线缆编号识别与装配工艺知识联合驱动的AR指令主动推送机制;最后,搭建了无标识的手持式移动AR布线软硬件原型系统,并在实验室环境下对高速列车复杂线缆装配进行了验证,结果表明本文所述方法能提高复杂产品布线效率、缓解操作人员认知负荷,对实现以人为中心的智能化AR布线具有重要参考价值。

关键词: 增强现实, 智能布线, 视听融合, 感知交互, 作业指引