计算机集成制造系统 ›› 2022, Vol. 28 ›› Issue (8): 2508-2521.DOI: 10.13196/j.cims.2022.08.021

• • 上一篇    下一篇

面向产品概念设计的多模态智能交互框架及实现

牛红伟,郝佳,曹贝宁,龙辉,张非凡,王国新   

  1. 北京理工大学工业与智能系统工程研究所
  • 出版日期:2022-08-31 发布日期:2022-09-13
  • 基金资助:
    国家重点研发计划资助项目(2021YFB1714500);国防基础科研资助项目(JCKY2018204B053)。

Multimodal intelligent interaction framework and realization for product conceptual design

NIU Hongwei,HAO Jia,CAO Beining,LONG Hui,ZHANG Feifan,WANG Guoxin   

  1. Institute of Industrial and Intelligent Systems Engineering,Beijing Institute of Technology
  • Online:2022-08-31 Published:2022-09-13
  • Supported by:
    Project supported by the National Key Research and Development Program,China (No.2021YF1714500),and the National Defense Basic Scientific Research Program,China (No.JCKY2018204B053).

摘要: 针对传统基于“鼠标+键盘”的计算机辅助设计(CAD)交互模式阻碍设计思维自然表达的问题,剖析了产品概念设计过程对智能人机交互技术的发展需求,探索一种以端对端模型生成及操控为特征的产品概念设计智能交互模式。构建了面向产品概念设计的多模态智能交互框架,分析了框架中涉及的多模态信号同步采集、产品概念设计情境模型构建、多模态信号特征层及决策层融合等关键技术;在此基础上,搭建了脑眼手融合的多模态智能交互系统,并通过两个典型应用案例,展示了所提框架和关键技术的可行性,为实现新一代CAD智能交互系统提供了思路和技术途径。

关键词: 产品概念设计, 多模态, 智能交互框架, 计算机辅助设计

Abstract: The traditional interaction mode of Computer Aided Design (CAD) based on “mouse+keyboard” is not conducive to the natural expression of design thinking.Facing the development demand of intelligent human-computer  interaction technology in product conceptual design,an intelligent interaction mode  was explored based on end-to-end model generation and manipulation,and a multimodal intelligent interaction framework for product conceptual design was constructed.According to the framework,key techniques of multimodal intelligent interaction  were studied including the multimodal signal synchronous acquisition,situation model construction and multimodal signal fusion on the level of feature and decision.On this basis,a multimodal intelligent interaction system based on brain-eye-hand was built and two typical application cases were provided to prove the feasibility of the framework and key technologies proposed in this paper.It provided ideas and technical means for the realization of a new generation of CAD intelligent interactive system.

Key words: product conceptual design, multimodal, intelligent interaction framework, computer aided design

中图分类号: