Computer Integrated Manufacturing System

Previous Articles     Next Articles

Human-computer interaction multi-task modeling based on implicit intent EEG decoding

MIAO Xiu1,2,HOU Wenjun3,4,5+   

  1. 1.School of Modern Post(School of Automation),Beijing University of Posts and Telecommunications
    2.School of Architecture and Artistic Design,Inner Mongolia University of Science and Technology
    3.School of Digital Media & Design Arts,Beijing University of Posts and Telecommunications
    4.Beijing Key Laboratory of Network System and Network Culture
    5.Key Laboratory of Interactive Technology and Experience System,Ministry of Culture and Tourism

基于隐式意图脑电解码的人机交互多任务建模研究

苗秀1,2,侯文军3,4,5+   

  1. 1.北京邮电大学现代邮政学院(自动化学院)
    2.内蒙古科技大学建筑与艺术设计学院
    3.北京邮电大学数字媒体与设计艺术学院
    4.北京邮电大学网络系统与网络文化北京市重点实验室
    5.北京邮电大学交互技术与体验系统文化和旅游部重点实验室

Abstract: In the short term with fully autonomous level of machine intelligence can not be achieved,human are still an important part of the HCI systems.Intelligent systems should be able to "feel" and "predict" human intentions to achieve multi-channel natural and dynamic collaboration between human and machine,which is very important to improve the safety and efficiency of HCI system.However,the process of HCI is full of a large number of fuzzy and hidden implicit intentions,and the analysis efficiency and accuracy using traditional psychological or behavioral analysis methods are poor.With the development of sensing technology,intention recognition based on physiological signals has become the main method,but the existing research basis has some problems,such as few separable modes,low recognition accuracy,and insufficient research on domain context.This paper presents a method to integrate human into human-machine coordination loop naturally based on passive brain-computer interface technology in the field of industrial control complex system.Firstly,typical HCI interactive tasks are extracted based on MATB multi-task paradigm.Then,the Common Space Pattern algorithm is used to extract the EEG spatial features of multi-task intention,and it is found that the CSP algorithm is more effective than the traditional feature extraction methods,and the feature effectiveness is further verified by combining 3D space visualization.Finally,a machine learning intention model is constructed to decode implicit intention EEG and realize automatic recognition of implicit intention through subject-wise cross-validation and 5-fold parameter optimization.This paper proves that EEG signals can be used as the basis for judging the implicit intention of HCI,and proposes that CSP+SVM algorithm model can effectively improve the EEG decoding performance of implicit intention.The translation of implicit intent information is of significance for the study of intent-based efficient HCI model,the development of HCI systems and the improvement of human-machine collaboration efficiency.

Key words: implicit intention, human-computer interaction, electroencephalogram decoding, multi-task modeling

摘要: 在短期内具有完全自主水平的机器智能无法实现的情况下,人仍是人机系统的重要组成部分。智能系统感觉并预测用户的意图,有助于实现人机之间自然动态地协同,提高人机系统安全和效率。然而,人机交互的过程中充斥着大量模糊、隐蔽的隐式意图,传统的心理或行为分析方法解析意图无法保证时效性和准确性。随着传感技术发展,基于生理信号识别用户意图成为主流方法,但现有关于隐式意图的研究存在可分模式少、识别精度低、面向领域实境研究不足等问题。本文面向工控复杂系统领域,在生理视域下基于被动脑机接口技术,提出一种将人自然地纳入到智能人机系统回路中的方法。首先,抽取工控HMI典型交互任务,在MATB多任务范式基础上设计意图生理信号诱发实验程序;接着,采用共空间模式算法提取多任务意图脑电空域特征;最后,通过被试间交叉验证和5折参数寻优,构建机器学习意图模型,实现对隐式交互意图的自动识别。研究发现,相比传统特征提取方法,基于改良后的多分类CSP算法对意图特征提取更为有效,结合三维空间特征可视化进一步证实了特征的有效性;脑电信号能够作为判断人机交互隐式意图的依据,CSP+SVM算法模型能够有效提高人机交互隐式意图脑电的解码性能。本文对隐式意图信息的转译对构建基于意图的高效人机交互模型,以及发展人机系统、提高人机协作效率具有重要意义。

关键词: 隐式意图, 人机交互, 电解码, 多任务建模

CLC Number: