计算机集成制造系统 ›› 2023, Vol. 29 ›› Issue (11): 3592-3599.DOI: 10.13196/j.cims.2022.0401

• • 上一篇    下一篇

端到端的面向任务型对话系统多任务优化模型

赵逢达1,2,3,邱梦璐1,3,李贤善1,3+,孙永派1,3,杨智开1,3   

  1. 1.燕山大学信息科学与工程学院
    2.新疆科技学院信息科学与工程学院
    3.河北省软件工程重点实验室
  • 出版日期:2023-11-30 发布日期:2023-12-04
  • 基金资助:
    新疆维吾尔自治区自然科学基金面上项目(2022D01A59);新疆维吾尔自治区高校科研计划资助项目(自然科学重点项目)(XJEDU2021I029);河北省创新能力提升计划资助项目(22567637H)。

End-to-end multi-task optimization model for task-based dialogue systems

ZHAO Fengda1,2,3,QIU Menglu1,3,LI Xianshan1,3+,SUN Yongpai1,3,YANG Zhikai1,3   

  1. 1.School of Information Science and Engineering,Yanshan University
    2.School of Information Science and Engineering,Xinjiang University of Science and Technology
    3.The Key Laboratory for Software Engineering of Hebei Province
  • Online:2023-11-30 Published:2023-12-04
  • Supported by:
    Project supported by the General Program of Natural Science Foundation of Xinjiang Uygur Autonomous Region,China(2022D01A59),the Xinjiang Uygur Autonomous Region University Scientific Research Project (Key Project of Natural Science),China(No.XJEDU2021I029),and the Hebei Province Innovation Capacity Improvement Plan,China(No.22567637H).

摘要: 在对话系统中的自然语言理解模块中存在着意图检测与插槽填充两个任务,这两个任务之间存在着极强的相关性,即插槽信息的生成高度依赖于意图信息。然而,现有工作大部分将其视为两个独立任务实现,导致对话系统的准确率无法得到进一步提升。为此,针对对话系统中意图检测任务与插槽填充任务之间的相关性信息,在已有工作的基础上提出了端到端的基于Stack-Propagation(堆栈传播)思想实现的网络模型。该模型在解码器阶段借鉴并改进了Stack-Propagation框架的思想,即将意图检测的结果加入到插槽填充任务的输入中,使用意图检测的结果去进一步指导插槽填充任务的进行。通过在斯坦福多领域对话数据集上进行实验,证明该模型不仅可以充分利用意图检测任务与插槽填充任务之间的相关性信息,还可以通过联合学习达到相互促进的效果,最终有效提高对话系统的准确率。

关键词: 对话系统, 意图检测, 插槽填充, 堆栈传播框架, 人机交互

Abstract: In the natural language understanding module,there are two tasks of intent detection and slot filling,and there is a strong correlation between the two tasks that the generation of slot information is highly dependent on the intent information.However,most of the existing works regard it as two independent tasks to achieve,resulting in that the accuracy of the dialogue system cannot be further improved.To this end,aiming at the correlation information between the intent detection task and the slot filling task in the dialogue system,on the basis of the existing work,an end-to-end network model based on the idea of  Stack-Propagation was proposed.The idea of the Stack-Propagation framework in the decoder stage was borrowed and improved,which added the result of intent detection to the input of the slot filling task,and used the result of the intent detection to further guide the slot filling task.Through experiments on SMD dataset,it was proved that the model could not only make full use of the correlation information between the intent detection task and the slot filling task,but also achieve the effect of mutual promotion through joint learning,and finally effectively improve the accuracy of the dialogue system.

Key words: dialogue system, intent detection, slot filling, Stack-Propagation framwork, human-machine interaction

中图分类号: