计算机集成制造系统 ›› 2023, Vol. 29 ›› Issue (5): 1602-1614.DOI: 10.13196/j.cims.2023.05.017

• • 上一篇    下一篇

非独立同分布工业大数据下联邦动态加权学习方法

刘晶1,3,4,朱家豪1,袁闰萌5,季海鹏2,3,4+   

  1. 1.河北工业大学人工智能与数据科学学院
    2.河北工业大学材料科学与工程学院
    3.河北省数据驱动工业智能工程研究中心
    4.天津开发区精诺瀚海数据科技有限公司
    5.天津师范大学软件学院
  • 出版日期:2023-05-31 发布日期:2023-06-14
  • 基金资助:
    京津冀基础研究合作专项资助项目(E2021203250);河北省自然科学基金面上资助项目(F2022202021)。

Federated dynamic weighted learning method based on non-independent and identically distributed industrial big data

LIU Jing1,3,4,ZHU Jiahao1,YUAN Runmeng5,JI Haipeng2,3,4+   

  1. 1.School of Artificial Intelligence,Hebei University of Technology
    2.School of Materials Science and Engineering,Hebei University of Technology
    3.Hebei Provincial Data Driven Industrial Intelligent Engineering Research Center
    4.Tianjin Development Zone Jingnuo Data Technology Co.,Ltd.
    5.School of Software,Tianjin Normal University
  • Online:2023-05-31 Published:2023-06-14
  • Supported by:
    Project supported by the Beijing-Tianjin-Hebei Basic Research Cooperation Special Project,China(No.E2021203250),and the Hebei Provincial Natural Science Foundation,China(No.F2022202021).

摘要: 联邦学习在不交换本地数据的情况下可以完成多方协作训练,很好地解决了工业物联网领域数据隐私保护及共享问题。但是传统的联邦学习在面对非独立同分布的工业数据时,会因为局部模型更新导致模型的偏移。针对上述问题,提出非独立同分布工业大数据下联邦动态加权学习方法,该方法分为局部更新和全局聚合两个阶段。在局部更新阶段,利用联邦距离算法消除偏移程度过大的局部模型的影响;在全局聚合阶段,提出动态加权算法,动态的给对全局模型更有利的局部数据分配更大的训练权重。该方法既考虑了局部更新导致的模型偏移程度问题,又兼顾了偏移局部模型对全局模型的影响。通过实验验证了该方法在面对非独立同分布的工业数据时具有良好的效果。

关键词: 工业物联网, 隐私保护, 联邦学习, 非独立同分布数据

Abstract: The problems of data sharing and privacy protection of Industrial Internet of Things (IIOT) were well solved by multi-party collaborative training of federated learning without exchanging the local private data.But the model offset was mainly caused by partial model renewal when traditional federated learning faced the industrial data of Non Independent and Identically Distributed (Non-IID).The federated dynamic weighted learning was proposed to figure out the problem.The method was divided into two basic steps as partial renewal and global convergence.The federated distance algorithm was used to eliminate the influence of the local model with excessive offset in partial renewal phase;the dynamic weighted algorithm was proposed to assign greater training weights dynamically to the local data that was more beneficial to the overall model in global convergence phrase.The impact of local update to model offset and local model offset to global model were carefully considered in federated dynamic weighted learning method.The experimental results verified that the federated dynamic weighted learning method had good results in the face of industrial data of Non-IID.

Key words: Internet of things, privacy protection, federated learning, non-independent and identically distributed data

中图分类号: