计算机集成制造系统 ›› 2015, Vol. 21 ›› Issue (第8期): 2249-2256.DOI: 10.13196/j.cims.2015.08.030

• 产品创新开发技术 • 上一篇    

基于累积全熵的子空间聚类离群点检测算法

张忠平1,2,房春珍1+   

  1. 1.燕山大学信息科学与工程学院
    2.燕山大学河北省计算机虚拟技术与系统集成重点实验室
  • 出版日期:2015-08-31 发布日期:2015-08-31
  • 基金资助:
    河北省自然科学基金资助项目(F2012203087);国家自然科学基金资助项目(61272124,61073063)。

Outlier detection algorithm for subspace clustering based on cumulative holoentropy

  • Online:2015-08-31 Published:2015-08-31
  • Supported by:
    Project supported by the Hebei Provincial Natural  Science Foundation,China(No.F2012203087),and the National Natural Science Foundation,China(No.61272124,61073063).

摘要: 针对累积互信息方法存在的最佳聚类子空间选择不稳定和计算复杂的问题,给出累积熵的链式法则、累积全相关、累积全熵的计算方法,采用累积全熵在连续数据集上挖掘最佳聚类子空间,并在最佳聚类子空间中进行离群点挖掘,提出基于累积全熵的子空间聚类离群点检测算法。分别在真实数据集和虚拟数据集上验证了所提算法的有效性和可伸缩性。实验表明,所提算法进一步提高了子空间离群点的挖掘效率。

关键词: 大数据分析, 离群点检测, 子空间聚类, 累积全熵

Abstract: Aiming at the instability and complex computation of optimal subspace clustering selection existed in Cumulative Mutual Information (CMI) method,the computational method for chain rule of cumulative entropy,cumulative total correlation and cumulative holoentropy were given.Cumulative holoentropy was used to mine the best clustering subspaces on continuous data sets in which outliers were detected,and then subspace outlier detection algorithm based on cumulative holoentropy was proposed.The validity and scalability of proposed method were tested on real datasets and virtual datasets.Experiment result showed that the efficiency of mining outliers in subspaces was enhanced by the proposed algorithm.

Key words: big data analysis, outlier detection, subspace clustering, cumulative holoentropy

中图分类号: