Clustering algorithm preserving differential privacy in the framework of Spark

Zhi-qiang GAO; Qing-peng LI; Ren-yuan HU

doi:10.11959/j.issn.2096-109x.2016.00087

您当前的位置：

首页 >

文章列表页 >

Clustering algorithm preserving differential privacy in the framework of Spark

Papers | 更新时间：2024-06-03

- Clustering algorithm preserving differential privacy in the framework of Spark
- Chinese Journal of Network and Information Security Vol. 2, Issue 11, Pages: 47-51(2016)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2016.00087
  CLC： TP301
- Online First：2016-11，
  
  Published：15 November 2016
- 稿件说明：
移动端阅览
Zhi-qiang GAO, Qing-peng LI, Ren-yuan HU. Clustering algorithm preserving differential privacy in the framework of Spark[J]. Chinese Journal of Network and Information Security, 2016, 2(11): 47-51.
DOI：

Zhi-qiang GAO, Qing-peng LI, Ren-yuan HU. Clustering algorithm preserving differential privacy in the framework of Spark[J]. Chinese Journal of Network and Information Security, 2016, 2(11): 47-51. DOI： 10.11959/j.issn.2096-109x.2016.00087.

摘要

针对经典聚类方法无法应对任意背景知识下恶意攻击者在海量数据挖掘过程中的恶意攻击问题，结合差分隐私保护机制，提出一种适用于Spark内存计算框架下满足差分隐私保护的聚类算法，并从理论上证明了改进算法满足在Spark并行计算框架下的ε-差分隐私。实验结果表明，改进算法在保证聚类结果可用性前提下，具有良好的隐私保护性和满意的运行效率，在海量数据聚类分析的隐私保护挖掘中，具有很好的应用前景和价值。

Abstract

Aimed at the problem that traditional methods fail to deal with malicious attacks with arbitrary background knowledge during the process of massive data clustering analysis

an improved clustering algorithm， especially designed for preserving differential privacy

under the framework of Spark was proposed.Furthermore

it’s theoretically proved to meet the standard of ε-differential privacy in the framework of Spark platform.Finally

experimental results show that guaranteeing the availability of proposed clustering algorithm

the improved algorithm has an advantage over privacy protection and satisfaction in the aspect of time as well as efficiency.Most importantly

the proposed algorithm shows a good application prospect in the analysis of data clustering preserving privacy protection and data security.

关键词

Keywords

references

方滨兴 . 从层次角度看网络空间安全技术的覆盖领域 [J ] . 网络与信息安全学报 , 2015 , 1 ( 1 ): 1 - 6 .

FANG B X . A hierarchy model on the research fields of cyberspace security technology [J ] . Chinese Journal of Network and Information Security , 2015 , 1 ( 1 ): 1 - 6 .

方滨兴 , 贾焰 , 李爱平 , 等 . 大数据隐私保护技术综述 [J ] . 大数据 , 2016 ( 1 ): 1 - 18 .

FANG B X , JIA Y , LI A P , et al . A survey of large data privacy protection technology [J ] . Big Data , 2016 ,( 1 ): 1 - 18 .

SANJAY B , ARYYA G . A Wavelet-based approach to preserve privacy for classification mining [J ] . Decision Sciences , 2006 , 37 ( 4 ): 623 - 643 .

CIHAN K , HUSEYIN P . Privacy-preserving naive Bayesian classifier-based recommendations on distributed data [J ] . Computational Intelligence , 2015 , 31 ( 1 ): 47 - 69 .

ROY I , SETTY S T V , KILZER A , et al . Airavat:security and privacy for MapReduce [C ] // The 7th Usenix Symposium on Networked Systems Design and Implementation . 2010 : 297 - 312 .

杨绍禹 , 王世卿 . MapReduce 模型下数据隐私保护机制研究 [J ] . 计算机科学 , 2012 , 39 ( 12 ): 153 - 157 .

YANG S Y , WANG S Q . Research on the mechanism of data privacy protection in the MapReduce model [J ] . Computer Science , 2012 , 39 ( 12 ): 153 - 157 .

李洪成 , 吴晓平 , 陈燕 . MapReduce框架下支持差分隐私保护的k-means聚类方法 [J ] . 通信学报 , 2016 , 37 ( 2 ): 124 - 130 .

LI H C , WU X P , CHEN Y . K-means clustering method for differential privacy protection under the framework of MapReduce [J ] . Journal on Communications , 2016 , 37 ( 2 ): 124 - 130 .

DWORK C . A firm foundation for private data analysis [J ] . Communications of the ACM , 2011 , 54 ( 1 ): 86 - 95 .

DWORK C , . Differential privacy [C ] // The 33rd International Colloquium on Automata,Languages and Programming . 2006 : 1 - 12 .

熊平 , 朱天清 , 王晓峰 . 差分隐私保护及其应用 [J ] . 计算机学报 , 2014 , 37 ( 1 ): 101 - 122 .

XIONG P , ZHU T Q , WANG X F . Differential privacy protection and its application [J ] . Journal of Computer Science , 2014 , 37 ( 1 ): 101 - 122 .

丁丽萍 , 卢国庆 . 面向频繁模式挖掘的差分隐私保护研究综述 [J ] . 通信学报 , 2014 , 35 ( 10 ): 200 - 209 .

DING L P , LU G Q . A survey of differential privacy protection for frequent pattern mining [J ] . Journal on Communications , 2014 , 35 ( 10 ): 200 - 209 .

张啸剑 , 孟小峰 . 面向数据发布和分析的差分隐私保护 [J ] . 计算机学报 , 2014 , 37 ( 4 ): 927 - 949 .

MENG X F , ZHANG X J . Differential privacy preserving data publishing and analysis [J ] . Journal of Computers , 2014 , 37 ( 4 ): 927 - 949 .

王保义 , 王冬阳 , 张少敏 . 基于Spark和IPPSO_LSSVM的短期分布式电力负荷预测算法 [J ] . 电力自动化设备 , 2016 , 36 ( 1 ): 117 - 122 .

WANG B Y , WANG D Y , ZHANG S M . Short term distributed load forecasting algorithm based on Spark and IPPSO_LSSVM [J ] . Electric Power Automation Equipment , 2016 , 36 ( 1 ): 117 - 122 .

Views

1491

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰