Survey on the privacy-preserving content based image retrieval

Ying WU; Xuan LI; Biao JIN; Rongrong JIN

doi:10.11959/j.issn.2096-109x.2019035

您当前的位置：

首页 >

文章列表页 >

Survey on the privacy-preserving content based image retrieval

Special Column:Researches on Key Technologies of Privacy Protection and Its Innovative Applications | 更新时间：2024-06-03

- Survey on the privacy-preserving content based image retrieval
- Chinese Journal of Network and Information Security Vol. 5, Issue 4, Pages: 14-28(2019)
- 作者机构：
  
  1. 福建师范大学数学与信息学院，福建福州 350100
  2. 福建省网络安全与密码技术重点实验室，福建福州 350100
  3. 数字福建大数据安全技术研究所，福建福州 350100
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2019035
  CLC： TP391.41
- Online First：2019-08，
  
  Published：15 August 2019
- 稿件说明：
移动端阅览
Ying WU, Xuan LI, Biao JIN, et al. Survey on the privacy-preserving content based image retrieval[J]. Chinese Journal of Network and Information Security, 2019, 5(4): 14-28.
DOI：

Ying WU, Xuan LI, Biao JIN, et al. Survey on the privacy-preserving content based image retrieval[J]. Chinese Journal of Network and Information Security, 2019, 5(4): 14-28. DOI： 10.11959/j.issn.2096-109x.2019035.

摘要

随着智能设备与社交媒体的广泛普及，图片数据的数量急剧增长，数据拥有者将本地数据外包至云平台，在云服务器上实现数据的存储、分享和检索。然而，图像数据含有大量有关用户的敏感信息，外部攻击者和不完全可信的云服务器都试图获取原始图像的内容，窥探用户隐私，造成严重的隐私泄露风险。回顾了近年来隐私保护需求下图像内容检索技术的研究进展，总结了应用于该技术的图像加密算法，包括同态加密、随机化加密和比较加密，围绕这3种密码技术，详细分析和比较了典型的解决方案，并介绍了索引构造的改进策略。最后，总结和展望了未来的研究趋势。

Abstract

With the widespread popularity of smart devices and social media

the number of image data is exponentially increasing.The data owners tend to outsource the local data to the cloud servers

where data is stored

shared and retrieved.However

the content of users’ image data contains a lot of sensitive information

which may be exposed to the attackers and the incomplete trusted cloud servers

resulting in a serious risk of privacy leakage to users.The research progress of the content-based image retrieval technology under the privacy-preserving in recent years were reviewed

and the key image cryptographic technology were summarized

including homomorphic encryption

randomized encryption and comparative encryption.Around these techniques

the typical solutions are analyzed and compared in detail

and the improvement strategies of index construction are introduced.Finally

the future research directions are discussed.

关键词

Keywords

references

KAMARA S , LAUTER K . Cryptographic cloud storage [C ] // International Conference on Financial Cryptography and Data Security,Berlin:Springer Berlin Heidelberg , 2010 . 136 - 149 .

LEON P , UR B , SHAY R , et al . Why Johnny can't opt out:a usability evaluation of tools to limit online behavioral advertising [C ] // Sigchi Conference on Human Factors in Computing Systems , 2012 : 589 - 598 .

NAIMIA I , WESTREICH D J . Big data:a revolution that will transform how we live,work,and think [J ] . Mathematics ＆ Computer Education , 2014 , 47 ( 17 ): 181 - 183 .

LAGENDIJK R L , BARNI M . Encrypted signal processing for privacy protection:conveying the utility of homomorphic encryption and multiparty computation [J ] . IEEE Signal Processing Magazine , 2013 , 30 ( 1 ): 82 - 105 .

RUPA C , . Privacy preservation of ROI of medical image using squint pixel and PLSB hiding technique [C ] // International Conference on Virtual System ＆ Multimedia . IEEE , 2017 : 1 - 5 .

DUFAUX F . Video scrambling for privacy protection in video surveillance - recent results and validation framework [J ] . Proceedings of SPIE-The International Society for Optical Engineering , 2011 , 8063 : 307 - 314 .

GUDIVADA V N , RAGHAVAN V V . Content based image retrieval systems [J ] . Computer , 1995 , 28 ( 9 ): 18 - 22 .

SMITH J R , CHANG S F . Tools and techniques for color image retrieval [J ] . Proc.of SPIE(The International Society for Optical Engineering) 1996 , 2670 : 32 - 42 .

JAIN A K , VAILAYA A . Image retrieval using color and shape [J ] . Pattern Recognition , 1996 , 29 ( 8 ): 1233 - 1244 .

DUNN D , HIGGINS W E , WAKELEY J . Texture segmentation using 2D Gabor elementary functions [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 1994 , 16 ( 2 ): 0 - 149 .

MANJUNATH B S , MA W Y . Texture features for browsing and retrieval of image data [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 1996 , 18 ( 8 ): 837 - 842 .

LOWE D G . Distinctive image features from scale-invariant keypoints [J ] . International Journal of Computer Vision , 2004 , 60 ( 2 ): 91 - 110 .

JEGOU H , DOUZE M , SCHMID C , et al . Aggregating local descriptors into a compact image representation [C ] // IEEE Conference on Computer Vision and Pattern Recognition . 2010 : 3304 - 3311 .

YANG B , CHEN S . A comparative study on local binary pattern (LBP) based face recognition:LBP histogram versus LBP image [J ] . Neurocomputing , 2013 , 120 ( 10 ): 365 - 379 .

SHEKHAR R , JAWAHAR C V . Word image retrieval using bag of visual words [C ] // IAPR International Workshop on Document Analysis Systems . 2012 : 297 - 301 .

DATAR M , IMMORLICA N , INDYK P , et al . Locality-sensitive hashing scheme based on p-stable distributions [C ] // Twentieth Symposium on Computational Geometry,ACM , 2004 : 253 - 262 .

TIPPING M E , BISHOP C M . Probabilistic principal component analysis [J ] . Journal of the Royal Statistical Society Series B (Statistical Methodology) , 1999 , 61 ( 3 ): 611 - 622 .

JOLLIFFE I T . Principal component analysis [J ] . Journal of Marketing Research , 2002 , 87 ( 100 ):513.

HSU C Y , LU C S , PEI S C . Image feature extraction in encrypted domain with privacy-preserving SIFT [J ] . IEEE Trans Image Processing , 2012 , 21 ( 11 ): 4593 - 4607 .

WANG S M , NASSAR M , ATALLAH M , et al . Secure and private outsourcing of shape-based feature extraction [M ] . Information and Communications Security . Springer International Publishing , 2013 : 90 - 99 .

LI Y M , ZHOU J T , CHENG A , et al . SIFT keypoint removal and injection via convex relaxation [J ] . IEEE Transactions on Information Forensics ＆Security , 2016 , 11 ( 8 ): 1722 - 1735 .

WANG Q , HU S S , REN K , et al . Catch me in the dark:effective privacy-preserving outsourcing of feature extractions over image data [C ] // IEEE International Conference on Computer Communications(INFOCOM) . 2016 : 1 - 9 .

HU S S , WANG Q , WANG J J , et al . SecSIFT:privacy-preserving outsourcing computation of feature extractions over encrypted image data [J ] . IEEE Transactions on Image Processing , 2016 , 25 ( 7 ): 3411 - 3425 .

WONG W K , CHEUNG D W , KAO B , et al . Secure KNN computation on encrypted databases [C ] // ACM Sigmod International Conference on Management of Data . 2009 : 139 - 152 .

卓力 , 龙海霞 , 彭远帆 , 等 . 加密域图像处理综述 [J ] . 北京工业大学学报 , 2016 , 42 ( 2 ): 174 - 183 .

ZHUO L , LONG H X , PENG Y F , et al . Image processing in encrypted domain:a comprehensive survey [J ] . Journal of Beijing University of Technology , 2016 , 42 ( 2 ): 174 - 183 .

FONTAINE C , GALAND F . A survey of homomorphic encryption for nonspecialists [J ] . Eurasip Journal on Information Security , 2007 , 2007 ( 1 ): 1 - 10 .

PAILLIER P , POINTCHEVAL D . Efficient public-key cryptosystems provably secure against active adversaries [C ] // International Conference on the Theory and Applications of Cryptology and Information Security:Advances in Cryptology . Springer-Verlag , 1999 : 165 - 179

MATTON S , MOURET G , BOCQUET R , et al . Sub-image homomorphic filtering technique for improving facial identification under difficult illumination conditions [C ] // International Conference on Systems,Signals ＆ Image Processing,Iwssip , 2006 : 439 - 473 .

LI L , EL-LATIF A A , NIU X . Elliptic curve elgamal based homomorphic image encryption scheme for sharing secret images [J ] . Signal Processing , 2012 , 92 ( 4 ): 1069 - 1078 .

LU W J , VARNA A L , WU M . Confidentiality-preserving image search:a comparative study between homomorphic encryption and distance-preserving randomization [J ] . IEEE Access , 2014 , 2 : 125 - 141 .

ZHANG Y , ZHUO L , PENG Y , et al . A secure image retrieval method based on homomorphic encryption for cloud computing [C ] // International Conference on Digital Signal Processing . IEEE , 2014 : 269 - 274 .

BELLAFQIRA R , COATRIEUX G , BOUSLIMI D , et al . Content-based image retrieval in homomorphic encryption domain [C ] // International Conference of the IEEE Engineering in Medicine and Biology Society . IEEE , 2015 : 2944 - 2947 .

QUELLEC G , LAMARD M , CAZUGUEL G , et al . Wavelet optimization for content-based image retrieval in medical databases [J ] . Medical Image Analysis , 2010 , 14 ( 2 ): 227 - 241 .

BELLAFQIRA R , COATRIEUX G , BOUSLIMI D , et al . An end to end secure CBIR over encrypted medical database [C ] // Engineering in Medicine and Biology Society . IEEE , 2016 :2537.

AHMED E D H , KALASH H M , ALLAH O S F . An efficient chaos-based feedback stream cipher (ECBFSC) for image encryption and decryption [J ] . Informatica , 2007 , 31 ( 1 ): 121 - 129 .

TONG X J , CUI M G . Feedback image encryption algorithm with compound chaotic stream cipher based on perturbation [J ] . Science China(Information Sciences) , 2010 , 53 ( 1 ): 191 - 202 .

LU W J , VARNA A L , SWAMINATHAN A , et al . Secure image retrieval through feature protection [C ] // IEEE International Conference on Acoustics,Speech and Signal Processing . IEEE , 2009 : 1533 - 1536 .

XIA Z H , ZHU Y , SUN X , et al . A similarity search scheme over encrypted cloud images based on secure transformation [J ] . International Journal of Future Generation Communication ＆ Networking , 2013 , 6 ( 6 ): 71 - 80 .

XIA Z H , XIONG N N , VASILAKOS A V , et al . EPCBIR:An efficient and privacy-preserving content-based image retrieval scheme in cloud computing [J ] . Information Sciences , 2017 , 387 : 195 - 204 .

FURUKAWA J , . Request-based comparable encryption [C ] // European Symposium on Research in Computer Security . Springer Berlin Heidelberg , 2013 : 129 - 146

FURUKAWA J , . Short comparable encryption [C ] // International Conference on Cryptology and Network Security . Springer,Cham , 2014 : 337 - 352 .

AGRAWAL R , KIERNAN J , SRIKANT R , et al . Order preserving encryption for numeric data [C ] // ACM SIGMOD IntConf on Management of Data . 2004 : 563 - 574 .

LEE S , PARK T J , LEE D , et al . Chaotic order preserving encryption for efficient and secure queries on databases [J ] . IEICE Transactions on Information and Systems , 2009 , 92 ( 11 ): 2207 - 2217 .

BOLDYREVA A , CHENETTE N , LEE Y , et al . Order-preserving symmetric encryption [C ] // International Conference on Advances in Cryptology-eurocrypt , 2009 : 224 - 241 .

LIU D X , WANG S L . Nonlinear order preserving index for encrypted database query in service cloud environments [J ] . Concurrency ＆ Computation Practice ＆ Experience , 2013 , 25 ( 13 ): 1967 - 1984 .

GAO Y Q , MIAO M X , WANG J F , et al . Secure approximate nearest neighbor search over encrypted data [C ] // IntConf on Broad band ＆ Wireless Computing . IEEE , 2015 : 578 - 583 .

POPA R A , REDFIELD C M S , ZELDOVICH N , et al . CryptDB:protecting confidentiality with encrypted query processing [C ] // ACM Symposium on Operating Systems Principles 2011,Cascais,Portugal,DBLP , 2011 : 85 - 100 .

TANG Q , . Privacy preserving mapping schemes supporting comparison [C ] // 2010 ACM Workshop on Cloud Computing Security Workshop . 2010 : 53 - 58 .

CHEN P , YE J , CHEN X F . Efficient request-based comparable encryption scheme based on sliding window method [J ] . Soft Computing , 2016 , 20 ( 11 ): 4589 - 4596 .

ZOU Q , WANG J F , YE J , et al . Efficient and secure encrypted image search in mobile cloud computing [J ] . Soft Computing , 2017 , 21 ( 11 ): 2959 - 2969 .

LU W J , SWARMINATHAN A , VARNA A , et al . Enabling search over encrypted multimedia databases [C ] // Media Forensics and Security . International Society for Optics and Photonics , 2009 : 725411 - 725418 .

YAO A C , . How to generate and exchange secrets [C ] // Foundations of Computer Science,Symposium on . IEEE , 2008 : 162 - 167 .

申立艳 , 陈小军 , 时金桥 , 等 . 隐私保护集合交集计算技术研究综述 [J ] . 计算机研究与发展 , 2017 , 54 ( 10 ): 2153 - 2169 .

SHEN L Y , CHEN X J , SHI J Q , et al . Survey on private preserving set intersection technology [J ] . Journal of Computer Research and Development , 2017 , 54 ( 10 ): 2153 - 2169 .

LINDELL Y , PINKAS B . A proof of security of yao’s protocol for two-party computation [J ] . Journal of Cryptology , 2009 , 22 ( 2 ): 161 - 188 .

HUANG Y , EVANS D , KATZ J , et al . Faster secure two-party computation using garbled circuits [C ] // Usenix Conference on Security . USENIX Association , 2011 : 35 - 35 .

ZHANG L , JUNG T , FENG P , et al . PIC:enable large-scale privacy preserving content-based image search on cloud [C ] // International Conference on Parallel Processing . IEEE , 2015 : 1 - 1 .

SHEN M , CHENG G , ZHE L , et al . Content-based multi-source encrypted image retrieval in clouds with privacy preservation [J ] . Future Generation Computer Systems , 2018 : 1 - 13 .

JUNG T , LI X Y , WAN M . Collusion-tolerable privacy-preserving sum and product calculation without secure channel [J ] . Journal of Cryptology , 2015 , 12 ( 1 ): 45 - 57 .

FERREIRA B , RODRIGUES J , LEITAO J , et al . Towards an image encryption scheme with content-based image retrieval properties [J ] . Lecture Notes in Computer Science , 2015 : 311 - 318 .

CHENG H , ZHANG X , YU J , et al . Encrypted JPEG image retrieval using block-wise feature comparison [J ] . Journal of Visual Communication ＆ Image Representation , 2016 , 40 : 111 - 117 .

CHENG H , ZHANG X , YU J . AC-coefficient histogram-based retrieval for encrypted JPEG images [J ] . Multimedia Tools and Applications , 2015 , 75 ( 21 ): 13791 - 13803 .

韩威 , 申铭 , 徐彦彦 , 等 . 一种云环境下JPEG图像的安全检索方法 [J ] . 计算机应用研究 , 2017 ( 4 ): 1239 - 1243 .

HAN W , SHEN M , XU Y Y , et al . Secure JPEG image retrieval method under cloud environment [J ] . Application Research of Computers , 2017 ( 4 ): 1239 - 1243 .

HUANG K , XU M , FU S J , et al . Efficient privacy-preserving content-based image retrieval in the cloud [C ] // International Conference on Web-Age Information Management . Springer Inter-national Publishing , 2016 : 28 - 39 .

HUANG Y , ZHANG J , PAN L , et al . Privacy protection in interactive content based image retrieval [J ] . IEEE Transactions on Dependable ＆ Secure Computing , 2018 : 1 - 1 .

ZHU Y , SUN X M , XIA Z H , et al . Enabling similarity search over encrypted images in cloud [J ] . Information Technology Journal , 2014 , 13 ( 5 ): 824 - 831 .

ZHU Y , SUN X M , XIA Z H , et al . Secure similarity search over encrypted cloud images [J ] . International Journal of Security ＆ Its Applications , 2015 , 9 ( 8 ): 1 - 14 .

XIA Z H , ZHU Y , SUN X M , et al . Towards privacy-preserving content-based image retrieval in cloud computing [J ] . IEEE Transactions on Cloud Computing , 2015 , 6 ( 1 ): 276 - 286 .

XIA Z H , WANG X H , ZHANG L G , et al . A privacy-preserving and copy-deterrence content-based image retrieval scheme in cloud computing [J ] . IEEE Transactions on Information Forensics ＆ Security , 2016 , 11 ( 11 ): 2594 - 2608 .

Views

1003

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Survey of zero trust security technology for cloud network integration

Privacy-preserving federated learning framework with irregular-majority users

Efficient and secure multi-user outsourced image retrieval scheme with access control

Study on privacy preserving encrypted traffic detection

Regulatory Bitcoin privacy-preserving mixing service

Related Author

Wu Jiangxing

Chen Hongchang

Tian Le

Hu Yuxiang

Pan Fan

Cui Pengshuai

Wang Zihao

Biao JIN

Related Institution

Institute of Information Technology, Information Engineering University

National Key Laboratory of Advanced Communication Networks

National Key Laboratory of Cyberspace Security, Ministry of Education

College of Computer and Cyber Security, Fujian Normal University

Fujian Provincial Key Laboratory of Network Security and Cryptology, Fujian Normal University

⁰