Robustness evaluation of commercial liveness detection platform

Pengcheng WANG; Haibin ZHENG; Jianfei ZOU; Ling PANG; Hu LI; Jinyin CHEN

doi:10.11959/j.issn.2096-109x.2022010

您当前的位置：

首页 >

文章列表页 >

Robustness evaluation of commercial liveness detection platform

Research and Development | 更新时间：2024-06-03

- Robustness evaluation of commercial liveness detection platform
- Chinese Journal of Network and Information Security Vol. 8, Issue 1, Pages: 180-189(2022)
- 作者机构：
  
  1. 浙江工业大学信息工程学院，浙江杭州 310023
  2. 信息系统安全技术重点实验室，北京 100101
  3. 浙江工业大学网络空间安全研究院，浙江杭州 310023
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2022010
  CLC： TP391
- Online First：2022-02，
  
  Published：15 February 2022
- 稿件说明：
移动端阅览
Pengcheng WANG, Haibin ZHENG, Jianfei ZOU, et al. Robustness evaluation of commercial liveness detection platform[J]. Chinese Journal of Network and Information Security, 2022, 8(1): 180-189.
DOI：

Pengcheng WANG, Haibin ZHENG, Jianfei ZOU, et al. Robustness evaluation of commercial liveness detection platform[J]. Chinese Journal of Network and Information Security, 2022, 8(1): 180-189. DOI： 10.11959/j.issn.2096-109x.2022010.

摘要

活体检测技术已经成为日常生活中的重要应用，手机刷脸解锁、刷脸支付、远程身份验证等场景都会用到这一技术。但如果攻击者利用虚假视频生成技术生成逼真的换脸视频来攻击上述场景的活体检测系统，将会对这些场景的安全性产生巨大的威胁。针对这个问题使用4种先进的Deepfake技术生成大量的换脸图片和视频作为测试样本，用这些样本来对百度、腾讯等商用活体检测平台的在线API接口进行测试。测试实验结果显示常用的各大商用活体检测平台对 Deepfake 图像的检测成功率普遍很低，并且对图像的质量较为敏感，对真实图像的误检率也很高。其主要原因可能是这些平台设计时针对的是打印照片攻击、屏幕二次翻拍攻击、硅胶面具攻击等传统的活体检测攻击方法，并未将先进的换脸检测技术集成到他们的活体检测算法中，这些平台因此不能够有效应对Deepfake攻击。因此，提出了一种集成活体检测方法Integranet，该方法由4种针对不同图像特征的检测算法集成所得，既能够有效检测出打印照片、屏幕二次翻拍等传统的攻击手段，也能够有效应对先进的Deepfake攻击。在测试数据集上验证Integranet的检测效果，结果显示Integranet检测方法相比较各大商用活体检测平台，对Deepfake图像的检测成功率至少提高35%以上。

Abstract

Liveness detection technology has become an important application in daily life

and it is used in scenarios including mobile phone face unlock

face payment

and remote authentication.However

if attackers use fake video generation technology to generate realistic face-swapping videos to attack the living body detection system in the above scenarios

it will pose a huge threat to the security of these scenarios.Aiming at this problem

four state-of-the-art Deepfake technologies were used to generate a large number of face-changing pictures and videos as test samples

and use these samples to test the online API interfaces of commercial live detection platforms such as Baidu and Tencent.The test results show that the detection success rate of Deepfake images is generally very low by the major commercial live detection platforms currently used

and they are more sensitive to the quality of images

and the false detection rate of real images is also high.The main reason for the analysis may be that these platforms were mainly designed for traditional living detection attack methods such as printing photo attacks

screen remake attacks

and silicone mask attacks

and did not integrate advanced face-changing detection technology into their liveness detection.In the algorithm

these platforms cannot effectively deal with Deepfake attacks.Therefore

an integrated live detection method Integranet was proposed

which was obtained by integrating four detection algorithms for different image features.It could effectively detect traditional attack methods such as printed photos and screen remakes.It could also effectively detect against advanced Deepfake attacks.The detection effect of Integranet was verified on the test data set.The results show that the detection success rate of Deepfake images by proposed Integranet detection method is at least 35% higher than that of major commercial live detection platforms.

关键词

Keywords

references

LITJENS G , KOOI T , BEJNORDI B E , et al . A survey on deep learning in medical image analysis [J ] . Medical Image Analysis , 2017 , 42 : 60 - 88 .

KRISHNAMURTHY B , SARKAR M . Deep-learning network architecture for object detection:U.S.Patent 10,152,655 [P ] . 2018 - 12 - 11 .

DENG L , LIU Y . A joint introduction to natural language pro-cessing and to deep learning [C ] // Proceedings of Deep Learning in Natural Language Processing . 2018 : 1 - 22 .

COLLOBERT R , WESTON J , BOTTOU L , et al . Naturallang-uage processing (almost) from scratch [J ] . Journal of Machine Learning Research , 2011 , 12 ( 8 ): 2493 - 2537 .

XIONG W , DROPPO J , HUANG X , et al . Achieving human parity in conversational speech recognition [J ] . arXiv Preprint Arxiv:1610.05256 , 2016 .

MOUSAVI A , BARANIUK R G . Learning to invert:signal recovery via deep convolutional networks [C ] // Proceedings of 2017 IEEE International Conference on Acoustics,Speech and Signal Processing . 2017 : 2272 - 2276 .

王宇龙 , 刘开元 . 基于面部特征点运动的活体识别方法 [J ] . 网络与信息安全学报 , 2018 , 4 ( 6 ): 36 - 44 .

WANG Y L , LIU K Y . Liveness recognition method based on facial feature point motion [J ] . Chinese Journal of Network and Information Security , 2018 , 4 ( 6 ): 36 - 44 .

马玉琨 , 徐姚文 , 赵欣 , 等 . 人脸识别系统的活体检测综述 [J ] . 计算机科学与探索 , 2021 , 15 ( 7 ): 1195 - 1206 .

MA Y K , XU Y W , ZHAO X , et al . Review of presentation attack detection in face recognition system [J ] . Journal of Frontiers of Computer Science and Technology , 2021 , 15 ( 7 ): 1195 - 1206 .

Deepfakes [EB ] . 2019 .

谢永江 , 姜淑丽 . 我国网络立法现状与问题分析 [J ] . 网络与信息安全学报 , 2015 , 1 ( 1 ): 24 - 30 .

XIE Y J , JIANG S L . Analysis of the situation and problem on the legislation of cyberspace in China [J ] . Chinese Journal of Network and Information Security , 2015 , 1 ( 1 ): 24 - 30 .

乔通 , 姚宏伟 , 潘彬民 , 等 . 基于深度学习的数字图像取证技术研究进展 [J ] . 网络与信息安全学报 , 2021 , 7 ( 5 ): 13 - 28 .

QIAO T , YAO H W , PAN B M , et al . Current study of digital image forensic techniques based on deep learning [J ] . Chinese Journal of Network and Information Security , 2021 , 7 ( 5 ): 13 - 28 .

黄惠芬 , 王志红 , 常玉红 . 数学形态学在数字伪造模糊检测中的应用 [J ] . 网络与信息安全学报 , 2017 , 3 ( 4 ): 20 - 25 .

HUANG H F , WANG Z H , CHANG Y H . Blur detection of digital forgery using mathematical morphology [J ] . Chinese Journal of Network and Information Security , 2017 , 3 ( 4 ): 20 - 25 .

CHEN H S , ROUHSEDAGHAT M , GHANI H , et al . DefakeHop:a light-weight high-performance deepfake detector [J ] . arXiv:2103.06929 , 2021 .

LI Y , LYU S . Exposing DeepFake videos by detecting face-warping artifacts [C ] // Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition Workshops . 2018 .

AFCHAR D , NOZICK V , YAMAGISHI J , et al . MesoNet:a compact facial video forgery detection network [C ] // Proceedings of 2018 IEEE International Workshop on Information Forensics and Security . Piscataway:IEEE Press , 2018 : 1 - 7 .

FENG H , HONG Z , YUE H , et al . Learning generalized spoofcues for face anti-spoofing [J ] . arXiv:2005.03922 , 2020 .

KORSHUNOVA I , SHI W Z , DAMBRE J , et al . Fast face-swap using convolutional neural networks [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision . 2017 : 3697 - 3705 .

NIRKIN Y , KELLER Y , HASSNER T . FSGAN:subject agnostic face swapping and reenactment [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2019 : 7183 - 7192 .

LI L , BAO J , YANG H , et al . FaceShifter:towards high fidelity and occlusion aware face swapping [J ] . arXiv:1912.13457 , 2019 .

SIAROHIN A , S LATHUILIÈRE , TULYAKOV S , et al . first order mot-ion model for image animation [J ] . arXiv:2003.00196 , 2020 .

KARRAS T , LAINE S , AILA T M . A style-based generator architecture for generative adversarial networks [C ] // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 2019 : 4396 - 4405 .

HE Z L , ZUO W M , KAN M N , et al . AttGAN:facial attribute editing by only changing what you want [J ] . IEEE Transactions on Image Processing , 2019 , 28 ( 11 ): 5464 - 5478 .

CHOI Y , CHOI M , KIM M , et al . StarGAN:unified generative adversarial networks for multi-domain image-to-image translation [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . 2018 : 8789 - 8797 .

LIU M , DING Y K , XIA M , et al . STGAN:a unified selective transfer network for arbitrary image attribute editing [C ] // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 2019 : 3668 - 3677 .

YANG X , LI Y Z , LYU S W . Exposing deep fakes using inconsistent head poses [C ] // Proceedings of ICASSP 2019 -2019 IEEE International Conference on Acoustics,Speech and Signal Processing . 2019 : 8261 - 8265 .

龚晓娟 , 黄添强 , 翁彬 , 等 . 基于双层注意力的Deepfake换脸检测 [J ] . 网络与信息安全学报 , 2021 , 7 ( 2 ): 151 - 160 .

GONG X J , HUANG T Q , WENG B , et al . Deepfake swapped face detection based on double attention [J ] . Chinese Journal of Network and Information Security , 2021 , 7 ( 2 ): 151 - 160 .

LI Y Z , CHANG M C , LYU S W . In ICTU OCULI:exposing AI created fake videos by detecting eye blinking [C ] // Proceedings of 2018 IEEE International Workshop on Information Forensics and Security . Piscataway:IEEE Press , 2018 : 1 - 7 .

WANG Z Z , YU Z T , ZHAO C X , et al . Deep spatial gradient and temporal depth learning for face anti-spoofing [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 2020 : 5041 - 5050 .

RÖSSLER A , COZZOLINO D , VERDOLIVA L , et al . FaceForensics++:learning to detect manipulated facial images [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . 2019 : 1 - 11 .

Views

197

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Robust Schnorr-based subgroup multi-signature scheme

Robust deepfake detection method based on siamese network

Survey on adversarial attacks and defense of face forgery and detection

Application and risk response of deep synthesis technology

Robust reinforcement learning algorithm based on pigeon-inspired optimization

Related Author

WANG Zhiwei

ZHU Qiuchi

ZHANG Zhenqi

LIN Shanhe

Haifeng LUO

Liqing HUANG

Wei LI

Tianqiang HUANG

Related Institution

School of Computer Science, Nanjing University of Posts and Telecommunications

Jiangsu Key Laboratory of Big Data Security and Intelligent Processing, Nanjing University of Posts and Telecommunications

Fujian Star-net Communication Company Limited

College of Computer and Cyber Security, Fujian Normal University

Digital Fujian Institute of Big Data Security Technology

⁰