Multi-biometrics fusion based on dynamic weighting of characteristic signal quality

Wenbing ZHANG; Peishun LIU; Fenghui XUE

doi:10.11959/j.issn.2096-109x.2018022

您当前的位置：

首页 >

文章列表页 >

Multi-biometrics fusion based on dynamic weighting of characteristic signal quality

Papers | 更新时间：2024-06-03

- Multi-biometrics fusion based on dynamic weighting of characteristic signal quality
- Chinese Journal of Network and Information Security Vol. 4, Issue 3, Pages: 59-67(2018)
- 作者机构：
  
  1. 中国海洋大学信息科学与工程学院，山东青岛 266100
  2. 青岛黄海学院国际电子商务学院，山东青岛 266427
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2018022
  CLC： TP391.41
- Online First：2018-03，
  
  Published：15 March 2018
- 稿件说明：
移动端阅览
Wenbing ZHANG, Peishun LIU, Fenghui XUE. Multi-biometrics fusion based on dynamic weighting of characteristic signal quality[J]. Chinese Journal of Network and Information Security, 2018, 4(3): 59-67.
DOI：

Wenbing ZHANG, Peishun LIU, Fenghui XUE. Multi-biometrics fusion based on dynamic weighting of characteristic signal quality[J]. Chinese Journal of Network and Information Security, 2018, 4(3): 59-67. DOI： 10.11959/j.issn.2096-109x.2018022.

摘要

将人脸识别和说话人识别进行决策层级的融合，为应对外界环境对识别结果的影响，引入图像质量和声音质量评价方法，通过对信息质量进行评估，去除信息质量较差的特征，根据信息质量动态调整模块的权重比例，并对单模特征识别匹配度低的个体做拒绝处理，然后根据D-S理论将各个证据合并成为一个新的证据体，实现对用户身份识别。实验结果显示，这种考虑特征信号质量的融合方法可以有效提升识别的准确率和安全性。

Abstract

Face recognition and speaker recognition were integrated at the decision-making level.In order to cope with the influence of the external environment on the recognition result

image quality and sound quality assessment methods were introduced.By evaluating the quality of information

features with poor information quality were removed.Information quality dynamically adjusted the weight proportion of the module

and rejected individuals with low matching degree of single-mode feature recognition.Then

according to DS theory

each evidence was merged into a new body of evidence to realize user identification.The experimental results show that the fusion method which takes into account the characteristic signal quality can effectively improve the recognition accuracy and security.

关键词

Keywords

references

JAIN A , BOLLE R , PANKANTI S . Biometrics Personal Identification in Networked Society [M ] . Boston : Kluwer Academic PublishersPress , 1999 .

绕过三星 Galaxy S8 的虹膜识别？黑客表示非常简单 [EB/OL ] . http://www.freebuf.com/ news/135600.html http://www.freebuf.com/ news/135600.html .

To bypass the iris recognition of samsung Galaxy S8? Hackers say it's very simple [EB/OL ] . http://www.freebuf.com/ news/135600.html http://www.freebuf.com/ news/135600.html .

疯狂的身份证:一张身份证如何攻破人脸识别技术 [EB/OL ] . http://www.freebuf.com/ articles/others-articles/129889.html http://www.freebuf.com/ articles/others-articles/129889.html .

Crazy ID card:how does a card breach face recognition technolo-gy [EB/OL ] . http://www.freebuf.com/articles/others-articles/ 129889.html http://www.freebuf.com/articles/others-articles/ 129889.html .

ROSS A , JAIN A . Information fusion in biometrics [J ] . Pattern Recognition Letters , 2003 , 24 ( 13 ): 2115 - 2125 .

ROSS A , JAIN A . Multimodal biometrics:an overview [C ] // European Signal Processing Conference . 2015 : 1221 - 1224 .

MAURER D E , BAKER J P . Fusing multimodal biometrics with quality estimates via a Bayesian belief network [J ] . Pattern Recognition , 2008 , 41 ( 3 ): 821 - 832 .

NANDAKUMAR K , CHEN Y , JAIN A , et al . Quality-based score level fusion in multibiometric systems [C ] // The International Conference on Pattern Recognition . 2006 : 473 - 476 .

KHIARI-HILI N , MONTAGNE C , LELANDAIS S , et al . Quality dependent multimodal fusion of face and iris biometrics [C ] // The International Conference on Image Processing Theory TOOLS and Applications . 2017 : 1 - 6 .

杨静波 . 融合说话人识别和人脸识别的身份认证 [D ] . 兰州:西北师范大学 , 2016 .

YANG J B . Research on authentication by fusing with speaker recognition and face recognition [D ] . Lanzhou:Northwest Normal University , 2016 .

陈倩 . 多生物特征融合身份识别研究 [D ] . 杭州:浙江大学 , 2007 .

CHEN Q . Multimodel biometric personal identification based on data fusion [D ] . Hangzhou:Zhejiang University , 2007 .

LEE S Y , HAM Y K , PARK R H . Recognition of human front faces using knowledge-based feature extraction and neuro fuzzy algorithm [J ] . Pattern Recognition , 1996 , 29 ( 11 ): 1,863 - 1,876

KIRBY M , SIROVICH L . Application of the karhunen-loeve procedure for the characterization of human faces [J ] . IEEE Transactions on Pattern Analysis ＆ Machine Intelligence , 2002 , 12 ( 1 ): 103 - 108

TAIGMAN Y , YANG M , RANZATO M , et al . DeepFace:closing the gap to human-level performance in face verification [C ] // IEEE Computer Vision and Pattern Recognition . 2014 : 1701 - 1708 .

SUN Y , WANG X , TANG X . Deep learning face representation from predicting 10,000 classes [J ] . Computer Vision ＆ Pattern Recognition , 2014 : 1891 - 1898 .

SUN Y , WANG X , TANG X . Deep learning face REPRESENTA TION by joint identification-verification [J ] . Advances in Neural Information Processing Systems , 2014 , 27 : 1988 - 1996 .

SUN Y , WANG X , TANG X . Deeply learned face representations are sparse,selective,and robust [J ] . Computer Vision ＆ Pattern Recognition , 2015 : 2892 - 2900 .

SUN Y , LIANG D , WANG X , et al . DeepID3:face recognition with very deep neural networks [J ] . Computer Science , 2015 :

SCHROFF F , KALENICHENKO D , PHILBIN J . FaceNet:a unified embedding for face recognition and clustering [J ] . Computer Vision ＆ Pattern Recognition , 2015 : 815 - 823 .

DOUGLAS A , REYNOLDS , QUATIERI T F , et al . Speaker verification using adapted Gaussian mixture models [J ] . Digital Signal Processing , 2000 , 10 ( 1-3 ): 19 - 41 .

KENNY P , BOULIANNE G , OUELLET P , et al . Speaker and session variability in GMM-based speaker verification [J ] . IEEE Transactions on Audio Speech ＆ Language Processing , 2007 , 15 ( 4 ): 1448 - 1460 .

DEHAK N , DEHAK R , KENNY P , et al . Support vector machines versus fast scoring in the low-dimensional total variability space for speaker verification [C ] // Conference of the International Speech Communication Association . 2009 : 1559 - 1562 .

KRYSZCZUK K , DRYGAJLO A . What do quality measures predict in biometrics? [C ] // European Signal Processing Conference . 2015 : 1 - 5 .

HSU R L V , SHAH J , MARTIN B . Quality assessment of facial Images [C ] // Biometric Consortium Conference . 2006 : 1 - 6 .

CAPPELLI R , FERRARA M , MALTONI D . The quality of fingerprint scanners and its impact on the accuracy of fingerprint recognition algorithms [C ] // The International Conference on Multimedia Content Representation . 2006 : 10 - 16 .

ABAZA A , HARRISON M A , BOURLAI T , et al . Design and evaluation of photometric image quality measures for effective face recognition [J ] . Biometrics Iet , 2014 , 3 ( 4 ): 314 - 324 .

BARTOS A L , NELSON D J . Enabling improved speaker recognition by voice quality estimation [C ] // Signals,Systems ＆ Computers . 2012 : 595 - 599 .

SELLAHEWA H , JASSIM S A . Image-quality-based adaptive face recognition [J ] . IEEE Transactions on Instrumentation ＆ Measurement , 2010 , 59 ( 4 ): 805 - 813 .

高修峰 , 张培仁 , 李子青 . 人脸图像质量评估标准 [J ] . 小型微型计算机系统 , 2009 , 30 ( 1 ): 95 - 99

GAO X F , ZHANG P R , LI Z Q . Standardization of face image sample quality [J ] . Journal of Chinese Computer Systems , 2009 , 30 ( 1 ): 95 - 99 .

ABBOUD A J , SELLAHEWA H , JASSIM S A . Quality based approach for adaptive face recognition [C ] // The International Society for Optics and Photonics . 2009 .

WANG Z , BOVIK A C . A universal image quality index [J ] . IEEE Signal Processing Letters , 2002 , 9 ( 3 ): 81 - 84

FERZLI R , KARAM L J . A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB) [J ] . IEEE Transactions on Image Processing , 2009 , 18 ( 4 ): 717 - 28 .

NARVEKAR N D , KARAM L J . A no-reference image blur metric based on the cumulative probability of blur detection (CPBD) [J ] . IEEE Transactions on Image Processing , 2011 , 20 ( 9 ): 2678 - 2683 .

肖宾杰 . 基于图像质量加权的 D-S 证据理论多生物特征融合识别 [J ] . 计算机应用 , 2012 , 32 ( 1 ): 264 - 268 .

XIAO B J . Muti-biometric feature fusion identification based on D-S evident theory of image quality with different weights [J ] . Journal of Computer Applications , 2012 , 32 ( 1 ): 264 - 268

蒋晔 . 基于短语音和信道变化的说话人识别研究 [D ] . 南京:南京理工大学 , 2013 .

JIANG Y . Research on speaker recognition over short utterance and varying channels [D ] . Nanjing:Nanjing University of Science and Technology , 2013 .

BLATNIK R , KANDUS G . Influence of the speech quality in telephony on the automated speaker recognition [C ] // WSEAS International Conference on Circuits . 2011 : 115 - 120

RIX A W , BEERENDS J G , HOLLIER M P , et al . Perceptual evaluation of speech quality (pesq) [J ] . Journal of the Audio Engineering Society , 2001 , 50 ( 10 ): 755 - 764 .

JAIN A , NANDAKUMAR , ROSS K A . Score normalization in multimodal biometric systems [J ] . Pattern Recognition , 2004 , 38 ( 12 ): 2270 - 2285 .

王延平 , 袁杰 , 廖原 , 等 . 利用信息融合技术的缺损目标识别方法 [J ] . 中国图象图形学报 , 2000 , 5 ( 3 ): 237 - 240 .

WANG Y P , YUAN J , LIAO Y , et al . Pattern recognition of oc-cluded objects using information fusion [J ] . Journal of Image and Graphics , 2000 , 5 ( 3 ): 237 - 240 .

Views

1245

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on IoT security situation awareness method based on evidence theory

Identity preserving face completion with generative adversarial networks

Related Author

Jian LI

Tinglu DONG

Jie LI

Xudong WANG

Hongquan WEI

Chao GAO

Ruiyang HUANG

Related Institution

School of Artificial Intelligence, Beijing University of Posts and Telecommunications

School of Computer Science(National Pilot Software Engineering School), Beijing University of Posts and Telecommunications

⁰