Intellectualized forensic technique for Android pattern locks

Jiahao QIU; Weidong QIU; Yangde WANG; Yan ZHA; Yuming XIE; Yan LI

doi:10.11959/j.issn.2096-109x.2022005

您当前的位置：

首页 >

文章列表页 >

Intellectualized forensic technique for Android pattern locks

Research and Development | 更新时间：2024-06-03

- Intellectualized forensic technique for Android pattern locks
- Chinese Journal of Network and Information Security Vol. 8, Issue 1, Pages: 118-127(2022)
- 作者机构：
  
  1. 上海交通大学网络空间安全学院，上海200240
  2. 司法鉴定科学研究院上海市司法鉴定专业技术服务平台司法部司法鉴定重点实验室，上海 200063
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2022005
  CLC： TP309
- Online First：2022-02，
  
  Published：15 February 2022
- 稿件说明：
移动端阅览
Jiahao QIU, Weidong QIU, Yangde WANG, et al. Intellectualized forensic technique for Android pattern locks[J]. Chinese Journal of Network and Information Security, 2022, 8(1): 118-127.
DOI：

Jiahao QIU, Weidong QIU, Yangde WANG, et al. Intellectualized forensic technique for Android pattern locks[J]. Chinese Journal of Network and Information Security, 2022, 8(1): 118-127. DOI： 10.11959/j.issn.2096-109x.2022005.

摘要

在电子数据取证中，如何对手机等移动设备进行屏幕解锁一直是亟待攻克的难题。将手势图形密码这种广泛应用于手机屏幕解锁以及软件访问授权的密码防护机制作为研究对象，针对已有的手势图形密码还原技术存在的隐蔽性差、实用性低、非智能化、场景单一等弊端，从肩膀冲浪、监控摄像、现场取证等场景中抽象出两个基本的威胁模型，提出一种多场景下的手势图形密码侧信道攻击技术方法。该方法以监控摄像头或人工拍摄视频数据为基础，采用智能视觉识别技术，实时而动态地对视频中目标设备和解锁生物关键点进行识别、选择与跟踪；随后采用空间映射和剪枝算法，将离散的跟踪轨迹进行整合，使用降噪算法对跟踪轨迹进行去冗余和优化，定位出视频中绘制手势图形密码的关键转折点；最后将精简的轨迹与手势图形密码的规则进行比对和匹配，根据置信度对实际绘制的手势图形密码进行猜测和还原。实验结果表明，在监控摄像场景中，即设备屏幕可见场景下，所提技术对手势图形密码的 10 次尝试成功率为89%，20次尝试成功率为99.3%；在面对面拍摄场景中，即屏幕和手部关键点被遮挡情况下，10次尝试成功率为82%，20次尝试成功率为89.3%；拍摄水平距离的增加在监控摄像场景下对成功率的影响较明显，但随着尝试次数的增加影响逐渐降低；复杂密码在所提技术中无法起到更好的保护作用，在 20 次尝试内，复杂密码的破解成功率始终高于简单密码；拍摄角度偏转在5°以内对破解成功率几乎没有影响。

Abstract

In the field of digital forensics

how to unlock mobile devices such as phones has always been an urgent problem to overcome.As a special kind of password

pattern lock is widely used in mobile phone screen unlock and software access authorization.Existing pattern lock cracking techniques have several non-negligible disadvantages

such as poor concealment

low practicability

non-intelligence and single application scenario.Two basic threat models were abstracted from shoulder surfing

surveillance camera

and real-time forensics

and a multi-scenario side channel attack on pattern locks was proposed.Based on the data of surveillance camera or manual video

intelligent vision recognition algorithms were adopted to identify

select and track the target device and biological key points in the video dynamically.Then

discrete tracking points were integrated by spatial mapping and pruning algorithm.The denoising algorithm was used to eliminate redundancy and optimize the trajectory.Through procedures above

the original trajectory was simplified into regular polylines defined by several key turning points.Finally

the simplified pattern was compared and matched with the rules of legal pattern locks to inference and retort its actual pattern.Possible candidates will be sorted in the output according to their confidences.Results show that in the surveillance camera scenario

where the device screen is always visible

the cracking success rate of our technique is 89% for 10 attempts and 99.3% for 20 attempts.In the face-to-face scenario

where the subject consciously blocks the screen and his drawing finger

the success rate was 82% after 10 attempts and 89.3% after 20 attempts.In the surveillance camera scenario

the increase of shooting horizontal distance can significantly decrease the cracking success rate.But this effect diminishes with the increase of the number of attempts.Results show that the cracking success rate of the complex password is always higher than that of the simple password during 20 attempts

which means a complex pattern lock cannot play a better protection role if the proposed technique is applied.Shooting angle deflection within 5° has little effect on the success rate of cracking.

关键词

Keywords

references

WEISS R , DE LUCA A . PassShapes:utilizing stroke based authentication to increase password memorability [C ] // Proceedings of the 5th Nordic Conference on Human-computer Interaction:Building Bridges . 2008 : 383 - 392 .

YE G X , TANG Z Y , FANG D Y , et al . Cracking android pattern lock in five attempts [C ] // Proceedings 2017 Network and Distributed System Security Symposium . 2017 .

AVIV A J , GIBSON K L , MOSSOP E , et al . Smudge attacks on smartphone touch screens [J ] . Woot , 2010 , 10 : 1 - 7 .

ZHANG J , ZHENG X L , TANG Z Y , et al . Privacy leakage in mobile sensing:your unlock passwords can be leaked through wireless hotspot functionality [J ] . Mobile Information Systems , 2016 ,(2016):8793025.

ABDELRAHMAN Y , KHAMIS M , SCHNEEGASS S , et al . Stay cool! understanding thermal attacks on mobile-based user authentication [C ] // Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems . 2017 : 3751 - 3763 .

ZHOU M , WANG Q , YANG J X , et al . PatternListener:cracking android pattern lock using acoustic signals [C ] // Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security . 2018 : 1775 - 1787 .

EIBAND M , KHAMIS M , VON ZEZSCHWITZ E , et al . Understanding shoulder surfing in the wild:stories from users and observers [C ] // Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems . 2017 : 4254 - 4265 .

WIEDENBECK S , WATERS J , SOBRADO L , et al . Design and evaluation of a shoulder-surfing resistant graphical password scheme [C ] // Proceedings of the Working Conference on Advanced Visual Interfaces . 2006 : 177 - 184 .

KUMAR M , GARFINKEL T , BONEH D , et al . Reducing shoulder-surfing by using gaze-based password entry [C ] // Proceedings of the 3rd Symposium on Usable Privacy and Security -SOUPS '07 . 2007 : 13 - 19 .

ROTH V , RICHTER K , FREIDINGER R . A PIN-entry method resilient against shoulder surfing [C ] // Proceedings of the 11th ACM Conference on Computer and Communications Security . 2004 : 236 - 245 .

WINKLER T , RINNER B . User-centric privacy awareness in video surveillance [J ] . Multimedia Systems , 2012 , 18 ( 2 ): 99 - 121 .

GELBORD B , ROELOFSEN G . New surveillance techniques raise privacy concerns [J ] . Communications of the ACM , 2002 , 45 ( 11 ): 23 - 24 .

WINKLER T , RINNER B . Security and privacy protection in visual sensor networks:a survey [J ] . ACM Computing Surveys , 2014 , 47 ( 1 ): 2 .

SCHIFF J , MEINGAST M , MULLIGAN D K , et al . Respectful cameras:detecting visual markers in real-time to address privacy concerns [M ] // Protecting Privacy in Video Surveillance , 2009 : 65 - 89 .

KORSHUNOV P , EBRAHIMI T . Using warping for privacy protection in video surveillance [C ] // Proceedings of 2013 18th International Conference on Digital Signal Processing (DSP) . 2013 : 1 - 6 .

GUERAR M , MIGLIARDI M , PALMIERI F , et al . Securing PIN-based authentication in smartwatches with just two gestures [J ] . Concurrency and Computation:Practice and Experience , 2020 , 32 ( 18 ): e5549 .

LU C X , DU B W , WEN H K , et al . Snoopy [J ] . Proceedings of the ACM on Interactive,Mobile,Wearable and Ubiquitous Technologies , 2018 , 1 ( 4 ): 1 - 29 .

WANG C , GUO X N , CHEN Y Y , et al . Personal PIN leakage from wearable devices [J ] . IEEE Transactions on Mobile Computing , 2018 , 17 ( 3 ): 646 - 660 .

SHUKLA D , PHOHA V V . Stealing passwords by observing hands movement [J ] . IEEE Transactions on Information Forensics and Security , 2019 , 14 ( 12 ): 3086 - 3101 .

SHUKLA D , KUMAR R , SERWADDA A , et al . Beware,your hands reveal your secrets! [C ] // Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security . 2014 : 904 - 917 .

CHEN T , FARCASIN M , CHAN-TIN E , . Smartphone passcode prediction [J ] . IET Information Security , 2018 , 12 ( 5 ): 431 - 437 .

BALAGANI K S , CONTI M , GASTI P , et al . SILK-TV:secret information leakage from keystroke timing videos [M ] // Computer Security . Cham : Springer International Publishing , 2018 : 263 - 280 .

BALAGANI K , CARDAIOLI M , CONTI M , et al . PILOT:password and PIN information leakage from obfuscated typing videos [J ] . Journal of Computer Security , 2019 , 27 ( 4 ): 405 - 425 .

XU Y , HEINLY J , WHITE A M , et al . Seeing double:reconstructing obscured typed input from repeated compromising reflections [C ] // Proceedings of the 2013 ACM SIGSAC Conference on Computer ＆ Communications Security . 2013 : 1063 - 1074 .

YUE Q G , LING Z , FU X W , et al . Blind recognition of touched keys on mobile devices [C ] // Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security . 2014 : 1403 - 1414 .

Barrett D . One surveillance camera for every 11 people in Britain,says CCTV survey [J ] . The Telegraph , 2013 ,10.

REDMON J , FARHADI A . YOLOv3:an incremental improvement [J ] . arXiv preprint arXiv:1804.02767 , 2018 .

SIMON T , JOO H , MATTHEWS I , et al . Hand keypoint detection in single images using multiview bootstrapping [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . 2017 : 4645 - 4653 .

LUKEŽIC A , VOJÍR T , ZAJC L C , et al . Discriminative correlation filter with channel and spatial reliability [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition . 2017 : 4847 - 4856 .

DOUGLAS D H , PEUCKER T K . Algorithms for the reduction of the number of points required to represent a digitized line or its caricature [J ] . Cartographica:the International Journal for Geographic Information and Geovisualization , 1973 , 10 ( 2 ): 112 - 122 .

KENDALL M G . Rank correlation methods [J ] . Biometrika , 1957 , 44 ( 1/2 ): 298 .

SPEARMAN C . General intelligence,objectively determined and measured [J ] . The American Journal of Psychology , 1904 , 15 ( 2 ): 201 - 292 .

SUN C , WANG Y , ZHENG J . Dissecting pattern unlock:the effect of pattern strength meter on pattern selection [J ] . Journal of Information Security and Applications , 2014 , 19 ( 4/5 ): 308 - 320 .

Views

339

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Survey of side channel attack on encrypted network traffic

Network slicing deployment method based on isolation level

Fault-injection attack on countermeasure algorithms of RSA-CRT cryptosystem

Security control scheme for cloud data copy based on differential privacy model

Research and simulation of timing attacks on ECC

Related Author

Wei LIN

Bin LU

Yuefei ZHU

Ding LI

Wei YOU

Kaizhi HUANG

Qirun PAN

Pengtao LIU

Related Institution

Information Engineering University

State Key Laboratory of Mathematical Engineering and Advanced Computing

Institute of Network Security,Shandong University

China Standard Software Co.,Ltd.

School of Cyberspace Security,Shandong University of Political Science and Law

⁰