Residential College | false |
Status | 已發表Published |
Blind recognition of touched keys on mobile devices | |
Yue, Qinggang1; Ling, Zhen2; Fu, Xinwen1; Liu, Benyuan1; Ren, Kui3; Zhao, Wei4 | |
2017-07-06 | |
Conference Name | 21st ACM Conference on Computer and Communications Security, CCS 2014 |
Source Publication | Proceedings of the ACM Conference on Computer and Communications Security
![]() |
Volume | 2014-November |
Issue | November |
Pages | 1403-1414 |
Conference Date | 11 3, 2014 - 11 7, 2014 |
Conference Place | Scottsdale, AZ, United states |
Author of Source | Association for Computing Machinery |
Abstract | In this paper, we introduce a novel computer vision based attack that automatically discloses inputs on a touch-enabled device while the attacker cannot see any text or popup in a video of the victim tapping on the touch screen. We carefully analyze the shadow formation around the fingertip, apply the optical flow, deformable part-based model (DPM), k-means clustering and other computer vision techniques to automatically locate the touched points. Planar ho-mography is then applied to map the estimated touched points to a reference image of software keyboard keys. Recognition of passwords is extremely challenging given that no language model can be applied to correct estimated touched keys. Our threat model is that a webcam, smartphone or Google Glass is used for stealthy attack in scenarios such as conferences and similar gathering places. We address both cases of tapping with one finger and tapping with multiple fingers and two hands. Extensive experiments were performed to demonstrate the impact of this attack. The per-character (or per-digit) success rate is over 97% while the success rate of recognizing 4-character passcodes is more than 90%. Our work is the first to automatically and blindly recognize random passwords (or passcodes) typed on the touch screen of mobile devices with a very high success rate. Copyright © 2014 ACM. |
DOI | 10.1145/2660267.2660288 |
Language | 英語English |
WOS ID | WOS:000482446400116 |
Scopus ID | 2-s2.0-84910620685 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | University of Macau |
Affiliation | 1.University of Massachusetts, Lowell, United States; 2.Southeast University, China; 3.University at Buffalo, United States; 4.University of Macau, China |
Recommended Citation GB/T 7714 | Yue, Qinggang,Ling, Zhen,Fu, Xinwen,et al. Blind recognition of touched keys on mobile devices[C]. Association for Computing Machinery, 2017, 1403-1414. |
APA | Yue, Qinggang., Ling, Zhen., Fu, Xinwen., Liu, Benyuan., Ren, Kui., & Zhao, Wei (2017). Blind recognition of touched keys on mobile devices. Proceedings of the ACM Conference on Computer and Communications Security, 2014-November(November), 1403-1414. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment