PIN-a-Boo: Revealing Smartphone PINs via Segmentation and Hand Skeleton Tracking from Video Feeds
| dc.contributor.author | Weich, Patrick | |
| dc.contributor.author | Lobachev, Oleg | |
| dc.contributor.editor | Skala, Václav | |
| dc.date.accessioned | 2025-07-30T10:33:57Z | |
| dc.date.available | 2025-07-30T10:33:57Z | |
| dc.date.issued | 2025 | |
| dc.description.abstract-translated | It is crucial to improve smartphone security, given the prevalence of sensitive information stored on them. This study presents an attack strategy that reveals smartphone PIN entries using computer vision and pattern recognition techniques. By leveraging modern segmentation and hand skeleton tracking, our method accurately identifies and analyzes finger movement patterns, even when partially obscured. We can reliably infer the entered PIN by combining these movement patterns with the smartphone’s position and the on-screen keypad layout. This approach significantly enhances shoulder-surfing attacks, requiring only a video recording of the entry process. Our attack requires much less specialized expertise, making it more accessible. We conclude by analyzing the method’s potential impact and its implications for public safety. | en |
| dc.format | 12 s. | cs |
| dc.format.mimetype | application/pdf | |
| dc.identifier.doi | http://www.doi.org/10.24132/CSRN.2025-31 | |
| dc.identifier.issn | 2464-4617 (Print) | |
| dc.identifier.issn | 2464-4625 (online) | |
| dc.identifier.uri | http://hdl.handle.net/11025/62241 | |
| dc.language.iso | en | en |
| dc.publisher | Vaclav Skala - UNION Agency | en |
| dc.rights | © Vaclav Skala - UNION Agency | en |
| dc.rights.access | openAccess | en |
| dc.subject | počítačové vidění | cs |
| dc.subject | rozpoznávání vzorů | cs |
| dc.subject | zabezpečení chytrých telefonů | cs |
| dc.subject | „showroom surfing“ | cs |
| dc.subject | útok založený na videu | cs |
| dc.subject | soukromí uživatelů | cs |
| dc.subject.translated | computer vision | en |
| dc.subject.translated | pattern recognition | en |
| dc.subject.translated | smartphone security | en |
| dc.subject.translated | shoulder-surfing | en |
| dc.subject.translated | video-based attack | en |
| dc.subject.translated | user privacy | en |
| dc.title | PIN-a-Boo: Revealing Smartphone PINs via Segmentation and Hand Skeleton Tracking from Video Feeds | en |
| dc.type | konferenční příspěvek | cs |
| dc.type | conferenceObject | en |
| dc.type.status | Peer reviewed | en |
| dc.type.version | publishedVersion | en |
| local.files.count | 1 | * |
| local.files.size | 9579663 | * |
| local.has.files | yes | * |