Saved in:
Bibliographic Details
Main Authors: Chen, Jieshan, Wang, Zhen, Sun, Jiamou, Xing, Zhenchang, Lu, Qinghua, Huang, Qing, Xu, Xiwei, Zhu, Liming
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.18084
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914456424939520
author Chen, Jieshan
Wang, Zhen
Sun, Jiamou
Xing, Zhenchang
Lu, Qinghua
Huang, Qing
Xu, Xiwei
Zhu, Liming
author_facet Chen, Jieshan
Wang, Zhen
Sun, Jiamou
Xing, Zhenchang
Lu, Qinghua
Huang, Qing
Xu, Xiwei
Zhu, Liming
contents Mobile apps are essential in daily life but frequently employ deceptive patterns, such as visual emphasis or linguistic nudging, to manipulate user behavior. Existing research largely relies on manual detection, which is time-consuming and cannot keep pace with rapidly evolving apps. Although recent work has explored automated approaches, these methods are limited to intra-page patterns, depend on manual app exploration, and lack flexibility. To address these limitations, we present AppRay, a system that integrates task-oriented app exploration with automated deceptive pattern detection to reduce manual effort, expand detection coverage, and improve performance. AppRay operates in two stages. First, it combines large language model-guided task-oriented exploration with random exploration to capture diverse user interface (UI) states. Second, it detects both intra-page and inter-page deceptive patterns using a contrastive learning-based multi-label classifier augmented with a rule-based refiner for context-aware detection. We contribute two datasets, AppRay-Tainted-UIs and AppRay-Benign-UIs, comprising 2,185 deceptive pattern instances, including 149 intra-page cases, spanning 16 types across 876 deceptive and 871 benign UIs, while preserving UI relationships. Experimental results show that AppRay achieves macro/micro averaged precision of 0.92/0.85, recall of 0.86/0.88, and F1 scores of 0.89/0.85, yielding 27.14% to 1200% improvements over prior methods and enabling effective detection of previously unexplored deceptive patterns.
format Preprint
id arxiv_https___arxiv_org_abs_2411_18084
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps
Chen, Jieshan
Wang, Zhen
Sun, Jiamou
Xing, Zhenchang
Lu, Qinghua
Huang, Qing
Xu, Xiwei
Zhu, Liming
Software Engineering
Artificial Intelligence
Human-Computer Interaction
D.2; I.2; H.5
Mobile apps are essential in daily life but frequently employ deceptive patterns, such as visual emphasis or linguistic nudging, to manipulate user behavior. Existing research largely relies on manual detection, which is time-consuming and cannot keep pace with rapidly evolving apps. Although recent work has explored automated approaches, these methods are limited to intra-page patterns, depend on manual app exploration, and lack flexibility. To address these limitations, we present AppRay, a system that integrates task-oriented app exploration with automated deceptive pattern detection to reduce manual effort, expand detection coverage, and improve performance. AppRay operates in two stages. First, it combines large language model-guided task-oriented exploration with random exploration to capture diverse user interface (UI) states. Second, it detects both intra-page and inter-page deceptive patterns using a contrastive learning-based multi-label classifier augmented with a rule-based refiner for context-aware detection. We contribute two datasets, AppRay-Tainted-UIs and AppRay-Benign-UIs, comprising 2,185 deceptive pattern instances, including 149 intra-page cases, spanning 16 types across 876 deceptive and 871 benign UIs, while preserving UI relationships. Experimental results show that AppRay achieves macro/micro averaged precision of 0.92/0.85, recall of 0.86/0.88, and F1 scores of 0.89/0.85, yielding 27.14% to 1200% improvements over prior methods and enabling effective detection of previously unexplored deceptive patterns.
title From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps
topic Software Engineering
Artificial Intelligence
Human-Computer Interaction
D.2; I.2; H.5
url https://arxiv.org/abs/2411.18084