MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914881472561152 |
|---|---|
| author | Hu, Yongquan Yeo, Hui-Shyong Yuan, Mingyue Fan, Haoran Elvitigala, Don Samitha Hu, Wen Quigley, Aaron |
| author_facet | Hu, Yongquan Yeo, Hui-Shyong Yuan, Mingyue Fan, Haoran Elvitigala, Don Samitha Hu, Wen Quigley, Aaron |
| contents | The primary focus of this research is the discreet and subtle everyday contact interactions between mobile phones and their surrounding surfaces. Such interactions are anticipated to facilitate mobile context awareness, encompassing aspects such as dispensing medication updates, intelligently switching modes (e.g., silent mode), or initiating commands (e.g., deactivating an alarm). We introduce MicroCam, a contact-based sensing system that employs smartphone IMU data to detect the routine state of phone placement and utilizes a built-in microscope camera to capture intricate surface details. In particular, a natural dataset is collected to acquire authentic surface textures in situ for training and testing. Moreover, we optimize the deep neural network component of the algorithm, based on continual learning, to accurately discriminate between object categories (e.g., tables) and material constituents (e.g., wood). Experimental results highlight the superior accuracy, robustness and generalization of the proposed method. Lastly, we conducted a comprehensive discussion centered on our prototype, encompassing topics such as system performance and potential applications and scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_15722 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing Hu, Yongquan Yeo, Hui-Shyong Yuan, Mingyue Fan, Haoran Elvitigala, Don Samitha Hu, Wen Quigley, Aaron Human-Computer Interaction The primary focus of this research is the discreet and subtle everyday contact interactions between mobile phones and their surrounding surfaces. Such interactions are anticipated to facilitate mobile context awareness, encompassing aspects such as dispensing medication updates, intelligently switching modes (e.g., silent mode), or initiating commands (e.g., deactivating an alarm). We introduce MicroCam, a contact-based sensing system that employs smartphone IMU data to detect the routine state of phone placement and utilizes a built-in microscope camera to capture intricate surface details. In particular, a natural dataset is collected to acquire authentic surface textures in situ for training and testing. Moreover, we optimize the deep neural network component of the algorithm, based on continual learning, to accurately discriminate between object categories (e.g., tables) and material constituents (e.g., wood). Experimental results highlight the superior accuracy, robustness and generalization of the proposed method. Lastly, we conducted a comprehensive discussion centered on our prototype, encompassing topics such as system performance and potential applications and scenarios. |
| title | MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2407.15722 |