WeVibe: Weight Change Estimation Through Audio-Induced Shelf Vibrations In Autonomous Stores

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Jiale, Wu, Yuyan, Codling, Jesse R, Chang, Yen Cheng, Gersey, Julia, Zhang, Pei, Noh, Hae Young, Dong, Yiwen
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916618273030144
author Zhang, Jiale
Wu, Yuyan
Codling, Jesse R
Chang, Yen Cheng
Gersey, Julia
Zhang, Pei
Noh, Hae Young
Dong, Yiwen
author_facet Zhang, Jiale
Wu, Yuyan
Codling, Jesse R
Chang, Yen Cheng
Gersey, Julia
Zhang, Pei
Noh, Hae Young
Dong, Yiwen
contents Weight change estimation is crucial in various applications, particularly for detecting pick-up and put-back actions when people interact with the shelf while shopping in autonomous stores. Moreover, accurate weight change estimation allows autonomous stores to automatically identify items being picked up or put back, ensuring precise cost estimation. However, the conventional approach of estimating weight changes requires specialized weight-sensing shelves, which are densely deployed weight scales, incurring intensive sensor consumption and high costs. Prior works explored the vibration-based weight sensing method, but they failed when the location of weight change varies. In response to these limitations, we made the following contributions: (1) We propose WeVibe, a first item weight change estimation system through active shelf vibration sensing. The main intuition of the system is that the weight placed on the shelf influences the dynamic vibration response of the shelf, thus altering the shelf vibration patterns. (2) We model a physics-informed relationship between the shelf vibration response and item weight across multiple locations on the shelf based on structural dynamics theory. This relationship is linear and allows easy training of a weight estimation model at a new location without heavy data collection. (3) We evaluate our system on a gondola shelf organized as the real-store settings. WeVibe achieved a mean absolute error down to 38.07g and a standard deviation of 31.2g with one sensor and 10% samples from three weight classes on estimating weight change from 0g to 450g, which can be leveraged for differentiating items with more than 100g differences.
format Preprint
id arxiv_https___arxiv_org_abs_2502_12093
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle WeVibe: Weight Change Estimation Through Audio-Induced Shelf Vibrations In Autonomous Stores
Zhang, Jiale
Wu, Yuyan
Codling, Jesse R
Chang, Yen Cheng
Gersey, Julia
Zhang, Pei
Noh, Hae Young
Dong, Yiwen
Signal Processing
Systems and Control
J.2; J.7
Weight change estimation is crucial in various applications, particularly for detecting pick-up and put-back actions when people interact with the shelf while shopping in autonomous stores. Moreover, accurate weight change estimation allows autonomous stores to automatically identify items being picked up or put back, ensuring precise cost estimation. However, the conventional approach of estimating weight changes requires specialized weight-sensing shelves, which are densely deployed weight scales, incurring intensive sensor consumption and high costs. Prior works explored the vibration-based weight sensing method, but they failed when the location of weight change varies. In response to these limitations, we made the following contributions: (1) We propose WeVibe, a first item weight change estimation system through active shelf vibration sensing. The main intuition of the system is that the weight placed on the shelf influences the dynamic vibration response of the shelf, thus altering the shelf vibration patterns. (2) We model a physics-informed relationship between the shelf vibration response and item weight across multiple locations on the shelf based on structural dynamics theory. This relationship is linear and allows easy training of a weight estimation model at a new location without heavy data collection. (3) We evaluate our system on a gondola shelf organized as the real-store settings. WeVibe achieved a mean absolute error down to 38.07g and a standard deviation of 31.2g with one sensor and 10% samples from three weight classes on estimating weight change from 0g to 450g, which can be leveraged for differentiating items with more than 100g differences.
title WeVibe: Weight Change Estimation Through Audio-Induced Shelf Vibrations In Autonomous Stores
topic Signal Processing
Systems and Control
J.2; J.7
url https://arxiv.org/abs/2502.12093