| Naslov: | Gesture recognition on deformable objects using millimeter-wave radar |
|---|
| Avtorji: | ID Attygalle, Nuwan (Avtor)
ID Kljun, Matjaž (Avtor)
ID Čopič Pucihar, Klen (Avtor) |
|---|
| Datoteke: |  https://dl.acm.org/doi/10.1145/3731406.3734979
 RAZ_Attygalle_Nuwan_2025.pdf (9,65 MB)
MD5: 0F8D6BEFC63FC86683974C9764BD72EE
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Neznano |
|---|
| Tipologija: | 1.08 - Objavljeni znanstveni prispevek na konferenci |
|---|
| Organizacija: | FAMNIT - Fakulteta za matematiko, naravoslovje in informacijske tehnologije
|
|---|
| Opis: | Although deformable objects are not typically designed for digital interaction, they offer a largely unexplored potential—any such object could be repurposed as a medium for controlling digital content. While existing approaches embed sensors into deformable objects to enable interaction, this limits scalability and practicality of such systems. An alternative is to perform gesture recognition on deformable objects using a wrist-worn radar sensor. However, when analysing reflected radar signals it is difficult to separate reflections originating from the continues deformations of the object shape and those from the user’s hand and fingers. Additionally, the continuous shape changes of deformable objects introduce changes in radar cross-section, affecting signal variability. Furthermore, user ergonomics—such as variations in hand size, finger dexterity, and strength—are likely to influence the degree of object deformation during interaction. In this paper, we explore whether radar sensing can be used for robust gesture detection on deformable objects, focusing on how well does a system generalize to previously unseen users and what can we do to improve such generalisability. In pursuit of this goal, we record a dataset of 4.3k labelled gestures with Google Soli millimeter-wave radar sensor on a plush toy and demonstrates robust classification performance, achieving accuracy of up to 90% on a five-gesture set. Furthermore, we investigate model generalizability and show that transfer learning improves recognition for previously unseen users, yielding performance gains of up to 20%. These findings highlight the potential of radar-based sensing for spontaneous and practical interaction with deformable objects. |
|---|
| Ključne besede: | gesture recognition, deformable objects, millimeter-wave radar |
|---|
| Datum objave: | 22.06.2025 |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | Str. 50-58 |
|---|
| PID: | 20.500.12556/RUP-21375  |
|---|
| UDK: | 004.9 |
|---|
| DOI: | 10.1145/3731406.3734979 |
|---|
| COBISS.SI-ID: | 240291331 |
|---|
| Datum objave v RUP: | 23.06.2025 |
|---|
| Število ogledov: | 167 |
|---|
| Število prenosov: | 6 |
|---|
| Metapodatki: |    |
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
