Lupa

Show document Help

A- | A+ | Print
Title:Efficient material selection for training occluded mmWave radar-based gesture recognisers
Authors:ID Attygalle, Nuwan (Author)
ID Leiva, Luis A. (Author)
ID Kljun, Matjaž (Author)
ID Čopič Pucihar, Klen (Author)
Files:.pdf RAZ_Attygalle_Nuwan_2026.pdf (15,56 MB)
MD5: 0135C381F519077757A71EDC5050472F
 
URL https://www.nature.com/articles/s41598-026-56018-2
 
Language:English
Work type:Article
Typology:1.01 - Original Scientific Article
Organization:FAMNIT - Faculty of Mathematics, Science and Information Technologies
Abstract:Radar-based gesture recognition has emerged as a promising approach for unobtrusive interaction. Unlike camera-based systems, radar sensors can detect gestures through opaque materials, enabling seamless embedding into various everyday objects. However, it remains unclear how to train models efficiently for robust gesture recognition through diverse materials. To investigate this, we collected a dataset of 17,520 gesture recordings performed through 73 everyday materials. By comparing several material-sampling and data-augmentation strategies, we found that a small carefully selected representative subset of training materials was sufficient to match performance of a classifier trained on the full material dataset. Our results showed that the models trained on 14 quota-sampled materials achieved accuracies of 95.8% and 91.2%, comparable to training on all 73 materials (96.8% and 91.6%) and significantly better than training without material data (66.8% and 65.8%). Among the evaluated sampling approaches, Quota sampling also provided the best overall trade-off between performance and practicality. In contrast, classifiers trained on augmented data performed worse than those trained on actual material-specific data. Taken together, these findings indicate that, for the tested sensor, gesture set, and material collection, carefully selected real-material data offer a practical route to reducing material-specific data collection in radar-based gesture recognition while preserving generalisation. Code, models, and data are available in the public repository, with additional details provided in the supplementary materials: https://gitlab.com/hicuplab/seeing-through.
Keywords:deep learning, training optimization for neural networks, millimetre-wave radar, gesture recognition, material selection, sampling, synthetic noise
Publication version:Author Accepted Manuscript
Publication date:13.06.2026
Year of publishing:2026
Number of pages:str. 1-21
Numbering:[Vol.] , article no.
PID:20.500.12556/RUP-23158 This link opens in a new window
UDC:004.93
ISSN on article:2045-2322
DOI:10.1038/s41598-026-56018-2 This link opens in a new window
COBISS.SI-ID:281590275 This link opens in a new window
Publication date in RUP:19.06.2026
Views:41
Downloads:2
Metadata:XML DC-XML DC-RDF
:
Copy citation
  
Average score:(0 votes)
Your score:Voting is allowed only for logged in users.
Share:Bookmark and Share


Hover the mouse pointer over a document title to show the abstract or click on the title to get all document metadata.

Record is a part of a journal

Title:Scientific reports
Shortened title:Sci. rep.
Publisher:Nature Publishing Group
ISSN:2045-2322
COBISS.SI-ID:18727432 This link opens in a new window

Document is financed by a project

Funder:EC - European Commission
Project number:101071147
Name:Context-aware adaptive visualizations for critical decision making
Acronym:SYMBIOTIK

Funder:EC - European Commission
Project number:739574
Name:Renewable materials and healthy environments research and innovation centre of excellence
Acronym:InnoRenew CoE

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:N2-0354-2024
Name:Določanje uporabniške izkušnje z računalniškim psihološkim modeliranjem

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:BI-NO/25-27-007-2025
Name:Uporabniški modeli za razložljive priporočilne sisteme

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:P5-0433-2022
Name:DIGITALNO PRESTRUKTURIRANJE DEFICITARNIH POKLICEV ZA DRUŽBO 5.0 (INDUSTRIJO 4.0)

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:I0-0035-2022
Name:Infrastrukturna skupina Univerze na Primorskem

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J5-50155-2023
Name:DOPOLNJENA RESNIČNOST ZA DOSEGANJE BOLJŠEGA RAZUMEVANJA TROJNE NARAVE KEMIJSKIH POJMOV

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:P1-0383-2017
Name:Kompleksna omrežja

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J1-9186-2018
Name:Razvoj novih računskih orodij na PDB ravni za odkrivanje zdravil

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J1-1715-2019
Name:Atlas proteinskih interakcij za napovedovanje genskih variacij povezanih z interakcijami z zdravili in razvojem bolezni

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J5-1796-2019
Name:E-znanje za duševno zdravje: razvoj, implementacija in evalvacija spletnih intervencij za preprečevanje samomora in krepitev duševnega zdravja

Funder:ARIS - Slovenian Research and Innovation Agency
Project number:J1-1692-2019
Name:Barvanja, dekompozicije in pokritja grafov

Licences

License:CC BY 4.0, Creative Commons Attribution 4.0 International
Link:http://creativecommons.org/licenses/by/4.0/
Description:This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

Language:Slovenian
Abstract:Radarsko prepoznavanje gest se je uveljavilo kot obetaven pristop za nemotečo interakcijo. Za razliko od sistemov, ki temeljijo na kamerah, lahko radarski senzorji zaznavajo geste skozi neprozorne materiale, kar omogoča neopazno vgradnjo v različne vsakdanje predmete. Vendar še ni jasno, kako učinkovito trenirati modele za robustno prepoznavanje gest skozi raznolike materiale. Da bi to raziskali, smo zbrali podatkovno zbirko 17.520 posnetkov gest, izvedenih skozi 73 vsakdanjih materialov. S primerjavo več strategij vzorčenja materialov in bogatenja podatkov smo ugotovili, da je majhna, skrbno izbrana reprezentativna podmnožica učnih materialov zadostovala za doseganje primerljive uspešnosti kot klasifikator, naučen na celotni podatkovni zbirki materialov. Naši rezultati so pokazali, da so modeli, naučeni na 14 materialih, izbranih s kvotnim vzorčenjem, dosegli točnosti 95,8 % in 91,2 %, kar je primerljivo z učenjem na vseh 73 materialih, kjer sta bili točnosti 96,8 % in 91,6 %, ter bistveno bolje kot učenje brez podatkov o materialih, kjer sta bili točnosti 66,8 % in 65,8 %. Med ovrednotenimi pristopi vzorčenja je kvotno vzorčenje ponudilo tudi najboljše splošno razmerje med uspešnostjo in praktičnostjo. Nasprotno pa so klasifikatorji, naučeni na obogatenih podatkih, dosegli slabše rezultate kot tisti, naučeni na dejanskih podatkih za posamezne materiale. Skupaj te ugotovitve kažejo, da pri testiranem senzorju, naboru gest in zbirki materialov skrbno izbrani podatki, pridobljeni z dejanskimi materiali, ponujajo praktično pot za zmanjšanje zbiranja materialno specifičnih podatkov pri radarskem prepoznavanju gest, hkrati pa ohranjajo zmožnost posploševanja. Koda, modeli in podatki so na voljo v javnem repozitoriju, dodatne podrobnosti pa so podane v dopolnilnih gradivih: https://gitlab.com/hicuplab/seeing-through.
Keywords:globoko učenje, milimetrski radar, prepoznavanje gest, izbira materialov, optimizacija treniranja nevronskih mrež, vzorčenje, sintetični šum


Comments

Leave comment

You must log in to leave a comment.

Comments (0)
0 - 0 / 0
 
There are no comments!

Back
Logos of partners University of Maribor University of Ljubljana University of Primorska University of Nova Gorica