ACS Applied Computer Science

  • Increase font size
  • Default font size
  • Decrease font size

FEW-SHOT LEARNING WITH PRE-TRAINED LAYERS INTEGRATION APPLIED TO HAND GESTURE RECOGNITION FOR PEOPLE WITH DISABILITIES

Print

Employing vision-based hand gesture recognition for the interaction and communication of disabled individuals is highly beneficial. The hands and gestures of this category of people have a distinctive aspect, requiring the adaptation of a deep learning vision-based system with a dedicated dataset for each individual. To achieve this objective, the paper presents a novel approach for training gesture classification using few-shot samples. More specifically, the gesture classifiers are fine-tuned segments of a pre-trained deep network. The global framework consists of two modules. The first one is a base feature learner and a hand detector trained with normal people hand’s images; this module results in a hand detector ad hoc model. The second module is a learner sub-classifier; it is the leverage of the convolution layers of the hand detector feature extractor. It builds a shallow CNN trained with few-shot samples for gesture classification. The proposed approach enables the reuse of segments of a pre-trained feature extractor to build a new sub-classification model. The results obtained by varying the size of the training dataset have demonstrated the efficiency of our method compared to the ones of the literature.

  • APA 7th style
Elbahri, M., Taleb, N., Ardjoun, S. A. E. M., & Zouaoui, C. M. A. (2024). Few-shot learning with pre-trained layers integration applied to hand gesture recognition for disabled people. Applied Computer Science, 20(2), 1–23. https://doi.org/10.35784/acs-2024-13
  • Chicago style
Elbahri, Mohamed, Nasreddine Taleb, Sid Ahmed El Mehdi Ardjoun, and Chakib Mustapha Anouar Zouaoui. „Few-Shot Learning with Pre-Trained Layers Integration Applied to Hand Gesture Recognition for Disabled People”. Applied Computer Science 20, no. 2 (2024): 1–23.
  • IEEE style
M. Elbahri, N. Taleb, S. A. E. M. Ardjoun, and C. M. A. Zouaoui, „Few-shot learning with pre-trained layers integration applied to hand gesture recognition for disabled people”, Applied Computer Science, vol. 20, no. 2, pp. 1–23, 2024, doi: 10.35784/acs-2024-13.
  • Vancouver style
Elbahri M, Taleb N, Ardjoun SAEM, Zouaoui CMA. Few-shot learning with pre-trained layers integration applied to hand gesture recognition for disabled people. Applied Computer Science. 2024; 20(2):1–23.