Please use this identifier to cite or link to this item:
http://www.repositorio.ufop.br/jspui/handle/123456789/14456
Title: | Multimodal hand gesture recognition combining temporal and pose information based on CNN descriptors and histogram of cumulative magnitudes. |
Authors: | Escobedo Cárdenas, Edwin Jonathan Cámara Chávez, Guillermo |
Keywords: | Spherical coordinates Keyframe extraction Convolucional neuronal networks Fusion schemes |
Issue Date: | 2020 |
Citation: | ESCOBEDO CÁRDENAS, E. J.; CÁMARA CHÁVEZ, G. Multimodal hand gesture recognition combining temporal and pose information based on CNN descriptors and histogram of cumulative magnitudes. Journal of Visual Communication and Image Representation, v. 67, artigo 102772, 2020. Disponível em: <https://www.sciencedirect.com/science/article/abs/pii/S1047320320300225>. Acesso em: 25 ago. 2021. |
Abstract: | In this paper, we present a new approach for dynamic hand gesture recognition. Our goal is to integrate spatiotemporal features extracted from multimodal data captured by the Kinect sensor. In case the skeleton data is not provided, we apply a novel skeleton estimation method to compute temporal features. Furthermore, we introduce an effective method to extract a fixed number of keyframes to reduce the processing time. To extract pose features from RGB-D data, we take advantage of two different approaches: (1) Convolutional Neural Networks and (2) Histogram of Cumulative Magnitudes. We test different integration methods to fuse the extracted spatiotemporal features to boost recognition performance in a linear SVM classifier. Extensive experiments prove the effectiveness and feasibility of the proposed framework for hand gesture recognition. |
URI: | http://www.repositorio.ufop.br/jspui/handle/123456789/14456 |
metadata.dc.identifier.uri2: | https://www.sciencedirect.com/science/article/abs/pii/S1047320320300225 |
metadata.dc.identifier.doi: | https://doi.org/10.1016/j.jvcir.2020.102772 |
ISSN: | 1047-3203 |
Appears in Collections: | DECOM - Artigos publicados em periódicos |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
ARTIGO_MultimodalGestureRecognition.pdf Restricted Access | 2,33 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.