Use este identificador para citar ou linkar para este item:
http://www.repositorio.ufop.br/jspui/handle/123456789/15316
Título: | Learning to dance : a graph convolutional adversarial network to generate realistic dance motions from audio. |
Autor(es): | Ferreira, João Pedro Moreira Coutinho, Thiago Malta Gomes, Thiago Luange Silva Neto, José Francisco da Azevedo, Rafael Augusto Vieira de Martins, Renato José Nascimento, Erickson Rangel do |
Palavras-chave: | Human motion generation Sound and dance processing Multimodal learning Conditional adversarial nets Graph convolutional neural networks |
Data do documento: | 2021 |
Referência: | FERREIRA, J. P. et al. Learning to dance: a graph convolutional adversarial network to generate realistic dance motions from audio. Computers & Graphics-UK, v. 94, p. 11-21, 2021. Disponível em: <https://www.sciencedirect.com/science/article/pii/S0097849320301436?via%3Dihub>. Acesso em: 29 abr. 2022. |
Resumo: | Synthesizing human motion through learning techniques is becoming an increasingly popular approach to alleviating the requirement of new data capture to produce animations. Learning to move naturally from music, i.e., to dance, is one of the more complex motions humans often perform effortlessly. Each dance movement is unique, yet such movements maintain the core characteristics of the dance style. Most approaches addressing this problem with classical convolutional and recursive neural models un- dergo training and variability issues due to the non-Euclidean geometry of the motion manifold struc- ture. In this paper, we design a novel method based on graph convolutional networks to tackle the problem of automatic dance generation from audio information. Our method uses an adversarial learn- ing scheme conditioned on the input music audios to create natural motions preserving the key move- ments of different music styles. We evaluate our method with three quantitative metrics of generative methods and a user study. The results suggest that the proposed GCN model outperforms the state-of- the-art dance generation method conditioned on music in different experiments. Moreover, our graph- convolutional approach is simpler, easier to be trained, and capable of generating more realistic mo- tion styles regarding qualitative and different quantitative metrics. It also presented a visual movement perceptual quality comparable to real motion data. The dataset and project are publicly available at: https://www.verlab.dcc.ufmg.br/motion-analysis/cag2020. |
URI: | http://www.repositorio.ufop.br/jspui/handle/123456789/15316 |
Link para o artigo: | https://www.sciencedirect.com/science/article/pii/S0097849320301436?via%3Dihub |
DOI: | https://doi.org/10.1016/j.cag.2020.09.009 |
ISSN: | 00978493 |
Aparece nas coleções: | DECSI - Artigos publicados em periódicos |
Arquivos associados a este item:
Arquivo | Descrição | Tamanho | Formato | |
---|---|---|---|---|
ARTIGO_LearningDanceGraph.pdf | 3,33 MB | Adobe PDF | Visualizar/Abrir |
Os itens no repositório estão protegidos por copyright, com todos os direitos reservados, salvo quando é indicado o contrário.