12
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Recognition of musical beat and style and applications in interactive humanoid robot

      brief-report

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          The musical beat and style recognition have high application value in music information retrieval. However, the traditional methods mostly use a convolutional neural network (CNN) as the backbone and have poor performance. Accordingly, the present work chooses a recurrent neural network (RNN) in deep learning (DL) to identify musical beats and styles. The proposed model is applied to an interactive humanoid robot. First, DL-based musical beat and style recognition technologies are studied. On this basis, a note beat recognition method combining attention mechanism (AM) and independent RNN (IndRNN) [AM-IndRNN] is proposed. The AM-IndRNN can effectively avoid gradient vanishing and gradient exploding. Second, the audio music files are divided into multiple styles using the music signal's temporal features. A human dancing robot using a multimodal drive is constructed. Finally, the proposed method is tested. The results show that the proposed AM-IndRNN outperforms multiple parallel long short-term memory (LSTM) models and IndRNN in recognition accuracy (88.9%) and loss rate (0.0748). Therefore, the AM-optimized LSTM model has gained a higher recognition accuracy. The research results provide specific ideas for applying DL technology in musical beat and style recognition.

          Related collections

          Most cited references28

          • Record: found
          • Abstract: not found
          • Article: not found

          Deep Learning for Audio-Based Music Classification and Tagging: Teaching Computers to Distinguish Rock from Bach

            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            A Comparative Analysis of Hybrid Deep Learning Models for Human Activity Recognition

            Recent advances in artificial intelligence and machine learning (ML) led to effective methods and tools for analyzing the human behavior. Human Activity Recognition (HAR) is one of the fields that has seen an explosive research interest among the ML community due to its wide range of applications. HAR is one of the most helpful technology tools to support the elderly’s daily life and to help people suffering from cognitive disorders, Parkinson’s disease, dementia, etc. It is also very useful in areas such as transportation, robotics and sports. Deep learning (DL) is a branch of ML based on complex Artificial Neural Networks (ANNs) that has demonstrated a high level of accuracy and performance in HAR. Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) are two types of DL models widely used in the recent years to address the HAR problem. The purpose of this paper is to investigate the effectiveness of their integration in recognizing daily activities, e.g., walking. We analyze four hybrid models that integrate CNNs with four powerful RNNs, i.e., LSTMs, BiLSTMs, GRUs and BiGRUs. The outcomes of our experiments on the PAMAP2 dataset indicate that our proposed hybrid models achieve an outstanding level of performance with respect to several indicative measures, e.g., F-score, accuracy, sensitivity, and specificity.
              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              Using deep learning approach and IoT architecture to build the intelligent music recommendation system

                Bookmark

                Author and article information

                Contributors
                Journal
                Front Neurorobot
                Front Neurorobot
                Front. Neurorobot.
                Frontiers in Neurorobotics
                Frontiers Media S.A.
                1662-5218
                04 August 2022
                2022
                : 16
                : 875058
                Affiliations
                Music College, Dalian University , Dalian, China
                Author notes

                Edited by: Mu-Yen Chen, National Cheng Kung University, Taiwan

                Reviewed by: Nuryono S. Widodo, Ahmad Dahlan University, Indonesia; Pei-Hsuan Lin, National Chung Hsing University, Taiwan

                *Correspondence: Yue Chu chuyue@ 123456dlu.edu.cn
                Article
                10.3389/fnbot.2022.875058
                9386054
                35990882
                b059f4bf-24fd-4372-938a-9ca70e5e2e77
                Copyright © 2022 Chu.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

                History
                : 13 February 2022
                : 07 July 2022
                Page count
                Figures: 11, Tables: 0, Equations: 27, References: 28, Pages: 13, Words: 5638
                Categories
                Neuroscience
                Brief Research Report

                Robotics
                multi-modal features,humanoid robot,recurrent neural network,recognition technologies,musical beat and recognition of style source

                Comments

                Comment on this article