Large vocabulary automatic chord estimation using bidirectional long short-term memory recurrent neural network with even chance training

Abstract

This paper presents an argument for the necessity of a large vocabulary in automatic chord recognition systems, on the grounds of the requirements of machine musicianship. It proposes a system framework with a skewed class-sensitive training scheme that leads to a preliminary solution to large vocabulary automatic chord estimation. This framework applies a bidirectional long short-term memory recurrent neural network architecture, which employs an ‘even chance’ training scheme to make up for the lack of uncommon chords’ exposure. The main drawback of this approach is the low segmentation quality, which inevitably lowers the upper bound of chord estimation accuracy. Under a large vocabulary evaluation, the proposed system can significantly outperform the baseline system in terms of the overall weighted chord symbol recall, and there is no significant difference between them in terms of average chord quality accuracy. The results demonstrate preliminary success in our approach, and also prove the even chance training scheme to be effective in boosting uncommon chord symbol recalls as well as the average chord quality accuracy.

Keywords:

• Music information retrieval
• automatic chord estimation
• deep learning
• recurrent neural network
• large vocabulary

Notes

Junqi Deng, Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong.

1 music information retrieval exchange:http://www.music-ir.org/mirex/wiki/MIREX_HOME

2 means not a chord

3 http://tangkk.net/label/

4 http://isophonics.net/data-sets

5 https://github.com/tmc323/Chord-Annotations

6 https://staff.aist.go.jp/m.goto/RWC-MDB/

7 https://github.com/tangkk/tangkk-mirex-ace

8 http://www.music-ir.org/mirex/wiki/2013:Audio_Chord_Estimation

9 https://github.com/jpauwels/MusOOEvaluator