Humming2Music: Being A Composer As Long As You Can Humming

Humming2Music: Being A Composer As Long As You Can Humming

Yao Qiu, Jinchao Zhang, Huiying Ren, Yong Shan, Jie Zhou

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence
Demo Track. Pages 7163-7166. https://doi.org/10.24963/ijcai.2023/840

Creating a piece of music is difficult for people who have never been trained to compose. We present an automatic music generation system to lower the threshold of creating music. The system takes the user's humming as input and creates full music based on the humming melody. The system consists of five modules: 1) humming transcription, 2) melody generation, 3) broken chord generation, 4) accompaniment generation, and 5) audio synthesis. The first module transcribes the user's humming audio to a score, and then the melody generation module composes a complete melody based on the user's humming melody. After that, the third module will generate a broken chord track to accompany the full melody, and the fourth module will create more accompanying tracks. Finally, the audio synthesis module mixes all the tracks to generate the music. Through the user experiment, our system can generate high-quality music with natural expression based on the user's humming input.
Keywords:
Multidisciplinary Topics and Applications: MDA: Arts and creativity
Multidisciplinary Topics and Applications: MDA: Other