Proceedings

Expressing Musical Ideas with Constraint Programming Using a Model of Tonal Harmony

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. AI, Arts & Creativity. Pages 7753-7761.

https://doi.org/10.24963/ijcai.2024/858

Abstract

The realm of music composition with artificial intelligence stands as a pertinent and evolving field, attracting increasing interest and exploration in contemporary research and practice. This paper presents a constraint-programming based approach to generating four-voice diatonic chord progressions according to established rules of tonal harmony. It uses the strength of constraint programming as a formal logic to rigorously model musical rules and to offer complete control over the set of rules that are enforced. This allows composers to iteratively interact with the model, adding and removing constraints, allowing them to shape the solutions according to their preferences. We define a constraint model of basic tonal harmony, called Diatony. We show that our implementation using the Gecode solver finds optimal solutions in reasonable time and we show how it can be used by a composer to aid in their composition process.

  1. [Ableton AG, 1999] Ableton AG. Ableton Live, 1999.
  2. [Anders and Miranda, 2011] Torsten Anders and Eduardo R Miranda. Constraint programming systems for modeling music theories and composition. ACM Computing Surveys (CSUR), 43(4):1-38, 2011.
  3. Sibelius, 1993.
  4. [Briot and Pachet, 2017] Jean-Pierre Briot and Franc ¸ois Pa- chet. Music generation by deep learning-challenges and directions. arXiv preprint arXiv:1712.04371, 2017.
  5. [Briot et al., 2020] Jean-Pierre Briot, Gaëtan Hadjeres, and Franc ¸ois-David Pachet. Deep learning techniques for mu- sic generation, volume 1. Springer, 2020.
  6. [Cappart et al., 2021] Quentin Cappart, Thierry Moisan, Louis-Martin Rousseau, Isabeau Prémont-Schwarz, and Andre A Cire. Combining reinforcement learning and con- straint programming for combinatorial optimization. In Proceedings of the AAAI Conference on Artificial Intelli- gence, volume 35, pages 3677-3687, 2021.
  7. [Casini et al., 2018] Luca Casini, Gustavo Marfia, and Marco Roccetti. Some reflections on the potential and limitations of deep learning for automated music genera- tion. In 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), pages 27-31, 2018.
  8. [Delecluse et al., 2022] Augustin Delecluse, Pierre Schaus, and Pascal Van Hentenryck. Sequence variables for rout- ing problems. In 28th International Conference on Princi- ples and Practice of Constraint Programming (CP 2022). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2022.
  9. [Dong et al., 2018] Hao-Wen Dong, Wen-Yi Hsiao, Li-Chia Yang, and Yi-Hsuan Yang. Musegan: Multi-track sequen- tial generative adversarial networks for symbolic music generation and accompaniment. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.
  10. [Duha, 2016] Isabelle Duha. L'harmonie en liberté: de la mémoire à l'improvisation. Gérard Billaudot, Armiane Imp., 2016.
  11. [Gauldin, 2004] Robert Gauldin. Harmonic Practice in Tonal Music. Second Edition. W. W. Norton and Com- pany, Inc, 2004. [Gecode Team, 2019] Gecode Team. Gecode: Generic Con- straint Development Environment, 2019. Last accessed on 19/02/2023.
  12. [Hadjeres and Nielsen, 2020] Gaëtan Hadjeres and Frank Nielsen. Anticipation-rnn: Enforcing unary constraints in sequence generation, with application to interactive music generation. Neural Computing and Applications, 32(4):995-1005, 2020.
  13. [Ignatiev et al., 2022] Alexey Ignatiev, Yacine Izza, Peter J Stuckey, and Joao Marques-Silva. Using maxsat for ef- ficient explanations of tree ensembles. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 3776-3785, 2022.
  14. [Kizilay et al., 2020] Damla Kizilay, Pascal Van Henten- ryck, and Deniz T Eliiyi. Constraint programming mod- els for integrated container terminal operations. European Journal of Operational Research, 286(3):945-962, 2020.
  15. [Kotary et al., 2021] James Kotary, Ferdinando Fioretto, Pascal Van Hentenryck, and Bryan Wilder. End-to- end constrained optimization learning: A survey. arXiv preprint arXiv:2103.16378, 2021.
  16. [Lam et al., 2022] Edward Lam, Guy Desaulniers, and Pe- ter J Stuckey. Branch-and-cut-and-price for the electric vehicle routing problem with time windows, piecewise- linear recharging and capacitated recharging stations. Computers & Operations Research, 145:105870, 2022.
  17. [Mao et al., 2018] Huanru Henry Mao, Taylor Shin, and Garrison Cottrell. Deepj: Style-specific music generation. In 2018 IEEE 12th International Conference on Semantic Computing (ICSC), pages 377-382. IEEE, 2018.
  18. [Meehan, 1979] James R Meehan. An artificial intelligence approach to tonal music theory. In Proceedings of the 1979 annual conference, pages 116-120, 1979.
  19. [MuseScore BVBA, 2002] MuseScore BVBA. MuseScore, 2002.
  20. [Nam et al., 2018] Juhan Nam, Keunwoo Choi, Jongpil Lee, Szu-Yu Chou, and Yi-Hsuan Yang. Deep learning for audio-based music classification and tagging: Teaching computers to distinguish Rock from Bach. IEEE signal processing magazine, 36(1):41-51, 2018.
  21. [Nethercote et al., 2007] Nicholas Nethercote, Peter J Stuckey, Ralph Becket, Sebastian Brand, Gregory J Duck, and Guido Tack. Minizinc: Towards a standard CP modelling language. In International Conference on Principles and Practice of Constraint Programming, pages 529-543. Springer, 2007.
  22. [Pachet and Roy, 2001] Franc ¸ois Pachet and Pierre Roy. Mu- sical harmonization with constraints: A survey. Con- straints, 6:7-19, 2001.
  23. [Pachet and Roy, 2014] Franc ¸ois Pachet and Pierre Roy. Im- itative leadsheet generation with user constraints. In ECAI 2014, pages 1077-1078. IOS Press, 2014.
  24. [Purwins et al., 2019] Hendrik Purwins, Bo Li, Tuomas Vir- tanen, Jan Schlüter, Shuo-Yiin Chang, and Tara Sainath. Deep learning for audio signal processing. IEEE Journal of Selected Topics in Signal Processing, 13(2):206-219, 2019.
  25. [Sandred, 2021] Örjan Sandred. Constraint-solving systems in music creation. Handbook of Artificial Intelligence for Music: Foundations, Advanced Approaches, and Develop- ments for Creativity, pages 327-344, 2021.
  26. [Shukla and Banka, 2018] Shipra Shukla and Haider Banka. An automatic chord progression generator based on rein- forcement learning. In 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pages 55-59. IEEE, 2018.
  27. [Smoliar, 1972] Stephen W Smoliar. Music theory-a pro- gramming linguistic approach. In Proceedings of the ACM annual conference-Volume 2, pages 1001-1014, 1972.
  28. [Sprockeels et al., 2023] Damien Sprockeels, Thibault Waf- flard, Peter Van Roy, and Karim Haddad. A constraint formalization of Fux's counterpoint. Actes des Journées d'Informatique Musicale 2023, pages 68-77, 2023.
  29. [Tagg, 1982] Philip Tagg. Analysing popular music: theory, method and practice. Popular music, 2:37-67, 1982.
  30. [Truchet and Codognet, 2004] Charlotte Truchet and Philippe Codognet. Musical constraint satisfaction problems solved with adaptive search. Soft Computing, 8(9):633-640, 2004.
  31. [Tsouros et al., 2023] Dimos Tsouros, Senne Berden, and Tias Guns. Learning to learn in interactive constraint ac- quisition. arXiv preprint arXiv:2312.10795, 2023.
  32. [Van Hentenryck, 1989] Pascal Van Hentenryck. Constraint satisfaction in logic programming. MIT press, 1989.
  33. [Verhaeghe et al., 2020] Hélene Verhaeghe, Siegfried Ni- jssen, Gilles Pesant, Claude-Guy Quimper, and Pierre Schaus. Learning optimal decision trees using constraint programming. Constraints, 25:226-250, 2020.
  34. [Wu et al., 2021] Yusong Wu, Ethan Manilow, Yi Deng, Rigel Swavely, Kyle Kastner, Tim Cooijmans, Aaron Courville, Cheng-Zhi Anna Huang, and Jesse Engel. Midi- ddsp: Detailed control of musical performance via hierar- chical modeling. arXiv preprint arXiv:2112.09312, 2021.
  35. [Zhang, 2021] Jingwen Zhang. Music feature extraction and classification algorithm based on deep learning. Scientific Programming, 2021:1-9, 2021.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards