A Composer’s Guide to Creating with Generative Neural Networks • Molly Jones • GOTO 2023

This presentation was recorded at GOTO Chicago 2023. #GOTOcon #GOTOchgo https://gotochgo.com Molly Jones - Composer, Saxophonist & Software Engineer RESOURCES https://www.mollyjonesmusic.com https://linkedin.com/in/mollyjones101 ABSTRACT While generative text and image models like ChatGPT and DALL-E2 have garnered popular attention, generative music creation has only begun to blossom. This talk will focus on a case study of an independent composer navigating the infrastructure and coding challenges of building, optimizing, and training a deep learning model for audio generation for use in her own compositions. Molly Jones, a composer and software engineer, attempts to develop creative work that is aesthetically, conceptually, and ethically sound while addressing problems of data augmentation, solo coding, and limited resources. The case study does not offer immediate solutions to the problems faced by independent artists but rather a catalog of areas for future research aimed at easing the use of deep learning models in creative contexts. Molly is an Associate Software Consultant at Spantree, LLC, and a Composer in Residence at the University of Toronto, where she explores the intersections of AI and music. [...] TIMECODES 00:00 Intro 04:53 What's in this presentation, and what not? 05:43 Outline 06:05 Background & goals 13:22 Data collection 18:43 Model selection 25:05 Infrastructure 25:47 Development 29:22 Deciding when it's done 34:09 Composition 37:24 Future directions 40:45 Creative exercise 41:50 Gratitude 42:10 Outro Download slides and read the full abstract here: https://gotochgo.com/2023/sessions/2677 RECOMMENDED BOOKS Phil Winder • Reinforcement Learning • https://amzn.to/3t1S1VZ Holden Karau, Trevor Grant, Boris Lublinsky, Richard Liu & Ilan Filonenko • Kubeflow for Machine Learning • https://amzn.to/3JVngcx Kelleher & Tierney • Data Science (The MIT Press Essential Knowledge series) • https://amzn.to/3AQmIRg Lakshmanan, Robinson & Munn • Machine Learning Design Patterns • https://amzn.to/2ZD7t0x Lakshmanan, Görner & Gillard • Practical Machine Learning for Computer Vision • https://amzn.to/3m9HNjP Aurélien Géron • Hands-On Machine Learning with Scikit-Learn, Keras & TensorFlow • https://amzn.to/2XZaQy8 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #AI #ML #NN #NeuralNetworks #ChatGPT #DallE2 #LLC #GenerativeMusic #GenerativeArt #Spantree #MollyJones #UniversityOfToronto #ArtificialIntelligence #MachineLearning #DataScience #DeepLearning #AISymbiosis #EthicalQuandary Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1