Generative music video composition: using automation to extend creative practice

Abstract

This article outlines the design of a system for dynamic real-time editing of online music video sequences, utilising probabilistic parameters and algorithmic decision-making for progression. It will explain how this system enables videos to be different every time they are accessed, thus providing users with an enhanced viewing experience and creators with a new tool for video composition. As the advancement of online technology influences habits of media consumers, user uptake of new technologies suggests that a transition away from video's prevalent mode of presentation, as a linear sequence of shots, is entirely possible. Factors such as viewer engagement and usability drive the need for ongoing exploration in the use of video for entertainment, information and advertisement. The production of a music video with generative methods is described in this article as a semi-automated process. Human tasks are not replaced by computational execution, but are shifted to become increasingly conceptual.

Keywords:

• generative composition
• music video
• video editing
• new media
• online video is

Notes

¹ The Wilderness Downtown. Accessed May 19, 2013. http://thewildernessdowntown.com/.

² ROME. Accessed May 19, 2013. http://www.ro.me/.

³ Lost In The Echo. Accessed May 19, 2013. http://lostintheecho.com/.

⁴ Michael Sippey, “Vine: A New Way to Share Video.” Twitter Blog, January 24, 2013. Accessed July 9, 2013. https://blog.twitter.com/2013/vine-new-way-share-video. Finlo Rohrer, “Vine: Six Things People have Learned about Six-Second Video in a Week.” BBC News Magazine, January 31, 2013. Accessed July 9, 2013. http://www.bbc.co.uk/news/magazine-21267741. Chris Taylor, “What Makes Vine So Hot?” Mashable, January 30, 2013. Accessed July 9, 2013. http://mashable.com/2013/01/29/vine/.

⁵ Kevin Systrom, “Introducing Video on Instagram.” Instagram Blog, June 20, 2013. Accessed July 9, 2013. http://blog.instagram.com/post/53448889009/video-on-instagram.

⁶ Dan Fost, “‘CineBeat’ App by Smule Makes Music Videos.” San Francisco Chronicle, May 10, 2013. Accessed July 31, 2013. http://www.sfchronicle.com/technology/article/CineBeat-app-by-Smule-makes-music-videos-4503906.php.

⁷ Danielle Tomassini, “Connecting People and the Products They Love.” Google Retail Advertising Blog, May 15, 2013. Accessed May 19, 2013. http://googleretail.blogspot.com.au/2013/05/connecting-people-and-products-they-love.html.

⁸ Rufus Corporation. “whiteonwhite:algorithmicnoir.” Accessed February 17, 2014. http://www.rufuscorporation.com/wowpr.htm.

Additional information

Julia Stefan is a doctoral student at the Queensland College of Art, Griffith University in Brisbane, Australia. Her research interests focus on digital design and online video applications.

Andrew R. Brown is Professor of Digital Arts at the Queensland Conservatorium of Music, Griffith University in Brisbane, Australia. He is an active computer musician and computational artist. His research interests include digital creativity, computational aesthetics, music education and the philosophy of technology.