Impact in the games industry from practice based research in sound design and soundtrack

Submitting Institution

University of Chichester

Unit of Assessment

Music, Drama, Dance and Performing Arts

Summary Impact Type

Societal

Research Subject Area(s)

Information and Computing Sciences: Artificial Intelligence and Image Processing
Medical and Health Sciences: Neurosciences
Studies In Creative Arts and Writing: Film, Television and Digital Media


Download original

PDF

Summary of the impact

Baysted's creative research practice in composition and sound design culminated in a critically acclaimed and globally distributed commercial racing simulation game. The impacts of this research are worldwide commercial success, enhancement of the user (gamer) experience and the stimulation of public debate and discourse. Evidence is provided in terms of computer games sales, professional and amateur review.

Underpinning research

Much of Baysted's practice as research operates within a commercial context. The commercial brief acts as a series of creative parameters stimulating and necessitating innovation and new insights into the particular genre or form being explored. These innovations and insights have been more widely disseminated as part of the growing sub-discipline of Ludomusicology.

The underpinning research for the impacts described herein relates to Shift 2: Unleashed (2011), a multi-platform racing simulation game published and distributed worldwide by Electronic Arts. Baysted devised the original concept for the soundtrack as well as being audio director, lead sound designer and one of five composers on the project.

In terms of composition Baysted's research explores how music can function, non-diegetically, to enhance the player's experience and depth of immersion when, in the simulation genre, music is never interactive and is very rarely heard during sequences of gameplay. Furthermore, Baysted conceived to re-imagine a range of popular song form material as a hybrid cinematic style score that would function as a cohesive, unifying force governing the player's emotional responses and deepening immersion. This innovative approach had never been used before in the genre. The score fuses contemporary cinematic orchestral language with `distorted' electronica and sound design elements. Additionally, the output utilises and builds upon Baysted's novel approaches to realistic vehicle sound modelling which he has developed in previous projects.

By operating outside the norms of the genre, the score seeks to address the research question by describing at once the `real' racing driver's emotional and psychological journey and by enhancing the player's concomitant experiences. To this end Baysted explored the possibilities of using the `menu' system as a primary interface for the gamer's experience of the score and experimenting with how the visceral and symbolic elements of the sound design might also be used to support the overall experience. Conventionally music and vehicular sound design never share the same signifying space. In Shift 2, however, the sonic and musical experience remains unbroken because layers of processed `pit-to-car radio' transmissions and vehicular sounds are superimposed onto the music. This yields far deeper player immersion than other works in this genre. The outcome was a sonic experience combining innovative score and sound effects that functioned to prepare the player emotionally for the action that follows and to reward their success after it. Furthermore, the score references the musical and orchestrational vocabulary from key films and film genres, and this vocabulary informs and guides the transformation of the rock songs drawing on the intertextual relationship between games and the paramusical phenomena associated with popular music artists (Karen Collins (2008), Game Sound, MIT Press, Cambridge: MA, p.129). The compositional process itself involved finely deconstructing the original recorded song `stems' using original instrumental audio files for each instrument in every song, identifying and isolating each song's `genetic fingerprint', and subjecting the resultant material to a variety of transformational operations including: reharmonisation, reorchestration, metrical reframing, tempo alteration, resynthesis and resampling. These innovations — not before seen in any video game — have been picked up by award panels, reviewers and gamers alike.

In terms of sound design, Baysted's objective was to faithfully recreate the visceral nature of competitive motorsport by placing the game player at the centre of a racing driver's sonic experience. Experimentation with different techniques and tools of audio capture led to each car being recorded on chassis dynamometers or at a racing circuit using an array of specialist microphones positioned strategically internally and externally. Each sonic component was modelled and recreated in game: engine, transmission, surface noises, chassis noises, and impacts with tyre walls, Armco and concrete. The engine sounds were sampled at specific frequencies (RPM) under `load' in order that an innovative crossfading audio model could be constructed in software. The game's physics engine, running at 200hz, `plays' this model depending upon player input, thus the audio is fully and truly dynamic. Environmental sound effects (crowds, tannoy, helicopters) were designed to situate the player at the circuit itself and post-production effects such as reverberation, echo and filtering are deployed to allow the vehicle to interact with objects within its environment realistically.

References to the research

Need for Speed Shift 2: Unleashed, published and distributed worldwide by Electronic Arts Inc., Redwood, California, 2011. ASIN: B004GNGB00 The game was released globally in April 2011 in 3 DVD formats: Microsoft Xbox 360, Sony Playstation 3 and Windows PC. A mobile version of the game for iOS devices was released globally in November 2011.

Since the game's launch in April 2011, Baysted has given papers about the score at conferences and colloquia in Oxford (Royal Musical Association Study Day, St Catherine's College, 2012), Utrecht (2013) and Falmouth (2012) universities, and has presented the work to industry peers at a masterclass at the British Film Institute in London (2012).

The score and game has received a variety of prestigious international peer award nominations (Joystick, Game Audio Network Guild, Golden Reel).

Other projects in which elements of the work that culminate in Shift 2 include:
GTR: FIA Racing Simulation (2005), GTR2: FIA Racing Simulation (2006), GT Legends (2007), BMW M3 Challenge (2007), Need for Speed: Shift (2009), and latterly Ferrari Racing Legends (2012).

Details of the impact

The impacts of Baysted's innovative research into sound design and soundtrack composition in racing simulation achieved primarily through a commercial pathway are threefold:

  • Commercial success of the Shift 2 game;
  • Enhanced enjoyment of gamesplayers;
  • Debate, discourse and commentary in and around the games industry.

These impacts, which are materially and distinctly linked to Baysted's specific and innovative contribution to the simulation games are to some extent inter-dependent and are described in detail below.

Commercial success of the N4S Shift and Shift2 games

Need for Speed is the most successful racing video game series in the world, and one of the most successful video game franchises of all time. Baysted's contribution came to the third generation of the series (releases no. 13 and 17, termed herein as Shift (2009) and Shift2 (2011)); the research described in 2). Relates to the second of these two games. Shift 2 has sold 3.75M units globally and a key factor in the commercial success of this game is the sound design and soundtrack as indicated by these reviews from IGN (the largest games news site in the world, ranked 326 in the world for web traffic of all sites; http://www.alexa.com/siteinfo/ign.com). About the sound design: "The excellent audio visual feeds into this; the cars growl with purpose and they're finely modelled too", and "Shift 2 Unleashed's a violent and immersive racer that recreates the driving experience like no other game on the market..." ; and about the soundtrack "This is a totally unique approach to videogame scores," said Steve Schnur, Worldwide Executive of Music and Marketing for EA. The score and game has received a prestigious international peer award nominations (Golden Joystick, Game Audio Network Guild).

Enhanced enjoyment of gamesplayers

Over 3.75M people worldwide have played the game (not including multi-players per unit and second hand sales) plus many millions more have experienced the score through TV, Cinema and online advertising campaigns. Evidence that the soundtrack makes a substantive contribution to the gamer's experience and enjoyment is provided in the millions of views of YouTube videos of the game featuring its sound design and soundtrack. A search on YouTube for "shift 2 unleashed soundtrack" (in quotes) provides 1550 results, each are video clips from the game. A total of 658 of these are YouTube video clips from Shift 2 game menu screen i.e. no gameplay just sound. The top 10 of the 658 `menu only' clips are clearly downloaded by people just wanting to hear the soundtrack total 611,541 views alone (18/10/13). Comments posted on YouTube in reaction to these re-imagined tracks further underpin the importance of the soundtrack to the quality and intensity of the overall experience, the majority, but not all are positive (quotes, colloquialisms & typos are quoted verbatim) : "this was the best thing off the game!", "Did you know that Rise Against used this mix in one of their Concerts? I don't care if people said this is bad. For me, this is just pure awesomeness.", "...this song and the soundtracks are pretty damn dope, it fits the game perfectly", "The specifically composed soundtracks from Need for Speed 2 and 3 are on antoher level alltogether", "this song reminds me that im in the final GT1 world championship", "It's scary! This is game has been turned into a horror film compared to the 1st one..".

Debate, discourse and commentary in and around the games industry

The game has generated much debate across awards panels fora, blogs, news sites, YouTube and music sales and share sites. The innovation in the game were critical in nomination for Game Audio Network Guild 2012 annual awards: Shift 2 nominated for Best Use Of Licensed Music; and also a factor in the nomination for Best Racing Game in the 2011 Golden Joystick Awards. Some of the sound design techniques for the realistic recreation of engine noise also featured in an earlier instance of the Need for Speed Series (Shift; 2009) leading to a nomination for Best Sound Editing: Computer Entertainment in the 57th annual Golden Reel awards (2010). Reviews by professional critics and amateurs are often sites of debate; there are myriad such reviews online; a Google search of `"need for speed shift" and review' yields 15,100,000 results. Many reviews refer to the audio experience, many citing it as an important feature of the game and the gaming experience (see IGN link above) and others less positive; nevertheless public debate is evidenced; other illustrative reviews are provided in the corroborating sources. The gamers engage in debate too as indicated above; a Google search of "engine sound" "need for speed shift" returns 1,220,00 results. Whilst not always so eloquent as the reviews gamers often pick up on (and argue about) aspects of the sound design and soundtrack, the re-imagined pop/rock hits are either described as awesome or irritating, the engine sounds as realistic or not.

Sources to corroborate the impact

Website for Need for Speed: Shift 2 unleashed:
http://www.needforspeed.com/en_UK/shift-2-unleashed

Confirmation of Baysted as Audio director and composer on Need for Speed: Shift 2 Unleashed
http://www.slightlymadstudios.com/team.html

Illustrative reviews of Need for Speed: Shift 2 unleashed:

Comments taken from YouTube clips for:

Golden Joystick Awards 2011 (Nomination for Best Use Of Licensed Music)
http://www.vgchartz.com/article/87820/golden-joystick-2011-nominees-announced-vote-now/

Golden Reel Awards 2010 (Best Sound Editing — Shift)
http://latimesblogs.latimes.com/awards/2010/01/golden-reel-award-nominees-announced.html