Each of the essays in our “Medieval Sound” forum focuses on sound as it, according to Steve Goodman’s essay “The Ontology of Vibrational Force,” in The Sound Studies Reader, “comes to the rescue of thought rather than the inverse, forcing it to vibrate, loosening up its organized or petrified body (70). These investigations into medieval sound lend themselves to a variety of presentation methods loosening up the “petrified body” of academic presentation. Each essay challenges concepts of how to hear the Middle Ages and how the sounds of the Middle Ages continue to echo in our own soundscapes.
Read all the previous posts here, and, HEAR YE!, in April 2017, look for a second series on Aural Ecologies of noise! –Guest Editors Dorothy Kim and Christopher Roman
Freed though they have been from the historiographical pit of the Dark Ages, the Middle Ages inevitably slip ever further into the past. Nonetheless, they have never been easier to visit. We have but to open our computers or turn on our televisions to be transported into the past. As any good Sci-fi show will tell you, we must be careful when we travel into the past; we can change things.
The medium on which I wish to focus – videogame – relies precisely upon on this ability to affect change. It takes aspects of filmic medievalism but must also confront an intrinsic interactivity. This interactive capacity may seem to authenticate further the experience of the past by creating a rich and responsive world but it also frees aspects of narrative agency from the control of game designers, composers, and sound engineers. In this article, I will demonstrate some of the ways in which issues of space/place, identity, orientalism/otherness, and the norms of the medium itself can play out. In recomposing the past – be that with a nod to authenticity, within the realms of historical metafiction, or even the imagined (neo-)medievalism of the fantasy genre – videogames create something that sits between the past and present that nonetheless has a profound effect on the public conception of the medieval soundscape. My focus here is on CD Projekt Red’s high-fantasy game The Witcher III: Wild Hunt, addressing not only the musical score but also wider aspects of soundscape such as vocal accent, foley, and manipulation of the aural field.
The genre of fantasy could be described as medievalist in origin and aesthetic, taking clear inspiration from the medieval world and often using it, or a close approximation, as a geographical, historical, and cultural setting. Many of the more fantastical elements of fantasy too are drawn from medieval bestiaries and the genre of the medieval romance. The late Umberto Eco popularised the term neo-medievalism, albeit in a rather pejorative sense and in opposition to ‘responsible philological study’, to describe this interaction between medieval history and the fantastical. Perhaps due to the rather negative associations of neo-medievalism, both terms tend to be used somewhat interchangeably today.
A divide could perhaps be suggested as to whether medieval aspects are presented as unproblematic and nostalgic, or treated in a more critical and distanced manner. For instance, David Marshall defines neo-medievalism as ‘a self-conscious, ahistorical, non-nostalgic imagining or reuse of the historical Middle Ages that selectively appropriates iconic images…to construct a presentist space that disrupts traditional depictions of the medieval.’ In contrast, Kim Selling notes of medievalism that, after the breakdown of modernist historical metanarratives, the pre-modern world of the medieval offers a ‘rich, satisfying, and authentic’ counterpoint to the ‘profound social, spiritual, and political dislocation’ of postmodernism. From this viewpoint, the world of medievalist fantasy offers pure escapism back to a world in which old certainties can be re-asserted; perhaps, as Elkins notes, a reaction against the rationalistic, anti-heroic, materialist, and empiricist bent of modern society.
Regardless of the author’s framing of ‘the medieval’, it offers many narrative advantages. As Kim Selling has noted, in placing an imagined world in a simplified version of the Western European Middle Ages, the fantasy author can make use of narrative shorthands. The world of kings, queens, knights, peasants, dragons, magic, witches, and elves is already known from myth and fairy tale. These aspects require no explanation but rather build upon a tradition of understood western folkloric conventions – conventions that can also imply certain types of social structure.
The Witcher is certainly situated in a simplified medieval Europe (see the similarity between the coasts of Poland and Nilfgaard) and it clearly occupies a world with presentist concerns. More than this, its extreme use of narrative indeterminacy betrays a staunch adherence to postmodern concepts of storytelling and a distinct anti-heroic edge. The player navigates a world of many shades of grey, often choosing the lesser of many evils. They make decisions – which often result in unintended consequences – based on their own morality and desired outcomes. This said, perhaps the question of whether it could be defined as medievalist or neo-medievalist depends on the actions of the player and precisely the kind of narrative they construct.
An early example of unintended consequences and choosing the lesser of many evils
The visual world inhabited by The Witcher certainly relies on appropriating iconic images; the analogue aural world on appropriating iconic sounds, accents, and musical ideas as the player continuously explores regions with distinct identities, social structures, urban/pastoral settings, and religions. The rational, urban, and merchantile world of Oxenfurt (a city famous for its world-class university with a crest clearly based on that of the University of Cambridge and a name that hints at the university town of Oxford’s medieval etymology) and Novigrad are clearly at odds with the rural peasant life of the Velen wastelands or the Celtic imagery of the Skellige isles.
The landscape and soundscape of Oxenfurt
The landscape and soundscape of Novigrad
The landscape and soundscape of Velen (with multiple examples of the ‘combat music’)
The landscape and soundscape of Skellige (with the ‘combat music’ adapted for this area)
Like much medievalist fantasy the tension between rationalism and the fantastical is one of the central elements of dramatic tension. As the great cities of this world grow and the expansionist Nilfgaardian Empire press forward, the pre-modern world of The Witcher shrinks. Allied to the spread of rationalism, we also see the ‘Church of the Eternal Fire’ (an identifiable stand-in for Christianity) seek to eradicate magic, non-human populations, and more identifiably ‘pagan’ religions. The architecture of its buildings invite comparison with European sacred architecture and its witch hunters and inquisitions with particularly regrettable episodes of European history.
The Temple of the Eternal Fire burning people at the stake
Just as the visuals employ iconic imagery to imply certain ideas, the soundscape’s most important function is to provide the aural analogue of this. One aspect is the score. Within this, individual musical stems are layered in response to player actions. As the composer Marcin Przybylowicz noted in a recent interview with the Tech Times ‘[t]he cues (that were interactive) are divided into smaller layers, which come together, in the case of a combat cue, only when we are dealing with a very powerful enemy. If the enemy is small … only the first layer of the piece will play’. These layers are re-orchestrated in each area so as to preserve its aural identity. In a separate interview with IC-Radio.de, Przybylowicz notes:
No Mans (sic.) Land [Velen] is a war ravaged land… It’s also full of slavic references, pagan beliefs etc. …. Then, there’s Novigrad – the biggest city in northern kingdoms. … I decided music in Novigrad should be more civilized – that’s why there are lots of string instruments playing there (dulcimer, bouzouki, guitars, lutes, cimbalom etc.), and overall tone of the music is lighter, [and] reminds [me] a bit music of [the] Renaissance. Finally, [the] Skellige Isles – [a] region with Celtic, Scottish and Norse references, that had to be reflected in music as well. Use of bagpipes, flutes and Scandinavian folk instruments corresponds with that setting. On top of that, I had to think how it would all work together. That’s where our themes come in … We use those themes in every major location …. [and] we reorchestrate them with instruments corresponding to a particular region.
Combat music in Velen and Skellige respectively. Note how both utilise the orchestration of their own respective areas to alter the main theme and how additional layers are added to the music depending on the intensity of the fighting.
In viewing the different medievalisms on offer in this game, a comparison of the three areas mentioned above is instructive. The Skellige isles, an archipelago which looks curiously like Scottish islands, are occupied by inhabitants with Irish accents. As can be heard in the videos above, the clearly Celtic-influenced music of this area supports this association and the relative lack of diegetic music in this area, combined with natural sounds (the sea, wind, storms) combine to give a sense that the music is a part of the geography. Celtic folk music as a shorthand for the Middle Ages is nothing new. Simon Nugent has noted the tendency of many historically-situated films to draw on Celtic influence. His work has shown that the creation of ‘Celtic’ folk has little to do with a discrete geographical area or with historical accuracy but rather is a modern marketing creation that plays on associations with nature and an escape from modernity. This is precisely the case in The Witcher where, rather than utilising a real historical Celtic medieval repertory, it instead draws on aural cues from the popular medievalism of the filmic soundscape tradition, filtered through the need for an indeterminate score. This ‘packaging’ brings with it associations of an ‘authentic’ Celtic folk tradition as a remnant of the ‘true folk tradition’ that once existed for everyday people elsewhere.
We can perhaps see a link to the works of fantasy writers such as Gael Baudino and Patricia Kennealy-Morrison who turn to pagan Celtic sources as an alternative to what they perceive as the medieval Christian degradation of women, as Jane Tolmey has noted. This association between pagan prehistory, matriarchy, and freedom for women seems a common theme in the popular conception of the past, echoed by theorists such as Albert Classen. The fact that Skellige evokes a recognisably ‘Celtic’ soundscape (relying heavily on the Polish Folk band Percival who collaborated on both new works and who took several from a previous album which were then adapted for indeterminate playback) therefore comes with many associations, drawn almost entirely from the filmic soundscape tradition. This is a pre-modern, pagan land; a land with an authentic peasant class: roughhewn but honest. This Celtic imagery and soundscape also offers a counterpoint to the sexual politics of other areas. Women can more easily participate in areas which might otherwise be seen as male-dominated: depending on the actions of the player, a woman may rule Skellige. A matriarchal class of priestesses govern the region’s predominant religion in stark contrast to the male Priests in other areas. The soundscape here is therefore absolutely crucial to the identity of this area. In creating a Celtic sonic identity – equal part music and accent – the game designers have created a rich culture that need only be hinted at to be understood.
By contrast, the urban world of Novigrad and Oxenfurt is far less folk-influenced. Unlike the other areas of the game, it does not draw so heavily on either the pre-existent or newly composed music of Percival, make such explicit use of folk instrumentation, and seems far more closely related to a Renaissance dance music tradition. The urban/pastrol divide is enhanced by the sounds of a busy city compared to the sounds of nature and the frequent cries of the townsfolk give a sense of bustling urban life (this time with accents from the North of England – compare HBO’s Game of Thrones).
Compared to the wind instruments and female vocals of Skellige, percussion and plucked/struck strings predominate. There is indeed more of a Renaissance feel in an area already touched by modernity. Most notably, there is more diegetic music in these two cities. We frequently see and hear small Renaissance dance bands, using period instruments, entertaining crowds (watch from around 3:45 of the above video of Novigrad for an example; note how diegetic music slowly enters the soundtrack as they are approached). Perhaps the most significant diegetic moment, however, is the song by the Trobaritz Priscilla. The audio and visuals are surprisingly well matched, and the tuning of the lute adds emphasis to the fact of live performance. As a video cut-scene, this is one of few moments in the game where the player has no ability to affect their environs and must simply watch and listen.
Far more so than in other areas, the music in Novigrad and Oxenfurt is for and by people. This is in marked contrast to the soundscapes found on Skellige and in Velen where the music is almost purely non-diegetic. In contrast to the pre-Christian matriarchal associations of the priestesses of Skellige is the aural handling of the Temple of the Eternal Fire in Novigrad and its male priests. As Adam Whittaker has recently identified, there is a clear link between musicological discourse on purely vocal performance in Christian sacred space in Early Music, and its representation on screen. Male a capella voices, and a ‘chanting’ vocal style (again hinting at plainchant, rather than using pre-existent chant music), are often used to denote the aural identity of a church. Precisely this kind of vocal delivery is added to the soundtrack as the player moves closer to the Temple of the Eternal Fire, explicitly linking this Christian association with the aural presence of the Temple. The contrast with the female-dominated vocals elsewhere enhances the distinction and re-enforces the links between the ostensibly pre-Christian worlds of Skellige and Velen and the Christian associations made in Novigrad.
Approaching the Temple of the Eternal Fire
The music of the Velen wasteland and the neighbouring White Orchard, like Skellige, is more folk influenced, yet clearly distinct. Gone are the Celtic folk influences; instead, this area fuses a cinematic pastoral idyll (again laden with nature sounds and with a peasantry speaking with West Country accents – compare the idyllic ‘Shire’ in Peter Jackson’s The Lord of the Rings) with a dark and sinister undertone which draws on the ‘otherness’ of many non-western and folk instruments, particularly the kemenche, electric cello, hurdy gurdy, bowed gusli, gheychak, and the bowed yaylı – the vast majority of which only enter the soundscape in this area. The use of the medieval as a source of dangerous and primitive ‘otherness’ is common at the moment (evidinced, for instance, by the many recent descriptions in the West of the so-called Islamic State as ‘medieval’) and draws on modernist thought which characterized the middle ages as a period of dark and dangerous alterity between the glories of antiquity and the Renaissance.
That the soundscape of The Witcher draws on competing categorisations of the medieval as ‘dangerous’ and ‘pastoral’ says much about the mutability of medievalisms. Musically, this ‘otherness’ can be expressed as a kind of orientalism, both exotic and dangerous, and the microtonal inflections and use of glissandi here give a sinister undertone to what is otherwise a quintessentially pastoral film score. This area has one of the most memorable parts of the entire soundtrack ‘Ladies of the Wood’, underscoring a genuinely horrific narrative and visuals (some of the consequences of which are shown in the first video of this post with a lengthier section of the music given below). The exotic instrumentation combined with the driving repetition, at odds with an audio usually so responsive to the player’s actions, makes the experience unsettling and claustrophobic.
Ladies of the Wood
Taken together, these very distinctive sound worlds serve to demonstrate some of the many medieval soundscapes which permeate our collective consciousness. In utilising iconic aural cues, composers and sound designers in a neo-medievalist tradition can conjure up particular cultural and social structures with ease, taking many of the shorthands which have emerged from the TV and film traditions in recent years. The indeterminacy inherent to videogame, and the common response of using audio stems, means that the soundscape moves far beyond what is possible in TV and film. However, it also makes problematic the concept of using real, historically-informed music from the period being invoked which would not be able to respond to the interactivity of the world. In The Witcher, the decisions we make effect the world around us, including its soundscape. The effect is crucial both to helping to conjure the world of The Witcher and to helping us feel immersed in it – perhaps paradoxically this may make the soundworld invoked seem more authentic even if it simultaneously reduces the possibility of using ‘authentic’ historical repertoire.
Featured image by Carlos Santos @YouTube CC BY.
James Cook is a University Teacher in Music at the University of Sheffield. His work focuses on the musical period that falls neatly between the Middle Ages and the Renaissance. In particular, the ways that musical cultures in this period interact and how expatriate groups (merchants, clergy, and nobility) imported and used music. Some of his work (like this essay) concerns the representation of early music on stage and screen, be that the use of ‘real’ early music in multimedia productions, the imaginative re-scoring of historical dramas, or even the popular medievalism of the fantasy genre.
REWIND! . . .If you liked this post, you may also dig:
Sounding Out! Podcast #49: Sound and Sexuality in Video Games – Milena Droumeva and Aaron Trammell
Papa Sangre and the Construction of Immersion in Audio Games— Enongo Lumumba-Kasongo
Throughout the month of March, nerdcore MCs Mega Ran (Raheem Jarbo) and Sammus (Enongo Lumumba-Kasongo) will be embarking on the “Rappers with Arm Cannons” Tour. Both artists independently based their monikers on two of the most notable video game characters to possess arm cannons, (Mega Man and Samus respectively), but they have since collaborated on several songs and a SoundScan charting Castlevania project, as well as sharing the stage at numerous concert venues and conventions, and releasing individual albums and videos that have received international attention and critical acclaim. Now three years later the two teachers-turned-rappers have decided to take their show on the road alongside rapper and sound engineer Storyville (Matthew Weisse), who has recently joined forces with Mega Ran to release their February 2015 album “Soul Veggies.”
While at first glance the name of the tour appears a bit tongue-in-cheek, it calls necessary attention to the growing presence of Black nerdcore artists like Mega Ran and Sammus who cast their experiences as people of color against the backdrop of nerd and geek culture. In Mega Ran’s case, this has meant writing verses about his struggle to make sense of his Black nerd identity while growing up amongst a very rough crowd in Philadelphia. For Sammus, being a rapper with an arm cannon has largely meant reconciling her ideas about the lack of diverse representations of Black women in notable movies, games, and cartoons among other media forms.
Both Mega Ran and Sammus began making beats on the Playstation game MTV Music Generator. Since that time Sammus has brought together the production styles of Kanye West, Daft Punk, Björk and various video game composers to produce beats that are rich with video game synths and uniquely chopped samples. Mega Ran has similarly drawn on his love of hip hop artists, such as Redman, Nas, and Busta Rhymes as well as music from video games such as Mega Man, Final Fantasy VII, and River City Ransom.
On Tuesday, March 10th, the tour stopped at Cornell University’s Just About Music center where SO! Editors J. Stoever And Aaron Trammell sat down with the trio for a very frank and open discussion on how to survive and thrive as independent artists in the new music economy. Here’s a choice sample of that conversation:
The tour began on March 5th in NYC and will continue through March 19th with final stops in Austin, TX at this year’s South-by-South-West (SXSW). For full details on tall of the dates visit http://sammusmusic.com/shows-tour-dates/
Enongo Lumumba-Kasongo is a PhD student in the Department of Science and Technology Studies at Cornell University. Since completing a senior thesis on digital music software, tacit knowledge, and gender under the guidance of Trevor Pinch, she has become interested in pursuing research in the emergent field of sound studies. She hopes to combine her passion for music with her academic interests in technological systems, bodies, politics and practices that construct and are constructed by sound. More specifically she would like to examine the politics surrounding low-income community studios, as well as the uses of sound in (or as) electronic games. In her free time she produces hip hop beats and raps under the moniker Sammus (based on the video game character, Samus Aran, from the popular Metroid franchise).
Making Music at Studio X: The Identity Politics of Community Studios-Enongo Lumumba-Kasongo
SO! Amplifies: Regina Bradley’s Outkasted Conversations-Regina Bradley
It’s an all too familiar movie trope. A bug hidden in a flower jar. A figure in shadows crouched listening at a door. The tape recording that no one knew existed, revealed at the most decisive of moments. Even the abrupt disconnection of a phone call manages to arouse the suspicion that we are never as alone as we may think. And although surveillance derives its meaning the latin “vigilare” (to watch) and French “sur-“ (over), its deep connotations of listening have all but obliterated that distinction.
This month, SO! Multimedia Editor Aaron Trammell curates a forum on Sound and Surveillance, featuring the work of Robin James and Kathleen Battles. And so it begins, with Aaron asking. . .”Want to Play a Game?” –JS
It’s eleven o’clock on a Sunday night and I’m in the back room of a comic book store in Scotch Plains, NJ. Game night is wrapping up. Just as I’m about to leave, someone suggests that we play Pit, a classic game about trading stocks in the early 20th century. Because the game is short, I decide to give it a go and pull a chair up to the table. In Pit, players are given a hand of nine cards of various farm-related suits and frantically trade cards with other players until their entire hand matches the same suit. As play proceeds, players hold up a set of similar cards they are willing to trade and shout, “one, one, one!,” “two, two, two!,” “three, three, three!,” until another player is willing to trade them an equivalent amount of cards in a different suit. The game only gets louder as the shouting escalates and builds to a cacophony.
As I drove home that night, I came to the uncomfortable realization that maybe the game was playing me. I and the rest of the players had adopted similar dispositions over the course of the play. As we fervently shouted to one another trying to trade between sets of indistinguishable commodities, we took on similar, intense, and excited mannerisms. Players who would not scream, who would not participate in the reproduction of the game’s sonic environment, simply lost the game, faded out. As for the rest of us, we became like one another, cookie-cutter reproductions of enthusiastic, stressed, and aggravated stock traders, getting louder as we cornered the market on various goods.
We were caught in a cybernetic-loop, one that encouraged us to take on the characteristics of stock traders. And, for that brief period of time, we succumbed to systems of control with far reaching implications. As I’ve argued before, games are cybernetic mechanisms that facilitate particular modes of feedback between players and the game state. Sound is one of the channels through which this feedback is processed. In a game like Pit, players both listen to other players for cues regarding their best move and shout numbers to the table representing potential trades. In other games, such as Monopoly, players must announce when they wish to buy properties. Although it is no secret that understanding sound is essential to good game design, it is less clear how sound defines the contours of power relationships in these games. This essay offers two games, Mafia, and Escape: The Curse of the Temple as case studies for the ways in which sound is used in the most basic of games, board games. By fostering environments that encourage both mimetic control and affective conditioning game sound draws players into the devious logic of cybernetic systems.
Understanding the various ways that sound is implemented in games is essential to understanding the ways that game sound operates as both a form of mimetic control and affective conditioning. Mimetic control is, at its most simple, the power of imitation. It is the degree to which we become alike when we play games. Mostly, it happens because the rules invoke a variety of protocols which encourage players to interact according to a particular standard of communication. The mood set by game sound is the power of affective conditioning. Because we decide what we interact with on account of our moods, moments of affective conditioning prime players to feel things (such as pleasure), which can encourage players to interact in compulsive, excited, subdued, or frenetic ways with game systems.
A game where sound plays a central and important role is Mafia (which has a number of other variants like Werewolf and The Resistance). In Mafia, some players take the secret role of mafia members who choose players to “kill” at night, while the eyes of the others are closed. Because mafia-team players shuffle around during the game and point to others in order to indicate which players to eliminate while the eyes of the other players are closed, the rules of the game suggest that players tap on things, whistle, chirp, and make other ambient noises while everyone’s eyes are closed. This allows for the mafia-team players to conduct their business secretly, as their motions are well below the din created by the other players. Once players open their eyes, they must work together to deduce which players are part of the mafia, and then vote on who to eliminate from the game. Here players are, in a sense, controlled by the game to provide a soundtrack. What’s more, the eeriness of the sounds produced by the players only accentuate the paranoia players feel when taking part in what’s essentially a lynch-mob.
The ambient sounds produced by players of Mafia have overtones of mimetic control. Protocols governing the use of game audio as a form of communication between bodies and other bodies, or bodies and machines, require that we communicate in particular ways at set intervals. Different than the brutal and martial forms of discipline that drove disciplinary apparatuses like Bentham’s panopticon, the form of control exerted through interactive game audio relies on precisely the opposite premise. What is often termed “The Magic Circle of Play” is suspect here as it promises players a space that is safe and fundamentally separate from events in the outside world. Within this space somewhat hypnotic behavior-patterns take place under the auspices of being just fun, or mere play. Players who refuse to play by the rules are often exiled from this space, as they refuse to enter into this contract of soft social norms with others.
Escape: The Curse of the Temple relies on sound to set a game mood that governs the ways that players interact with each other. In Escape, players have ten minutes (of real time) where they must work together to navigate a maze of cardboard tiles. Over the course of the game there are two moments when players must return to the tile that they started the game on, and these are announced by a CD playing in the background of the room. When this occurs, a gong rings on the CD and rhythms of percussion mount in intensity until players hear a door slam. At this point, if players haven’t returned to their starting tile, they are limited in the actions they can take for the rest of the game. In the moments of calm before players make a mad dash for the entrance, the soundtrack waxes ambient. It offers the sounds of howling-winds, rattling chimes, and yawning corridors.
The game is spooky, overall. The combination of haunting ambient sounds and moments where gameplay is rushed and timed, makes for an adrenaline-fueled experience contained and produced by the game’s ambient soundtrack. The game’s most interesting moments come from points where one player is trapped and players must decide whether they should help their friend or help themselves. The tense, haunting, soundtrack evokes feelings of high-stakes immersion. The game is fun because it produces a tight, stressful, and highly interactive experience. It conditions its players through the clever use of its soundtrack to feel the game in an embodied and visceral way. Like the ways that horror movies have used ambient sounds to a great effect in producing tension in audiences (pp.26-27), Escape: The Curse of the Temple encourages players to immerse themselves in the game world by playing upon the tried and true affective techniques that films have used for years. Immersed players feel an increased sense of engagement with the game and because of this they are willingly primed to engage in the mimetic interactive behaviors that engage them within the game’s cybernetic logic.
These two forms of power, mimetic control and affective conditioning, often overlap and coalesce in games. Sometimes, they meet in the middle during games that offer a more or less adaptive form of sound, like Mafia. Players work together and mimic each other when reproducing the ambient forms of quiet that constitute the atmosphere of terror that permeates the game space. Even the roar of bids which occurs in Pit constitutes a form of affective conditioning that encourages players to buy, buy, buy as fast as possible. Effectively simulating the pressure of The Stock Exchange.
Although there is now a growing discipline around the production of game audio, there is relatively little discourse that attempts to understand how the implementation of sound in games functions as a mode of social control. By looking at the ways that sound is implemented in board and card games, we can gain insight of the ways in which it is implemented in larger technical systems (such as computer games), larger aesthetic systems (such as performance art), economic systems (like casinos and the stock market), and even social systems (like parties). Furthermore, it is easy to describe more clearly the ways in which game audio functions as a form of soft power through techniques of mimetic control and affective conditioning. It is only by understanding how these techniques affect our bodies that we can begin to recognize our interactions with large-scale cybernetic systems that have effects reaching beyond the game itself.
Aaron Trammell is co-founder and Multimedia Editor of Sounding Out! He is also a Media Studies PhD candidate at Rutgers University. His dissertation explores the fanzines and politics of underground wargame communities in Cold War America. You can learn more about his work at aarontrammell.com.
Featured image “Psychedelic Icon,” by Gwendal Uguen CC BY-NC-SA.
Papa Sangre and the Construction of Immersion in Audio Games- Enongo Lumumba-Kasongo
This post continues our summer Sound and Pleasure series, as the third and final podcast in a three part series by Leonard J. Paul. What is the connection between sound and enjoyment, and how are pleasing sounds designed? Pleasure is, after all, what brings y’all back to Sounding Out! weekly, is it not?
Part of the goal of this series of podcasts has been to reveal the interesting and invisible labor practices which are involved in sound design. In this final entry Leonard J. Paul breaks down his process in designing living sounds for the game Vessel. How does one design empathetic or aggressive sounds? If you need to catch up read Leonard’s last entry where he breaks down the vintage sounds of Retro City Rampage. Also, be sure to be sure to check out last week’s edition where Leonard breaks down his process in designing sound for Sim Cell. But first, listen to this! -AT, Multimedia Editor
CLICK HERE TO DOWNLOAD: Game Audio Notes III: The Nature of Sound in Vessel
SUBSCRIBE TO THE SERIES VIA ITUNES
ADD OUR PODCASTS TO YOUR STITCHER FAVORITES PLAYLIST
Game Audio Notes III: The Nature of Sound in Vessel
Strange Loop Game’s Vessel is set in an alternate world history where a servant class of liquid automatons (called fluros) has gone out of control. The player explores the world and solves puzzles in an effort to restore order. While working on Vessel, I personally recorded all of the sounds so that I could have full control over the soundscape. I recorded all of the game’s samples with a Zoom H4n portable recorder. My emphasis on real sounds was intended to focus the player’s experience of immersion in the game.
This realistic soundscape was supplemented with a variety of techniques that produced sounds that dynamically responded to the changes in the physics engine. Water and other fluids in the game were difficult to model with both the physics engine and the audio engine (FMOD Designer). Because fluids are fundamentally connected to the game’s physics engine, they takes on a variety of different dynamic forms as players interact with the fluid in different ways. In order to address this Kieran Lord, the audio coder, and I considered factors like the amount of liquid in a collision with anything, the hardness of the surface that it was colliding with, the type of liquid in motion, whether the player is experiencing an extreme form of that sound because it is colliding with their head, and, of course, how fast the liquid is travelling.
Although there was a musical score, I designed the effects to be played without music. Each element of the game, for instance a lava fluro’s (one of the game’s rebellious automatons) footsteps, entailed required layers of sound. The footsteps were composed of water sizzling on a hot pan, a gloopy slap of oatmeal and a wet rag hitting the ground. Finding the correct emotional balance to support the game’s story was fundamental to my work as a sound designer. The game’s sound effects were constantly competing with the adaptive music (which is also contingent on player action) that plays throughout the game, so it was important to provide an informative quality to them. The sound effects inform you about the environment while the music sets the emotional underscore of the gameplay and helps guide you in the puzzles.
Defining the character of the fluros was difficult because I wanted players to have empathy for them. This was important to me because there is often no way to avoid destroying them when solving the game’s puzzles. While recording sounds in the back of an antique shop, I came across a vintage Dick Tracey gun that made a fantastic clanking sound when making a siren sound. Since the gun allowed me to control how quickly the siren rose and fell, it was a great way to produce vocalizations for the fluros. I simply recorded the gun’s siren sound, chopped the recording into smaller pieces, and then played back different segments randomly. The metal clanking gave a mechanical feel and the siren’s tone gave a vocal quality to the resulting sound that was perfect for the fluros. I could make the fluros sound excited by choosing a higher pitch range from the sample grains and inform the player when they approached their goal.
I wanted a fluid-based scream to announce a fluro’s death. I tried screaming underwater, screaming into a glass of water, and a few other things, but nothing worked. Eventually, when recording a rubber ear syringe, I found squeezing the water out quickly lent a real shriek while it spit out the last of the water. Not only did this sound really cut through the din of the gears clanking in the mix, but it also bonded a watery yell with the sense of being crushed and running out of breath.
For the final boss, I tried many combinations of glurpy sounds to signify its lava form. Eventually I recorded a nail in a board being dragged across a large rusty metal sheet. Though it was quite excruciating to listen to, I pitched down the recording and combined it with a pitched down and granulated recording of myself growling into a cup of water. This sound perfectly captured the emotion I wanted to feel when encountering a final boss. Although it can take a long time to arrive at the “obvious” sound, simplicity is often the key.
Anticipation is fundamental to a player’s sense of immersion. It carves a larger space for tension to build, for instance a small crescendo of a creaking sound can develop a tension that builds to a sudden and large impact. A whoosh before a punch lands adds extra weight to the force of the punch. These cues are often naturally present in real-world sounds, such as a rush of air sweeping in before a door slams. A small pause might be included just for added suspense and helps to intensify the effect of the door slamming. Dreading the impact is half of the emotion of a large hit .
Recording all of the sounds for Vessel was a large undertaking but since I viewed each recording as a performance, I was able to make the feeling of the world very cohesive. Each sound was designed to immerse the player in the soundscape, but also to allow players enough time to solve puzzles without becoming annoyed with the audio. All sounds have a life of their own and a resonance of memory and time that stays with the them during each playthrough of a game. In Retro City Rampage I left a sonic space for the player to wax nostalgic. In Sim Cell, I worked to breathe life into a set of sterile and synthesized sounds. Each recorded sound in Vessel is alive in comparison, telling stories of time, place and recording with them, that are all their own.
The common theme of my audio work on Retro City Rampage, Sim Cell and Vessel, is that I enjoy putting constraints on myself to inspire my creativity. I focus on what works and removing non-essential elements. Exploring the limits of constraints often provokes interesting and unpredictable results. I like “sculpting” sounds and will often proceed from a rough sketch, polishing and reducing elements until I like what I hear. Typically I remove layers that don’t add an emotive aspect to the sound design. In games there are often many sounds that can play at once, so clarity and focus are necessary when preventing sounds from getting lost in a sonic goo.
In this post I have shown how play and experimentation are fundamental to my creative process. For an aspiring sound artist, spending time with Pure Data, FMOD Studio or Wwise and a personal recorder is a great way to improve their skill with game audio. This series of articles has aimed to reveal the tacit decisions behind the production of game audio that get obscured by the fun of the creative process. Plus, I hope they offer a bit of inspiration to those creating their own sounds in the future.
- My GDC 2012 talk – My site includes an MP3 recording of the talk and the full powerpoint presentation. A full video of the talk is in the GDC Vault but requires membership
- See the Jon Hopkins Soundtrack in the Video Game Vessel video game soundtrack video by me on YouTube – shows use of Lua with music in the custom level editor : https://www.youtube.com/watch?v=KOyjMPPvaY4
Leonard J. Paul attained his Honours degree in Computer Science at Simon Fraser University in BC, Canada with an Extended Minor in Music concentrating in Electroacoustics. He began his work in video games on the Sega Genesis and Super Nintendo Entertainment System and has a twenty year history in composing, sound design and coding for games. He has worked on over twenty major game titles totalling over 6.4 million units sold since 1994, including award-winning AAA titles such as EA’s NBA Jam 2010, NHL11, Need for Speed: Hot Pursuit 2, NBA Live ’95 as well as the indie award-winning title Retro City Rampage.
He is the co-founder of the School of Video Game Audio and has taught game audio students from over thirty different countries online since 2012. His new media works has been exhibited in cities including Surrey, Banff, Victoria, São Paulo, Zürich and San Jose. As a documentary film composer, he had the good fortune of scoring the original music for multi-awarding winning documentary The Corporation which remains the highest-grossing Canadian documentary in history to date. He has performed live electronic music in cities such as Osaka, Berlin, San Francisco, Brooklyn and Amsterdam under the name Freaky DNA.
He is an internationally renowned speaker on the topic of video game audio and has been invited to speak in Vancouver, Lyon, Berlin, Bogotá, London, Banff, San Francisco, San Jose, Porto, Angoulême and other locations around the world.
His writings and presentations are available at http://VideoGameAudio.com
Featured image: Courtesy of Vblank Entertainment (c)2014 – Artwork by Maxime Trépanier.
REWIND! . . .If you liked this post, you may also dig:
Sounding Out! Podcast #31: Hand Made Music in Retro City Rampage– Leonard J. Paul
Papa Sangre and the Construction of Immersion in Audio Games- Enongo Lumumba-Kasongo