Tag Archive | affect

The Dark Side of Game Audio: The Sounds of Mimetic Control and Affective Conditioning

Sound and Surveilance4

It’s an all too familiar movie trope. A bug hidden in a flower jar. A figure in shadows crouched listening at a door. The tape recording that no one knew existed, revealed at the most decisive of moments. Even the abrupt disconnection of a phone call manages to arouse the suspicion that we are never as alone as we may think. And although surveillance derives its meaning the latin “vigilare” (to watch) and French “sur-“ (over), its deep connotations of listening have all but obliterated that distinction.

This month, SO! Multimedia Editor Aaron Trammell curates a forum on Sound and Surveillance, featuring the work of Robin James and Kathleen Battles.  And so it begins, with Aaron asking. . .”Want to Play a Game?” –JS

It’s eleven o’clock on a Sunday night and I’m in the back room of a comic book store in Scotch Plains, NJ. Game night is wrapping up. Just as I’m about to leave, someone suggests that we play Pit, a classic game about trading stocks in the early 20th century. Because the game is short, I decide to give it a go and pull a chair up to the table. In Pit, players are given a hand of nine cards of various farm-related suits and frantically trade cards with other players until their entire hand matches the same suit. As play proceeds, players hold up a set of similar cards they are willing to trade and shout, “one, one, one!,” “two, two, two!,” “three, three, three!,” until another player is willing to trade them an equivalent amount of cards in a different suit. The game only gets louder as the shouting escalates and builds to a cacophony.

As I drove home that night, I came to the uncomfortable realization that maybe the game was playing me. I and the rest of the players had adopted similar dispositions over the course of the play. As we fervently shouted to one another trying to trade between sets of indistinguishable commodities, we took on similar, intense, and excited mannerisms. Players who would not scream, who would not participate in the reproduction of the game’s sonic environment, simply lost the game, faded out. As for the rest of us, we became like one another, cookie-cutter reproductions of enthusiastic, stressed, and aggravated stock traders, getting louder as we cornered the market on various goods.

We were caught in a cybernetic-loop, one that encouraged us to take on the characteristics of stock traders. And, for that brief period of time, we succumbed to systems of control with far reaching implications. As I’ve argued before, games are cybernetic mechanisms that facilitate particular modes of feedback between players and the game state. Sound is one of the channels through which this feedback is processed. In a game like Pit, players both listen to other players for cues regarding their best move and shout numbers to the table representing potential trades. In other games, such as Monopoly, players must announce when they wish to buy properties. Although it is no secret that understanding sound is essential to good game design, it is less clear how sound defines the contours of power relationships in these games. This essay offers two games,  Mafia, and Escape: The Curse of the Temple as case studies for the ways in which sound is used in the most basic of games, board games. By fostering environments that encourage both mimetic control and affective conditioning game sound draws players into the devious logic of cybernetic systems.

Understanding the various ways that sound is implemented in games is essential to understanding the ways that game sound operates as both a form of mimetic control and affective conditioning. Mimetic control is, at its most simple, the power of imitation. It is the degree to which we become alike when we play games. Mostly, it happens because the rules invoke a variety of protocols which encourage players to interact according to a particular standard of communication. The mood set by game sound is the power of affective conditioning. Because we decide what we interact with on account of our moods, moments of affective conditioning prime players to feel things (such as pleasure), which can encourage players to interact in compulsive, excited, subdued, or frenetic ways with game systems.

A game where sound plays a central and important role is Mafia (which has a number of other variants like Werewolf and The Resistance). In Mafia, some players take the secret role of mafia members who choose players to “kill” at night, while the eyes of the others are closed. Because mafia-team players shuffle around during the game and point to others in order to indicate which players to eliminate while the eyes of the other players are closed, the rules of the game suggest that players tap on things, whistle, chirp, and make other ambient noises while everyone’s eyes are closed. This allows for the mafia-team players to conduct their business secretly, as their motions are well below the din created by the other players. Once players open their eyes, they must work together to deduce which players are part of the mafia, and then vote on who to eliminate from the game. Here players are, in a sense, controlled by the game to provide a soundtrack. What’s more, the eeriness of the sounds produced by the players only accentuate the paranoia players feel when taking part in what’s essentially a lynch-mob.

The ambient sounds produced by players of Mafia have overtones of mimetic control. Protocols governing the use of game audio as a form of communication between bodies and other bodies, or bodies and machines, require that we communicate in particular ways at set intervals. Different than the brutal and martial forms of discipline that drove disciplinary apparatuses like Bentham’s panopticon, the form of control exerted through interactive game audio relies on precisely the opposite premise. What is often termed “The Magic Circle of Play” is suspect here as it promises players a space that is safe and fundamentally separate from events in the outside world. Within this space somewhat hypnotic behavior-patterns take place under the auspices of being just fun, or mere play. Players who refuse to play by the rules are often exiled from this space, as they refuse to enter into this contract of soft social norms with others.

Not all panopticons are in prisons. "Singing Ringing Tree at Sunset," Dave Leeming CC BY.

Not all panopticons are in prisons. “Singing Ringing Tree at Sunset,” Dave Leeming CC BY.

Escape: The Curse of the Temple relies on sound to set a game mood that governs the ways that players interact with each other. In Escape, players have ten minutes (of real time) where they must work together to navigate a maze of cardboard tiles. Over the course of the game there are two moments when players must return to the tile that they started the game on, and these are announced by a CD playing in the background of the room. When this occurs, a gong rings on the CD and rhythms of percussion mount in intensity until players hear a door slam. At this point, if players haven’t returned to their starting tile, they are limited in the actions they can take for the rest of the game. In the moments of calm before players make a mad dash for the entrance, the soundtrack waxes ambient. It offers the sounds of howling-winds, rattling chimes, and yawning corridors.

The game is spooky, overall. The combination of haunting ambient sounds and moments where gameplay is rushed and timed, makes for an adrenaline-fueled experience contained and produced by the game’s ambient soundtrack. The game’s most interesting moments come from points where one player is trapped and players must decide whether they should help their friend or help themselves. The tense, haunting, soundtrack evokes feelings of high-stakes immersion. The game is fun because it produces a tight, stressful, and highly interactive experience. It conditions its players through the clever use of its soundtrack to feel the game in an embodied and visceral way. Like the ways that horror movies have used ambient sounds to a great effect in producing tension in audiences (pp.26-27), Escape: The Curse of the Temple encourages players to immerse themselves in the game world by playing upon the tried and true affective techniques that films have used for years. Immersed players feel an increased sense of engagement with the game and because of this they are willingly primed to engage in the mimetic interactive behaviors that engage them within the game’s cybernetic logic.

These two forms of power, mimetic control and affective conditioning, often overlap and coalesce in games. Sometimes, they meet in the middle during games that offer a more or less adaptive form of sound, like Mafia. Players work together and mimic each other when reproducing the ambient forms of quiet that constitute the atmosphere of terror that permeates the game space. Even the roar of bids which occurs in Pit constitutes a form of affective conditioning that encourages players to buy, buy, buy as fast as possible. Effectively simulating the pressure of The Stock Exchange.

Although there is now a growing discipline around the production of game audio, there is relatively little discourse that attempts to understand how the implementation of sound in games functions as a mode of social control. By looking at the ways that sound is implemented in board and card games, we can gain insight of the ways in which it is implemented in larger technical systems (such as computer games), larger aesthetic systems (such as performance art), economic systems (like casinos and the stock market), and even social systems (like parties). Furthermore, it is easy to describe more clearly the ways in which game audio functions as a form of soft power through techniques of mimetic control and affective conditioning. It is only by understanding how these techniques affect our bodies that we can begin to recognize our interactions with large-scale cybernetic systems that have effects reaching beyond the game itself.

Aaron Trammell is co-founder and Multimedia Editor of Sounding Out! He is also a Media Studies PhD candidate at Rutgers University. His dissertation explores the fanzines and politics of underground wargame communities in Cold War America. You can learn more about his work at aarontrammell.com.

Featured image “Psychedelic Icon,” by Gwendal Uguen CC BY-NC-SA.

tape reelREWIND!…If you liked this post, you may also dig:

Papa Sangre and the Construction of Immersion in Audio Games- Enongo Lumumba-Kasongo 

Sounding Out! Podcast #31: Game Audio Notes III: The Nature of Sound in Vessel- Leonard J. Paul

Experiments in Aural Resistance: Nordic Role-Playing, Community, and Sound- Aaron Trammell

Experiments in Aural Resistance: Nordic Role-Playing, Community, and Sound

Sound and PlayEditor’s Note:  Welcome to Sounding Out!‘s fall series titled “Sound and Play,” where we ask how sound studies, as a discipline, can help us to think through several canonical perspectives on play. While Johan Huizinga had once argued that play is the primeval foundation from which all culture has sprung, it is important to ask where sound fits into this construction of culture; does it too have the potential to liberate or re-entrench our social worlds? SO!’s Multimedia editor Aaron Trammell reflects upon using sound in role-playing games as a form of resistance. Ready, players?

When we play with sound, how does it influence the ways in which we understand, configure, and experience the world? I have already argued that non-diegetic sound can produce a visceral and emotive effect when connected to player interaction within a game world, that sounds are often structured within games to construct a sort of feedback between player and system, and that often within this feedback loop the narrative voice perpetuates problematic tropes of sexism and racism through its scripting. While I focused on the often dystopic production efforts of large and middle sized game companies in those prior essays, here I will be focusing on autonomous and grassroots examples of how sound is used as a way to stage social experiments which resist these often hegemonic ways that these dominant narratives constrict our views of the world.

Role-playing games, the focus of my post today, offer a more viable path of social resistance than better-known video games. Nordic larp style-games, for example, are written and played within not-for-profit communities, and they utilize themes of social inequality, transformation, and activism within their very scripts. Second, role-playing games, unlike computer games, do not require that their developers are able to code. Instead, games are often circulated by word-of-mouth, or in script format through player communities. In this sense, the genre itself is untethered from many of the problems of consumer capitalism. Many underground role-playing games are designed both around social issues and for local community needs as opposed to the market demands that necessitate big budgets, big programming teams, and few risks in the video game industry today. Finally, because role-playing games necessitate neither big budgets, the ability to code, nor mass audiences, they are an ideal site wherein game designers and referees can stage social experiments that speak to the unique wants and desires of the communities within which they are run.

In The Larpfactory Book Project, a forthcoming book containing several ready to play examples of Nordic larp (a big shout out to Lizzie Stark for hooking me up with an advance copy of this portion of the manuscript!), larpwrights Matthijs Holter and Fredrik Hossmann propose a game entitled “Before and After Silence,” focused on thinking through the collective experience of silence. From the game description:

In a world of more and more sound, silence is becoming more valuable. Before and After Silence is about limitations and listening, and about doing almost nothing. It is non-verbal and uses silence as its starting point. It is about shifting the point of view from “what is” to “what is not,” about shifting the focus from “the sounds” to “the spaces between the sounds,” from “the actions” to what is “between the actions,” and to “what is not done.” Rather than playing characters, we examine how we look at ourselves and how different filters can change how we see ourselves and others.

The game is structured as a social experiment for five to twelve players who are made to select two cards, one of which prompts players with an action they must complete only once during the hour of silence (one example reads “Go over to someone and whisper something in a language you don’t know”), and another which prompts players with a setting through which they should interpret the actions of the other players in the room (one example suggests a player imagine themselves in a community of prisoners, another makes a player imagine themselves as one in a society of telepaths). Before the game there are a set of workshops aimed at orienting players to the scope and silence of the game, and afterward there is a debriefing session where players compare their experiences of silence during the game.

Tons of great examples of work in the Nordic larp genre are in this book. Image borrowed from FransBadger @Flickr.

Tons of great examples of work in the Nordic larp genre are in this book. Image borrowed from FransBadger @Flickr.

Unlike American larps, which often take place in high-fantasy settings and direct their action around combat scenarios, Nordic larps often focus on the everyday and comparatively mundane, and as such tend to be more concerned the problems of the everyday as well. Even those that take place in more exotic environments, such as System Danmarc, a game set in the cyberpunk future of Copenhagen, engage players in real issues regarding class and poverty. After living in a shanty-town simulating the future streets of Copenhagen for a week of game-time (In Nordic-style larps, game-time is often equivalent to real time, and so a week in-game is equivalent to a week out of game) players are shown a documentary about the actual slums of Copenhagen where they realize that their experience within the space of play was made to mirror the experience of those struggling with the these very issues in the real world.

In the case of “Before and After Silence,” it is interesting to consider the ways in which the game designers here play with sound, and how these experiments in sonic game design might provoke new modes of subjectivity. As described earlier, players are both given a particular action and or noise to perform, but also are prompted with a way to imagine the actions that the rest of the players in the room are performing. The resulting group performance is an acid dream of sorts wherein each player is made to imagine the room’s soundscape in a very different way. Is the setting a long-lost silent film, or are you drifting through an ether of emotions and past romances? The game focuses on playing with silence in a way that makes the din of communication an unfamiliar and distant memory. The game affords players an opportunity to imagine the world sound. In doing this, “Before and After Silence” displaces the dominance of the voice as a mode of communication and through this questions the ways in which we imagine the world.

Not all is perfect, however, in this utopia of resistance. As Lisa Blackman (2009) argues in her essay “Embodying Affect: Voice-hearing, Telepathy, Suggestion and Modelling the Non-Conscious,” play with the exchange of subjectivities and sound marks an ontological shift from a praxiology of what bodies are to what bodies can do (p. 170). Moving forward from her work in understanding the ritual practices of voice-hearing communities, Blackman explains that similar forms of sonic play (including play with silence) allow for the experience, embodiment, and trade of desire, fear, and trauma. In the context of “Before and After Silence,” this means that as players sculpt and adjust the sonic space of the room, they run the risk of also shaping and altering each others psychic conditions, in unpredictable and perhaps dangerous ways.

The conflation which occurs between these spaces of real emotion and play emotion is, in fact, well documented, and referred to in larp communities as “bleed.” As role-playing scholar Sarah Bowman (2013), explains in her essay “Social Conflict in Role-Playing Communities: An Exploratory Qualitative Study,” even though bleed does occasionally create rifts in relationships (some participants that she has interviewed reported in-game events disturbing their out of game relationships), others seek it out as a form of extreme play. For this reason Nordic larps require ethical behavior on the parts of their players, and because of the nature of the psychic and social sculpting which can occur within the play spaces of the game, the possibility exists that a single unethical player could create a negative and perhaps concerning experience for many others. That said, there are several ways the community mitigates the possibility of this problem including meticulous casting processes, before-game workshops, after-game debrief sessions, and safe words for use during play.

Players debrief after a game. Image borrowed from Fiezi @Flickr.

Players debrief after a game. Image borrowed from Fiezi @Flickr.

“Before and After Silence” is a valuable cultural artifact that lies at the intersection of scholarship on sound studies and serious play. At the same time that it promises several new ways to think through how sound, communication, and silence influence the how we frame and approach the world, it also raises deeper questions regarding the nature of social control and the viability of autonomous modes of organization. As silence allows players to explore and interact with a world where the soundscape takes on an increased prominence, do sexist, racist, and homophobic modes of socialization still manage to creep into the play space? And does the voice, along with its physiological and cultural embodiment of race, class, and gender, offer an escape from these experiments in silence if and when they turn dystopic?

Featured image: “Larp” by Flickr user marten vaher, CC-BY-NC-SA 2.0

Aaron Trammell is co-founder and Multimedia Editor of Sounding Out! He is also a Media Studies PhD candidate at Rutgers University. His dissertation explores the fanzines and politics of underground wargame communities in Cold War America. You can learn more about his work at aarontrammell.com.

tape reelREWIND! . . .If you liked this post, you may also dig:

Goalball: Sport, Silence, and Spectatorship— Melissa Helquist

GLaDOS, The Voice of Postfeminist Control— Aaron Trammell

Video Gaming and the Sonic Feedback of Surviellance: Bastion and the Stanley Parable— Aaron Trammell