Tag Archive | video games

Video Gaming and the Sonic Feedback of Surveillance: Bastion and The Stanley Parable

The world of bastion is beautifully illustrated and affectively evocative. Image borrowed from darkzabimaru @DeviantArt.

The world of Bastion is beautifully illustrated and affectively evocative. Image borrowed from darkzabimaru @DeviantArt.

As the practice of sound design becomes ever more refined as a key factor in the immersive aspects of gameplay, it is essential to develop a conceptual vocabulary of the ways that sound is implemented as a cultural facet. In particular, it is important to recognize the power relations at stake within the implementation of the human voice as an interactive narrative trope. And, while I’ve already discussed the ways in which the voice of GLaDOS in Portal invites players to reflect on how they internalize a set of mediated perspectives about how their body ought to be, it is equally important to consider the other ways that a narrator’s voice invites players to reconsider the intersection of agency and surveillance.

This post compares the use of narration in Bastion and The Stanley Parable in an effort to understand how the voice is used as what Karen Collins would refer to as an “interactive non-diagetic sound,” or, in other words, a sound that is triggered by player actions, but not experienced by the character in the game. Specifically, I argue that the voice in these examples is an essential point in the feedback loop between player and game. And, as part of the cybernetics of gameplay, it produces a dispositif of surveillance, akin to Bentham’s panopticon, which lets the player know their actions are constantly being monitored, calculated, and considered by the game’s algorithms. But, while the original panopticon produced the effect of surveillance through the clever use of light, these games use sound to effect surveillance.

Bastion, was developed by the small indie game company Supergiant Games, but was distributed and released by Warner Bros. Interactive Entertainment, first through Microsoft’s distribution service, XBOX Live Arcade, but has since been released more broadly after receiving much critical acclaim. In Bastion, players take the role of a young boy, referred to only as “The Kid,” and adventure around gradually rebuilding a world that has fallen apart since a cataclysmic sundering referred to only as “the Calamity.” Although the world of Bastion is beautiful and visually stimulating, it is the game’s sound design that has earned it much critical acclaim. The game is narrated by a character named “Rucks,” who speaks in a deep weathered voice, with somewhat of a western twang. And, even though The Kid eventually encounters and is able to interact with Rucks within the game, Rucks still relays dialogue in the third-person.

When The Kid and Rucks meet, Rucks evinces with trademark grit, “Sure enough, he finds another. He finds me.” And, while that is a scripted plot point within the game, at other points Rucks’ narration modulates to best reflect the player’s actions. A player who begins the game slowly, exploring nooks and crannies, might hear “The kid walks slowly down the path, checking everything,” while a player who runs straight ahead could hear, “The kid barrels forward, not looking once behind him.” These quotes force the player to recognize that the game is watching, and actively staging narrative commentary about their in-game decisions. This commentary unfolds in aural space, through narration, discrete from the old text (and controller) triggers of “look” and “examine” which used to prompt text-box commentary about the environment of the game. In short, Bastion’s sound design succeeds because it is balanced in such a precise way: players are being constantly engaged with a narration which confirms that they are, in fact, properly interacting within the game world and story.

Games used to use text boxes to interrupt gameplay with narrative elements. Image borrowed from ultrapublications.com

Games used to use text boxes to interrupt gameplay with narrative elements. Image borrowed from ultrapublications.com

The Stanley Parable, on the other hand, works deliberately to turn the paradigm of narration on its head. Where Rucks, in Bastion, frequently alluded to how many secrets he was yet to reveal about himself and the game-world, his character ultimately plays a supportive role, helping The Kid to understand the chaotic environment of the game. The narrator in The Stanley Parable, however, plays the antagonist in many ways, attempting to foreshadow and predetermine the actions of the player, or “Stanley.” On the game’s website, a short sentence contextualizes the endeavor, “The Stanley Parable is a Half Life 2 mod about video games.” The game itself is a mod of the “Source engine,” which runs both Half-Life 2, and Portal, was developed by the very small development team of Davey Wreden and William Pugh, and released for free. It is meta-fiction that stages a critique of the context of narrative within interactive games and fiction. Specifically, the game questions the idea of narrative itself by showcasing the ways that players are able to undermine the scripted plots and spaces of a videogame by exploring and experimenting with exploits and bugs in the game’s code and narrative.

Although the narrator in The Stanley Parable will prescribe several decisions to the player over the course of the game, the player is given the agency to contest the story as told by the narrator, and, therefore, to experiment with the plot. As the player reaches a set of two open doors on the way to the employee lounge the narrator reads, “When Stanley came to a set of two open doors, he entered the door on his left.” If the player chooses to travel through the door on the right instead, the narrator will attempt to steer the player back to the main plot tree by saying, “This was not the correct way to the employee lounge, and Stanley knew it perfectly well.” And, then as an open door is revealed, “So he turned left at the first open door, and walked back in the right direction.” If the player continues to ignore the narrator’s advice, he comes to somewhat of a dead end and the narrator reads, “Stanley was so bad at following directions, it’s incredible that he wasn’t fired years ago. Maybe this was why everyone left. No one wanted to be around someone as bad at listening as him.” The player is given several other opportunities to make decisions and lead the story to completion in achieving one of seven endings; each based the decisions the player has made when interacting with the narrator’s dialogue.

The Stanley Parable allows players the agency to see the limitations of linear storytelling where Bastion does not. Where some paths in The Stanley Parable will lead the player into direct conflict with the narrator, other paths do not. There is never a point where the narrator ceases to comment on the player’s actions and activities. Because the sonic feedback of surveillance remains a constant in both games the player remains engaged, in both cases, with the logic of the game-system. In other words, no matter how many times the player defies the narrator in The Stanley Parable, it never seems like the game is breaking. The game world remains constant because the motif of surveillance holds; players know the game still works because the narrator continues to stage commentary – even if it is commentary about the player’s failure to keep to the plot.

For Marc Andrejevic, author of iSpy (2007)who has written extensively about the abundance of surveillance techniques implemented in digital spaces–the danger of surveillance lies in the production of an asymmetrical power relationship between media producer and media consumer. And, while this is certainly best argued about instances of dataveillance–how companies like Amazon, for example,  track customer clicks on and off their website via web cookies in order to better produce exploitable (and in some cases saleable) consumer profiles–it is important to also consider the ways that the implementation of sound also functions as a technique of control.

Paradigms of surviellance have changed a lot in the past 30 years. Image borrowed from cobalt123 @Flickr.

Paradigms of surveillance have changed a lot in the past 30 years. Image borrowed from cobalt123 @Flickr.

At its most positive, the sonic panopticism of Bastion and The Stanley Parable offer players a sense of comfort in knowing that the game is operating properly, and not glitching out. Further, players are invited into a more immersive game, which leverages both visual and audio interactivity to lull players into an environment of almost trancelike feedback and play. Clearly, this is the promise of good sound design; it gently alerts players to the presence of a tightly designed and well-implemented game, and produces affects of brand loyalty and trust within a game’s player contingent.

But, while there are clearly aesthetic and market benefits to the implementation of narration in both games, one cannot help but wonder, in the context of post-feminism and self-surveillance, what implications there are in the implementation of the male voice as surveil-er in both games. Just as it was curious in Portal 2 how GLaDOS acted as a critical female voice constantly judging the player’s body image and intelligence, it is curious how much authority is given to the voice of Rucks in Bastion. And while several good critiques have already been written about how the game features only one (somewhat silent, and certainly helpless) female character, and how the game’s villain is portrayed, concretely, as the racially exotic other, it is sadly fitting that the most comforting and well-acclaimed aspects of the game come from the interactivity produced by the voice of its distinctively white male narrator.

The sound design in The Stanley Parable, of course, is more cutting in the ways it stages a commentary about how the voice of the narrator (this time distinctively British), exacts a form of social coercion through techniques of surveillance, and how these techniques serve, namely, to hamper player agency. But, even its own narrative of resistance fails to compel; in fact, it is the uneasy ending of compliance and conformity that is, perhaps, the happiest. This, ironically, reveals one of the key cultural problems of our era: the reciprocal aspects of surveillance and interactivity. If affective resonances of trust, knowledge, and comfort come bundled with the male voice, is it in the vested economic interests of sound design communities to leverage these to make profit? Even though both games have earned critical praise, it is only Bastion that  has won awards for sound design. In other words, are we caught in our own feedback loop of comfort, industry, and design?

Aaron Trammell is co-founder and Multimedia Editor of Sounding Out! He is also a Media Studies PhD candidate at Rutgers University. His dissertation explores the fanzines and politics of underground wargame communities in Cold War America. You can learn more about his work at aarontrammell.com.

tape reelREWIND! . . .If you liked this post, you may also dig:

DIANE… The Personal Voice Recorder in Twin Peaks— Tom McEnaney

The Role of Sound in Video Games: Pong, Limbo, and Interactivity— Aaron Trammell

Orality and Cybernetics in Battleship— Aaron Trammell

Evoking the Object: Physicality in the Digital Age of Music

In our current relationship with technology, we bring our bodies, but our minds rule–Linda Stone, “Conscious Computing”

I begin with an epigraph from Linda Stone, who coined the phrase ‘continuous partial attention’ to describe our mental state in the digital age. The passive cousin of multi-tasking, continuous partial attention is a reaction to our constantly connected lifestyles in which everything is happening right now and where value is increasingly equated with our ability to digest it all.   Almost everything we do has the potential to be interrupted, be it by an email, a text or a tweet; often we will give only partial attention to any one thing in anticipation of the next thing that will require our attention.  In this internal fight for mental attention, listening to music has been seriously impacted.

The digital era has seen more music releases than ever before.  Unfortunately, the massive influx of quantity is by no means a measure of how we are engaging with said music.  iPhones and similar devices, for which music players have become mere features, enable listening to become a thing of partial attention. From allowing the shuffle or random modes to choose music selections for you, or even streaming music algorithms to calculate things you might like, to listening while playing Angry Birds or reading your Twitter stream, less commitment is made to the act of listening, and as such only a portion of our working memory is committed to the experience.  Without working memory actively processing musical information, it is less likely to be stored for the long term, particularly if other information is continuously vying for space and attention.

These days video games sell better than music.  Despite being a digital product, games are able to instill  memories (even of the music) into one’s consciousness, because the game interface allows our sensory memories to work together in an active manner with the medium.  Iconic memory stores visual cues from the game, echoic memory takes the audible cues from the game and the haptic memory is engaged in controlling game play.  There is only so much more which can be done while playing a video game.  If something were to interrupt game play, the game would be paused to address the new information rather than giving it partial attention. This is quite different from music which plays a background role in so much of our lives even when we are actively putting music on we tend to only engage it with partial attention.

When I began thinking about turning Concrète Sound System into a record label, one of my main goals was to create works that could engage the audience in active musical experiences that could create long term memories.   I felt that as important as the music would be, it would take something material to create these memories, a physical product more evocative of earlier moments in recording history than the CD, its most recent gasp. I wondered if, by creatively evoking the physical object, the listener could be engaged in an active manner that would enable the memory of music and its power to persist through the everyday waves of digital noise.

The first mass duplicated audio medium was the Gold Moulded Edison Cylinder at the turn of the twentieth century.  Imagine two cylinder copies of one of these recording today, as musical objects.  Each of them would have over a hundred years of physical history.  From the wear of the cases to the condition of the wax based on the temperature in which they were stored, each of these cylinders would be unique musical objects, with completely different histories, despite having the same origin.  It is reasonable to assume that if the cylinders were played today on the same playback device, despite the fact that the compositions and performances are exactly the same, the differences between the recordings would be audible.

Wax Cylinders in the Library of Congress preservation Lab, Image by Flickr User Photo Phiend

Even without a century of history, there would likely be audible differences between the cylinders.   If one cylinder was the first copy made, and another the 150th –master cylinders of Gold Moulded Edison Cylinders could only produce 150 copies reliably–the physical wear in the process of reproduction would leave its own imprint, making each of those copies distinct musical objects. In the analog world, as the technology improved the differences between copies decreased substantially.  Cassettes were manufactured in batches of ten to hundreds of thousands without audible differences.  But even in circulations so high, over time each of those analog copies took on their own identity and collected their own memories.

The listener as an active agent contributed to the development of these unique musical objects. After a purchase, any number of variables played into the ritual of the first experience of the music. Was there a way to listen upon walking out of the store?  Were there liner notes or lyric sheets inside?  Would you read those prior to listening or as you listen? Where would you listen?  Through headphones? The listening chair in front of the hi-fi stereo? Or on the boombox with some friends?  All of these possibilities shaped memories as musical objects that defined the music consumption culture of the past.

For example, I bought the debut 2Pac album 2Pacalypse Now on cassette the day it was released.  I loved the album so much I kept it in regular rotation in my Walkman for months until finally the tape popped.  Rather than go out and buy a new copy I decided to perform a surgery.  It was in a screwless reel case which meant I couldn’t just open it up to retrieve the ends of the tape trapped inside, but rather had to crack the reel case open and transplant the reels into a new body.  So, my copy of the 2Pacalypse Now cassette is now inside of a clear reel holder with no visual markings.  It also has a piece of tape that was used to splice it back together, which makes an audible warp when played back.  I can pretty much be sure that there is no other copy of 2Pacalypse which sounds exactly like mine.  While this probably detracts from the resale value of the cassette (not that I’d sell it), it is imbued with a personal history that is priceless.

Cassettes, in particular, played a significant role in the attachment of physical memories to music beyond the recordings they held.  They gave birth to the mixtape.  The taper community was born from personal tape recorders that allowed concert-goers to record performances they attended, and, prior to the rise of peer to peer sharing online, these communities were trading tapes internationally via regular postal mail.  European jazz and rock concerts were finding their way back to the states and South Bronx hip-hop performances were traveling with the military in Asia.  All of these instances required a physical commitment with which came memories that inherently became their own musical objects.

Needless to say the nature of musical exchange has changed with the rise of the digital age of music.  This is not to say that memories as musical objects have gone away, but they are being taken for granted as the objects lose their physicality.  I remember going to The Wiz on 96th Street with $10 to spend on music.  I spent at least ten minutes trying to decide between Sid and B-Tonn and Arabian Prince.  I ended up with Arabian Prince and have regretted it since I got home and listened that day, as I never found Sid and B-Tonn for sale again.  Today I could download both in the time it took me to walk to the train station.  After skimming through the first few songs of Arabian Prince I could decide it was not for me and drag drop it in the trash where the memory of it would disappear with the files.  No matter how I felt about the music then, the memory of it is a permanent fixture in my mind because of the physical actions it took to listen.

The first release for Concrète Sound System, Schrödinger’s Cassette, tackled this issue head on by presenting the audience with its own paradox, an update of physicist Erwin Schrödinger’s famous Thought Experiment, where the ultimate fate of the cassette inside is left up to the individual. Schrödinger’s Cassette sought to take listeners out of digital modes of consumption by using an analog medium to evoke the physical.  The cassette release trend has been growing over the last few years, almost in parallel to the rise of the digital music and speaking to the need to separate music from our digital lives and to a desire to work harder for it.  At the minimum, listening to a cassette requires having a cassette player, and acquiring one these days takes commitment.  Unlike digital media, listeners cannot instantly skip a song on a cassette or put a favorite on repeat.  It takes physical manipulation of the medium to move through its songs and doing so is a time investment.  All these limitations make the cassette a medium that is best for linear listening, from beginning to end (unless you physically cut, rearrange, and splice it yourself).

Schrödinger’s Cassette, Image Courtesy of The Wire

Schrödinger’s Cassette took the required commitment a step further by encasing the cassette itself in industrial grade concrete. This required the user to actively crack the concrete (or the french concrète meaning ‘real’, from which the label derives its name) in order to listen to the music.  The paradox is that, depending on the listener’s method for cracking, harm could be done to the cassette that might render it ‘unlistenable’.  Upon receiving one of these pieces, the listener holds in their hands a musical object which they must physically act upon in order to create an unrepeatable musical event.  Schrödinger’s Cassette has a look, a sound (if shaken you can hear the cassette reels), a feel, a smell, and a taste as well (though I wouldn’t advise it).  All of the senses can be actively focused on the object and, as such, the whole of one’s working memory is engaged in the discernment of the object’s musical contents.

The Wire breaks open Schrödinger’s Cassette courtesy of their Twitterstream

For many, Schrödinger’s Cassette was taken as a work of art and left uncracked.  The Wire magazine successfully cracked one edition open, revealing a portion of the musical contents on their regular radio program.  For those that decided not to crack it, digital versions were made available so that they could listen, though this option was only made available after the listener spent some time with their physical object.  In this way, the music from the project, a compilation called Between the Cracks, was directly connected to physical memories spurred by a material presence.

Triggering active memory during the consumption of music through physical objects need not be this complex.  Old medium such as vinyl and cassette releases inherently have the physical properties required without the concrete or much else.  Perhaps for this reason they show new signs of life despite the rise of digital.  No matter how much our reality is augmented by our digital lives, we still inhabit those bodies that we bring with us, and, as far as the memories those bodies carry with them go, physicality rules.

Featured Image: Wax Cylinders in the Library of Congress, Image by Flickr User Photo Phiend

Primus Luta is a husband and father of three.  He is a writer and an artist exploring the intersection of technology and art, and their philosophical implications.  He is a regular guest contributor to theCreate Digital Music website, and maintains his own AvantUrb site.  Luta is a regular presenter for the Rhythm Incursions Podcast series with his monthly showRIPL. As an artist, he is a founding member of the live electronic music collectiveConcrète Sound System, which spun off into a record label for the exploratory realms of sound in 2012.