Tag Archive | Aaron Trammell

Digital Analogies: Techniques of Sonic Play

Sound and PlayEditor’s Note: Welcome to Sounding Out!‘s fall forum titled “Sound and Play,” where we ask how sound studies, as a discipline, can help us to think through several canonical perspectives on play. While Johan Huizinga had once argued that play is the primeval foundation from which all culture has sprung, it is important to ask where sound fits into this construction of culture; does it too have the potential to liberate or re-entrench our social worlds? Here, Roger Moseley challenges us to rethink the philosophical discourses of both sound and play and locates the moments in which they intersect and interface. From games of Telephone to Guitar Hero, Moseley considers the ways in which sonic play can help us understand the phantasmic binaries of the analog and digital.–AT

Throughout the distinguished intellectual lineage of play (where it is touched on by notable philosophers such as Plato, Montaigne, Kant, Schiller, Gadamer, Derrida, and Baudrillard), little attention has been paid to the parallels that can be drawn between sound and play as both media and phenomena. The very name of today’s most prominent cultural and technological locus of play, the video game, overtly privileges the eye at the expense of the ear. As recent research and creative work by such figures as Aaron OldenburgAaron TrammellGeorge Karalis, and Enongo Lumumba-Kasongo indicates, a surge of interest in audio games, as well as video games that emphasize the importance of sound while eschewing or minimizing visual stimuli, is acting as a salutary corrective to this oculocentrism. In what follows, I suggest that bringing sonic and musical techniques to bear on this history might afford new insights into play and its myriad configurations. Conceiving of play sonically entails thinking of sound playfully. This intersectional logic can, I argue, unpick binarisms that enforce problematic distinctions and constrict thought. To demonstrate this, I conclude by deploying the concept of play to redefine the relationship between the digital and the analog—and vice versa.

How can play be defined in a manner that encompasses its farrago of meanings and associations? For video game designers and theorists Katie Salen and Eric Zimmerman, the answer is deceptively simple: play is “free motion within a more rigid structure” (Rules of Play, 304). To illustrate the flexibility of this definition, Salen and Zimmerman allude to the phenomenon of light playing upon the ocean waves. They leave unexamined, however, the intimacy and richness of the relationship between play and sound. From a scientific perspective, the patterned oscillation of which a sequence of sound waves is constituted consists of free motion within the limits set forth by the laws of physics. When disciplined and deployed as a cultural technique–take the play of musical instruments for example–sonic play is humanized and rendered transitive. But, we might also suggest that instruments play people, citing the sensation of automation with which fingers flash over fretboard or keyboard. Moving further away from anthropocentrism, we can observe how sonic technologies render play intransitive once more. From the barrel organ to the iPod, sound plays without human aid when mechanically reproduced. This way of framing reproduction invokes and extends Roger Caillois’s playful category of mimicry, which can be construed as faithful imitation, deceptive fakery, or even a Baudrillardian attempt to simulate a phenomenon that never existed.

In order to pay due attention to both the technologies through which sonic play is mediated as well as the cultural techniques imbue it with significance, I suggest that we supplement Salen and Zimmerman’s definition by thinking of freedom, motion, and structure in both digital and analogical terms. To an extent, the adoption of this modish epistemological framework acknowledges that conceptions of play are always constrained by their prevailing intellectual context. More importantly, however, I contend that technologies of sonic generation and representation from the seventeenth to the nineteenth centuries can be understood to play with the categories of the digital and the analog avant la lettre (ou le chiffre). The two categories are not mutually exclusive and to treat them as such would be to subjugate the granularity of the analog to the binary logic of the digital. Rather, they co-exist as modes between which sounds and players freely oscillate.

The origins of digital sonic play lie within the human body.  As Johan Huizinga put it, “the link between play and instrumental skill is to be sought in the nimble and orderly movements of the fingers.” In the course of musical performance, human digits perform innumerable calculations. At its crudest level, musical performance from a score can be construed as a sort of algorithmic play through which mimetic fidelity is evaluated (and wrong notes relentlessly tallied). This ludic logic is at its most visible in rhythm-action video games such as Guitar Hero in which the score is no longer a text but rather a quantitative analysis. The iconography of these games usually indexes a set of digital technologies used primarily for the recording, editing, and playback of music. On the one hand, this relationship can be traced back to Leibniz’s exposition of ars combinatoria and his “invention” of binary; on the other, it is realized by the hydraulic organ and composing machine devised and programmed by the Jesuit polymath Athanasius Kircher, both of which are depicted in his Musurgia universalis (1650). In media-archaeological terms, the combination of Leibniz’s concepts and Kircher’s mechanisms gave rise to the hardware and software of Joseph Marie Jacquard’s revolutionary loom, Charles Babbage’s prototypical Analytical Engine, the player piano, the IBM punch card, and the MIDI sequencer before resurfacing in Guitar Hero, a piece of software that, in purely algorithmic terms, enlists the player’s digits to verify checksums.

An example of Kirscher and Scott's Organum.

An example of Kircher and Schott’s Organum, an early example of the digitization of music.

Such digital grids may constitute the field and the rules of sonic play, but they must be supplemented by analog elements if play is to flourish. As detailed in C. P. E. Bach’s Versuch über die wahre Art das Clavier zu spielen (1753/62), the clavichord and its descendants distinguished themselves from the harpsichord and the organ by endowing the keyboard with an infinite sensitivity to touch, thereby enabling a mimetic spectrum of emotional flow with unprecedented verisimilitude. Analogicity also provides another perspective on Caillois’s concept of mimicry, according to which one object or activity playfully stands in for another via imitation, deception, or make-believe. Additionally, the curves of Ernst Chladni’s figures, which materialized sound as sand, exemplify this sonic and mimetic trajectory as they rely on both Hermann von Helmholtz’s pioneering work on acoustics and the complex history of phonography to the development of analog synthesis.

In terms of sonic play, digital and analog elements can be chiastically recombined and reconfigured. A sonic communication game such as Telephone relies on the human propensity for analogy and its corrupting influence on the integrity of information transfer, playfully inverting the conditions and functions of the “real” telephone (which was engineered to compress informational content digitally without jeopardizing meaning). In much electronic dance music, the digital latticework, simultaneously visualized and rendered audible by the sequencer’s grid, constitutes a field of play overlaid with vocals, sweeps, and other analog elements that, in turn, have been captured via digital sampling. As a kind of meta-game, a mash-up plays with sonic elements whose relations can be parsed in the digital terms of Leibnizian recombinatorial play, but equally important are the unintended associations and analogies which inevitably emerge. And while games such as Guitar Hero foreground digital techniques of sonic reproduction, they simultaneously foster diverse forms of analogical play involving the player’s manipulation of the sonic (and social) behavior of her on-screen avatar—and vice versa.

Playing telephone. Image borrowed from diamondmanga @Wikimedia.

Playing telephone. Image borrowed from diamondmanga @Wikimedia.

There is no doubt that the status of sound and its mediation through and as play have too often gone unacknowledged. As well as seeking to rectify this state of affairs by stressing the importance of sound in relation to the playful operations of other media, we might also dwell on the distinguishing features that set it apart: sound and the techniques that shape it are unique in the ways they simultaneously trace and are traced by the materials, technologies, and metaphors of play.

Roger Moseley is an Assistant Professor in the Department of Music at Cornell University. His most recent research brings a media-archaeological perspective to bear on musical performance and improvisation. He is particularly interested in how the concept of play informs sonic practices and cultural techniques. Active as a collaborative pianist on both modern and historical instruments, he has recently published essays on digital games in the contexts of musical and visual culture. His current book project is entitled Digital Analogies: Interfaces and Techniques of Musical Play.

tape reelREWIND! . . .If you liked this post, you may also dig:

Papa Sangre and the Construction of Immersion in Audio Games– Enongo Lumumba-Kasongo

Playing with Bits, Pieces, and Lightning Bolts: An Interview With Sound Artist Andrea Parkins— Maile Colbert

Experiments in Aural Resistance: Nordic Role-Playing, Community, and Sound— Aaron Trammell

Experiments in Aural Resistance: Nordic Role-Playing, Community, and Sound

Sound and PlayEditor’s Note:  Welcome to Sounding Out!‘s fall series titled “Sound and Play,” where we ask how sound studies, as a discipline, can help us to think through several canonical perspectives on play. While Johan Huizinga had once argued that play is the primeval foundation from which all culture has sprung, it is important to ask where sound fits into this construction of culture; does it too have the potential to liberate or re-entrench our social worlds? SO!’s Multimedia editor Aaron Trammell reflects upon using sound in role-playing games as a form of resistance. Ready, players?

When we play with sound, how does it influence the ways in which we understand, configure, and experience the world? I have already argued that non-diegetic sound can produce a visceral and emotive effect when connected to player interaction within a game world, that sounds are often structured within games to construct a sort of feedback between player and system, and that often within this feedback loop the narrative voice perpetuates problematic tropes of sexism and racism through its scripting. While I focused on the often dystopic production efforts of large and middle sized game companies in those prior essays, here I will be focusing on autonomous and grassroots examples of how sound is used as a way to stage social experiments which resist these often hegemonic ways that these dominant narratives constrict our views of the world.

Role-playing games, the focus of my post today, offer a more viable path of social resistance than better-known video games. Nordic larp style-games, for example, are written and played within not-for-profit communities, and they utilize themes of social inequality, transformation, and activism within their very scripts. Second, role-playing games, unlike computer games, do not require that their developers are able to code. Instead, games are often circulated by word-of-mouth, or in script format through player communities. In this sense, the genre itself is untethered from many of the problems of consumer capitalism. Many underground role-playing games are designed both around social issues and for local community needs as opposed to the market demands that necessitate big budgets, big programming teams, and few risks in the video game industry today. Finally, because role-playing games necessitate neither big budgets, the ability to code, nor mass audiences, they are an ideal site wherein game designers and referees can stage social experiments that speak to the unique wants and desires of the communities within which they are run.

In The Larpfactory Book Project, a forthcoming book containing several ready to play examples of Nordic larp (a big shout out to Lizzie Stark for hooking me up with an advance copy of this portion of the manuscript!), larpwrights Matthijs Holter and Fredrik Hossmann propose a game entitled “Before and After Silence,” focused on thinking through the collective experience of silence. From the game description:

In a world of more and more sound, silence is becoming more valuable. Before and After Silence is about limitations and listening, and about doing almost nothing. It is non-verbal and uses silence as its starting point. It is about shifting the point of view from “what is” to “what is not,” about shifting the focus from “the sounds” to “the spaces between the sounds,” from “the actions” to what is “between the actions,” and to “what is not done.” Rather than playing characters, we examine how we look at ourselves and how different filters can change how we see ourselves and others.

The game is structured as a social experiment for five to twelve players who are made to select two cards, one of which prompts players with an action they must complete only once during the hour of silence (one example reads “Go over to someone and whisper something in a language you don’t know”), and another which prompts players with a setting through which they should interpret the actions of the other players in the room (one example suggests a player imagine themselves in a community of prisoners, another makes a player imagine themselves as one in a society of telepaths). Before the game there are a set of workshops aimed at orienting players to the scope and silence of the game, and afterward there is a debriefing session where players compare their experiences of silence during the game.

Tons of great examples of work in the Nordic larp genre are in this book. Image borrowed from FransBadger @Flickr.

Tons of great examples of work in the Nordic larp genre are in this book. Image borrowed from FransBadger @Flickr.

Unlike American larps, which often take place in high-fantasy settings and direct their action around combat scenarios, Nordic larps often focus on the everyday and comparatively mundane, and as such tend to be more concerned the problems of the everyday as well. Even those that take place in more exotic environments, such as System Danmarc, a game set in the cyberpunk future of Copenhagen, engage players in real issues regarding class and poverty. After living in a shanty-town simulating the future streets of Copenhagen for a week of game-time (In Nordic-style larps, game-time is often equivalent to real time, and so a week in-game is equivalent to a week out of game) players are shown a documentary about the actual slums of Copenhagen where they realize that their experience within the space of play was made to mirror the experience of those struggling with the these very issues in the real world.

In the case of “Before and After Silence,” it is interesting to consider the ways in which the game designers here play with sound, and how these experiments in sonic game design might provoke new modes of subjectivity. As described earlier, players are both given a particular action and or noise to perform, but also are prompted with a way to imagine the actions that the rest of the players in the room are performing. The resulting group performance is an acid dream of sorts wherein each player is made to imagine the room’s soundscape in a very different way. Is the setting a long-lost silent film, or are you drifting through an ether of emotions and past romances? The game focuses on playing with silence in a way that makes the din of communication an unfamiliar and distant memory. The game affords players an opportunity to imagine the world sound. In doing this, “Before and After Silence” displaces the dominance of the voice as a mode of communication and through this questions the ways in which we imagine the world.

Not all is perfect, however, in this utopia of resistance. As Lisa Blackman (2009) argues in her essay “Embodying Affect: Voice-hearing, Telepathy, Suggestion and Modelling the Non-Conscious,” play with the exchange of subjectivities and sound marks an ontological shift from a praxiology of what bodies are to what bodies can do (p. 170). Moving forward from her work in understanding the ritual practices of voice-hearing communities, Blackman explains that similar forms of sonic play (including play with silence) allow for the experience, embodiment, and trade of desire, fear, and trauma. In the context of “Before and After Silence,” this means that as players sculpt and adjust the sonic space of the room, they run the risk of also shaping and altering each others psychic conditions, in unpredictable and perhaps dangerous ways.

The conflation which occurs between these spaces of real emotion and play emotion is, in fact, well documented, and referred to in larp communities as “bleed.” As role-playing scholar Sarah Bowman (2013), explains in her essay “Social Conflict in Role-Playing Communities: An Exploratory Qualitative Study,” even though bleed does occasionally create rifts in relationships (some participants that she has interviewed reported in-game events disturbing their out of game relationships), others seek it out as a form of extreme play. For this reason Nordic larps require ethical behavior on the parts of their players, and because of the nature of the psychic and social sculpting which can occur within the play spaces of the game, the possibility exists that a single unethical player could create a negative and perhaps concerning experience for many others. That said, there are several ways the community mitigates the possibility of this problem including meticulous casting processes, before-game workshops, after-game debrief sessions, and safe words for use during play.

Players debrief after a game. Image borrowed from Fiezi @Flickr.

Players debrief after a game. Image borrowed from Fiezi @Flickr.

“Before and After Silence” is a valuable cultural artifact that lies at the intersection of scholarship on sound studies and serious play. At the same time that it promises several new ways to think through how sound, communication, and silence influence the how we frame and approach the world, it also raises deeper questions regarding the nature of social control and the viability of autonomous modes of organization. As silence allows players to explore and interact with a world where the soundscape takes on an increased prominence, do sexist, racist, and homophobic modes of socialization still manage to creep into the play space? And does the voice, along with its physiological and cultural embodiment of race, class, and gender, offer an escape from these experiments in silence if and when they turn dystopic?

Featured image: “Larp” by Flickr user marten vaher, CC-BY-NC-SA 2.0

Aaron Trammell is co-founder and Multimedia Editor of Sounding Out! He is also a Media Studies PhD candidate at Rutgers University. His dissertation explores the fanzines and politics of underground wargame communities in Cold War America. You can learn more about his work at aarontrammell.com.

tape reelREWIND! . . .If you liked this post, you may also dig:

Goalball: Sport, Silence, and Spectatorship— Melissa Helquist

GLaDOS, The Voice of Postfeminist Control— Aaron Trammell

Video Gaming and the Sonic Feedback of Surviellance: Bastion and the Stanley Parable— Aaron Trammell