Archive | Technology RSS for this section

Digital Analogies: Techniques of Sonic Play

Sound and PlayEditor’s Note: Welcome to Sounding Out!‘s fall forum titled “Sound and Play,” where we ask how sound studies, as a discipline, can help us to think through several canonical perspectives on play. While Johan Huizinga had once argued that play is the primeval foundation from which all culture has sprung, it is important to ask where sound fits into this construction of culture; does it too have the potential to liberate or re-entrench our social worlds? Here, Roger Moseley challenges us to rethink the philosophical discourses of both sound and play and locates the moments in which they intersect and interface. From games of Telephone to Guitar Hero, Moseley considers the ways in which sonic play can help us understand the phantasmic binaries of the analog and digital.–AT

Throughout the distinguished intellectual lineage of play (where it is touched on by notable philosophers such as Plato, Montaigne, Kant, Schiller, Gadamer, Derrida, and Baudrillard), little attention has been paid to the parallels that can be drawn between sound and play as both media and phenomena. The very name of today’s most prominent cultural and technological locus of play, the video game, overtly privileges the eye at the expense of the ear. As recent research and creative work by such figures as Aaron OldenburgAaron TrammellGeorge Karalis, and Enongo Lumumba-Kasongo indicates, a surge of interest in audio games, as well as video games that emphasize the importance of sound while eschewing or minimizing visual stimuli, is acting as a salutary corrective to this oculocentrism. In what follows, I suggest that bringing sonic and musical techniques to bear on this history might afford new insights into play and its myriad configurations. Conceiving of play sonically entails thinking of sound playfully. This intersectional logic can, I argue, unpick binarisms that enforce problematic distinctions and constrict thought. To demonstrate this, I conclude by deploying the concept of play to redefine the relationship between the digital and the analog—and vice versa.

How can play be defined in a manner that encompasses its farrago of meanings and associations? For video game designers and theorists Katie Salen and Eric Zimmerman, the answer is deceptively simple: play is “free motion within a more rigid structure” (Rules of Play, 304). To illustrate the flexibility of this definition, Salen and Zimmerman allude to the phenomenon of light playing upon the ocean waves. They leave unexamined, however, the intimacy and richness of the relationship between play and sound. From a scientific perspective, the patterned oscillation of which a sequence of sound waves is constituted consists of free motion within the limits set forth by the laws of physics. When disciplined and deployed as a cultural technique–take the play of musical instruments for example–sonic play is humanized and rendered transitive. But, we might also suggest that instruments play people, citing the sensation of automation with which fingers flash over fretboard or keyboard. Moving further away from anthropocentrism, we can observe how sonic technologies render play intransitive once more. From the barrel organ to the iPod, sound plays without human aid when mechanically reproduced. This way of framing reproduction invokes and extends Roger Caillois’s playful category of mimicry, which can be construed as faithful imitation, deceptive fakery, or even a Baudrillardian attempt to simulate a phenomenon that never existed.

In order to pay due attention to both the technologies through which sonic play is mediated as well as the cultural techniques imbue it with significance, I suggest that we supplement Salen and Zimmerman’s definition by thinking of freedom, motion, and structure in both digital and analogical terms. To an extent, the adoption of this modish epistemological framework acknowledges that conceptions of play are always constrained by their prevailing intellectual context. More importantly, however, I contend that technologies of sonic generation and representation from the seventeenth to the nineteenth centuries can be understood to play with the categories of the digital and the analog avant la lettre (ou le chiffre). The two categories are not mutually exclusive and to treat them as such would be to subjugate the granularity of the analog to the binary logic of the digital. Rather, they co-exist as modes between which sounds and players freely oscillate.

The origins of digital sonic play lie within the human body.  As Johan Huizinga put it, “the link between play and instrumental skill is to be sought in the nimble and orderly movements of the fingers.” In the course of musical performance, human digits perform innumerable calculations. At its crudest level, musical performance from a score can be construed as a sort of algorithmic play through which mimetic fidelity is evaluated (and wrong notes relentlessly tallied). This ludic logic is at its most visible in rhythm-action video games such as Guitar Hero in which the score is no longer a text but rather a quantitative analysis. The iconography of these games usually indexes a set of digital technologies used primarily for the recording, editing, and playback of music. On the one hand, this relationship can be traced back to Leibniz’s exposition of ars combinatoria and his “invention” of binary; on the other, it is realized by the hydraulic organ and composing machine devised and programmed by the Jesuit polymath Athanasius Kircher, both of which are depicted in his Musurgia universalis (1650). In media-archaeological terms, the combination of Leibniz’s concepts and Kircher’s mechanisms gave rise to the hardware and software of Joseph Marie Jacquard’s revolutionary loom, Charles Babbage’s prototypical Analytical Engine, the player piano, the IBM punch card, and the MIDI sequencer before resurfacing in Guitar Hero, a piece of software that, in purely algorithmic terms, enlists the player’s digits to verify checksums.

An example of Kirscher and Scott's Organum.

An example of Kircher and Schott’s Organum, an early example of the digitization of music.

Such digital grids may constitute the field and the rules of sonic play, but they must be supplemented by analog elements if play is to flourish. As detailed in C. P. E. Bach’s Versuch über die wahre Art das Clavier zu spielen (1753/62), the clavichord and its descendants distinguished themselves from the harpsichord and the organ by endowing the keyboard with an infinite sensitivity to touch, thereby enabling a mimetic spectrum of emotional flow with unprecedented verisimilitude. Analogicity also provides another perspective on Caillois’s concept of mimicry, according to which one object or activity playfully stands in for another via imitation, deception, or make-believe. Additionally, the curves of Ernst Chladni’s figures, which materialized sound as sand, exemplify this sonic and mimetic trajectory as they rely on both Hermann von Helmholtz’s pioneering work on acoustics and the complex history of phonography to the development of analog synthesis.

In terms of sonic play, digital and analog elements can be chiastically recombined and reconfigured. A sonic communication game such as Telephone relies on the human propensity for analogy and its corrupting influence on the integrity of information transfer, playfully inverting the conditions and functions of the “real” telephone (which was engineered to compress informational content digitally without jeopardizing meaning). In much electronic dance music, the digital latticework, simultaneously visualized and rendered audible by the sequencer’s grid, constitutes a field of play overlaid with vocals, sweeps, and other analog elements that, in turn, have been captured via digital sampling. As a kind of meta-game, a mash-up plays with sonic elements whose relations can be parsed in the digital terms of Leibnizian recombinatorial play, but equally important are the unintended associations and analogies which inevitably emerge. And while games such as Guitar Hero foreground digital techniques of sonic reproduction, they simultaneously foster diverse forms of analogical play involving the player’s manipulation of the sonic (and social) behavior of her on-screen avatar—and vice versa.

Playing telephone. Image borrowed from diamondmanga @Wikimedia.

Playing telephone. Image borrowed from diamondmanga @Wikimedia.

There is no doubt that the status of sound and its mediation through and as play have too often gone unacknowledged. As well as seeking to rectify this state of affairs by stressing the importance of sound in relation to the playful operations of other media, we might also dwell on the distinguishing features that set it apart: sound and the techniques that shape it are unique in the ways they simultaneously trace and are traced by the materials, technologies, and metaphors of play.

Roger Moseley is an Assistant Professor in the Department of Music at Cornell University. His most recent research brings a media-archaeological perspective to bear on musical performance and improvisation. He is particularly interested in how the concept of play informs sonic practices and cultural techniques. Active as a collaborative pianist on both modern and historical instruments, he has recently published essays on digital games in the contexts of musical and visual culture. His current book project is entitled Digital Analogies: Interfaces and Techniques of Musical Play.

tape reelREWIND! . . .If you liked this post, you may also dig:

Papa Sangre and the Construction of Immersion in Audio Games– Enongo Lumumba-Kasongo

Playing with Bits, Pieces, and Lightning Bolts: An Interview With Sound Artist Andrea Parkins— Maile Colbert

Experiments in Aural Resistance: Nordic Role-Playing, Community, and Sound— Aaron Trammell

Playing with Bits, Pieces, and Lightning Bolts: An Interview with Sound Artist Andrea Parkins

Sound and PlayEditor’s Note:  Welcome to Sounding Out!‘s fall series titled “Sound and Play,” where we ask how sound studies, as a discipline, can help us to think through several canonical perspectives on play. While Johan Huizinga had once argued that play is the primeval foundation from which all culture has sprung, it is important to ask where sound fits into this construction of culture; does it too have the potential to liberate or re-entrench our social worlds? SO!’s regular contributor Maile Colbert interviews sound artist Andrea Parkins and gets her to talk about her creative process, and the experience of playing with sound, composition, and instruments.–AT

In 2003, working towards my graduate degree in Integrated Media at California Institute for the Arts, I met and worked with a visiting artist by the name of Andrea Parkins, with whom I became a friend and colleague. Although I’ve been familiar with her work for more than a decade, every time I see Andrea perform my mind is blown. And, every time we discuss her practice, her methodology, and her thoughts on art and work, I’m always compelled and inspired in my own practice as a sound artist. In particular, I am impressed by her insights on the relationship between art, play, and the act of improvisation.  The interview that follows is both a sampling of the conversations we have been gifted with throughout the years and a rare opportunity to listen in to the creative process of a working sound artist.

1. Hi Andrea, how are you today? What are you in the middle of?

I’m well – working on a number of different projects at the moment, including preparing for a residency at Q-02: workspace for experimental music and sound art, in Brussels, where I’m going to be working on a new multi-diffusion sound piece, addressing the interaction of moving objects with human gesture in idiosyncratic acoustical spaces. I’m also working on some new recordings – one is a catalogue of short pieces, combining electric accordion-generated feedback with processed field recordings; and another incorporates 15 short object-based electronic pieces into a live ensemble work.

2. Can you describe your entrance into the world of sound and music?

I grew up in Western Pennsylvania, acutely aware of the drones and sonic events in the surrounding rural landscape. At the same time my early experience of sound through my teens resided in realm of the “musical” and the social; it connoted family (nearly all of my family members were/are musicians, and music and sound was always present); culture; and musical practice as ritual. Most family members were serious classical musicians, some were rock musicians and singer/songwriters; some were both.  I studied classical piano from the age of 6 through my early twenties, and from the beginning had access to and absorbed a wide range of musics– immediately attracted to dissonance, or music with subtle harmonic and timberal changes.  After high school, I moved to Boston and studied jazz piano and free improvisation.  In my early 20s, I bought an analog synth, and experimented with oscillators and filters, playing synth in punk, free jazz, and new wave bands. Probably most important in my sonic development was that I went to art school and in that context began making experimental films and video, drawings and installation. I believe that my exposure to non-narrative film especially had a profound effect on how I began thinking of compositional possibilities for sound, and about art that happens in time, and also space

3. Speaking of worlds, what is the line experienced, if there is one, between the experimental sound art world and improvisation?  How did you find yourself with one foot in each of these worlds, and how do you navigate between them?

While I know that some artists and theorists do draw a line between sound art and improvisational “music” performance, I don’t usually think about it that way, and for the most part that is not how I experience my relationship with sound. Having said this, I recognize that there are communities that identify themselves as one thing or the other, and performance and exhibition spaces that are organized based on one side or the other of this dichotomy, so at times I do have to “navigate between them.”  This isn’t necessarily a bad thing: this allows artists to build a common discourse around their particular focus, and can even develop a creative legacy among artists.  For myself, I try to think about my intentions regarding a particular installation or performance: especially in consideration of site and audience, and formulate language around this that can speak to the specifics of the situation.

Photo Credit: Paul Geluso 2009

Photo Credit: Paul Geluso 2009

4. And being a woman in these worlds, have you found a difference between when you were starting out and now?  Have you found a difference within the generations you work with?  

I believe that for younger women, things have changed a lot: peer communities of young artists are more integrated gender-wise, and it seems that there are many more women worldwide are active and visible as experimental musicians and sound artists than when I began. I came “of age” at a different juncture and did not have this experience. To some extent this was because of the class and milieu that I came from, which meant there was no model in front of me. I do think this would have been mitigated if I had learned sooner about some of the female innovators of electronic music, among them: Bebe Barron, Wendy (Walter) Carlos, Eliane Radigue, Maryanne Amacher, Laurie Spiegel, and Pauline Oliveros. This exposure came later.

When I began working as an improvising musician, I found myself on the periphery, and never wholly part of, a group of mostly male colleagues.  There were aspects to this experience that I actually now appreciate. It had value because I remained in the position of an outsider, and while I felt some sense of displacement because of this, it allowed me to develop my own critique of whatever prevailing processes and products were happening at that time, and a new assessment of what I wanted to create. I should mention that when working alone or in collaboration in other forms: intermedia, sound and performance installation, I have found that these contexts offer a more inclusive politics and discourse.

5. Something interesting came up in our last conversation that inspired me to change this question around a bit.  Instead of asking you to talk about your works, and since our readers can access many different interviews, documents, and articles online, can you talk about how to talk about your work?

This is something I am learning how to do (yet again), as I become more aware that my work engages with multiple practices, multiple voices, multiple processes. It’s about beauty too (that dirty word) – in the sense that beauty (for me) is about viscerality, atmosphere, presence, fragility; this calls my attention to the physical space I am in and to how time is passing: that is to say, to mortality. Most recently I have been seeking different forms of sonic structure that are not based on “history” as forward motion, as a narrative driving through time, but that can allow for stasis, multiplicity, simultaneity, and chaos and acceptance of a potentially forward moving structure to fall totally apart.

Since 2005, in addition to exploring these modalities as an improviser and composer (for live instruments), I have been working to reintegrate a more interdisciplinary approach to my work – referencing the materiality of objects, and the body in motion, and engaging in wider range of sonic sources and processes, visual elements, and acoustical spaces.  This has resulted in my creation of several fixed media works for the gallery/installation setting, as well as some electronic music pieces scored only for objects.

6. The term improvisation confuses a lot of people, and can be hard to articulate.  What does it mean to you? And within improv, what does “work” and what does “play” means to you?

Speaking most simply, improvisation is (for me) a series of compositional decisions made in real time that are then immediately acted upon, with acute attention: to self, other, site and context.  Being an improviser entails so much listening (to oneself and others, at the same time) and also connecting with others while maintaining one’s own sonic space/language; in a way it’s social and interiorized process at the same time. So it’s work!  You are  — at times – straining your ears; listening for the clues for what others are “saying,” even if they are not quite saying it. Perhaps this even involves a kind of telepathy. However, at its best moments it can be exhilarating work; there can be lively engagement among fellow performers  — or when performing alone when moving among one’s own sonic materials and instruments – that is highly stimulating and fun.

Photo credit: Maile Colbert 2010

Photo credit: Maile Colbert 2010

7. Is there a hierarchy of process versus presentation for you?

I often find that my best-laid plans must be jettisoned because I have an idea or epiphany that suddenly strikes me, and it just won’t wait. For me, these “lightening bolts” often quickly resolve into having to face a challenging new work process — challenging perhaps because I have been afraid that somehow it won’t produce a result that I can readily identify as successful. But the old ways will always be there, and in the meantime it is possible that by trying something else, a new discovery will come that transforms everything – including the way I think about what a “successful result” should look like. I now feel that the notion of a “successful result” in itself has become pretty relative, and in some cases, a moot point. This is because what I now define as successful can often have much to do with my assessment of the process I employ in making something, rather than how well I have fulfilled the requirements of a pre-meditated structure: the result. This has made my engagement with my work much more open-ended in a way that I have learned to appreciate over time.

For me, composition mostly happens in the editing: that is where I find (uncover, sculpt) structure from the sound that I collect and/or record, building up a mass of material from which I can “find the piece” through editing, assemblage and layering. I think this is similar to the way some filmmakers might shoot video/film and then from raw footage hone in on or discover a film’s structure via the editing process. I like the idea that instead of filling a pre-ordained structure with content one can move the content around until the structure emerges. Maybe one recognizes the completed structure when one sees it. I like to remember that a structure, even if unusual, asymmetric, messy, seemingly random, or just plain weird – if that is what emerges – is still a structure, howsoever idiosyncratic. And it can be presented.

Photo Credit: Herve Le Gall 2012

Photo Credit: Herve Le Gall 2012

8. Can you talk about differences between performance vs. play and performance vs. studio to you, and your relationship with the instruments you play?  

In 2002, I began developing a MAX-based extended processing instrument inspired by Rube Goldberg and his machines. It has built into its programming seemingly “randomized” sonic processing that highlights and/or alters specific frequencies and densities, with emphasis on repetitions, interruptions, stasis and malfunction. When I began working with the instrument, I was exploring processes related to Fluxus in my compositional and improvisational practices. I was also thinking about a kind of poetics that I saw as related to my independent studies in feminist and psychoanalytic theory, and to the body of an improvising performer who is up against the limits of his or her own virtuosity. Once I designed the instrument I realized there really was a connection to these things – and to how approach decision-making as an artist – the importance of chance – but also slippage and failure and moments of physical awkwardness as what I try to accomplish on a technical level comes perilously (and for me, interestingly) close to falling apart – especially when performing with multiple instruments in simultaneity. My virtual instrument is a collaborative partner who doesn’t cooperate. It makes “sense and non-sense,” The slippage and failure relates to meaning, and for me is a metaphor for loss or displacement. For me, this is important … to me this is daily, everyday life.

Photo Credit: Glenn Cornett 2013

Photo Credit: Glenn Cornett 2013

Featured Image Photo Credit: Julia Berg 2010

Andrea Parkins is a composer, sound/installation artist and improvising electroacoustic performer who engages with interactive electronics as compositional/performative process, and explores strategies related to Fluxus’ ordered, ephemeral activities. She is a key participant in the New York sound art and experimental music scene,  and worldwide she is known for her pioneering gestural/textural approach on her electronically-processed accordion and self-designed virtual sound-processing instruments. Described as a “sound-ist,” of “protean,” talent by The New York Times music critic Steve Smith, Parkins’ laptop electronics and Fender-amped accordion create sonic fields of lush harmonics and sculpted electronic feedback, punctuated by moments of gap and rift.  Her work has been presented at the Whitney Museum of American Art, The Kitchen, Diapason, and Experimental Intermedia; and international festivals/venues including Mexico City’s 1st International Sound Art Festival, NEXT in Bratislava, Cyberfest in St. Petersberg, and q-02 in Brussels. Parkins’ recordings have been published by Important Records, Atavistic, and Creative Sources, and her work has received support from American Composers Forum, NYSCA, the French-American Cultural Exchange, Meet the Composer, Harvestworks Digital Media Arts Center, and Frei und Hanseastadt Hamburg Kulturbehoerde. Parkins is on faculty at Goddard College’s MFA in Interdisciplinary Arts program.

Maile Colbert is a multi-media artist with a concentration on sound and video who relocated from Los Angeles, US to Lisbon, Portugal. She is a regular writer for Sounding Out!

tape reelREWIND! . . .If you liked this post, you may also dig:

Wayback Sound Machine: Sound Through Time, Space, and Place— Maile Colbert

Sounding Out! Podcast #15: Listening to the Tuned City of Brussels, The First Night— Felicity Ford and Valeria Merlini

Sounding Out! Podcast #10: Interview with Theremin Master Eric Ross— Aaron Trammell