Archive | Aesthetics RSS for this section
September 24, 2012  

Further Experiments in Agent-based Musical Composition

Photo by whistler1984 @Flickr.

Editor’s Note:  WARNING: THE FOLLOWING POST IS INTERACTIVE!!!  This week’s post is especially designed by one of our regulars, Andreas Duus Pape, to spark conversation and provoke debate on its comment page.  I  have directly solicited feedback and commentary from several top sound studies scholars, thinkers, artists, and musicians, who will be posting at various times throughout the day and the week–responding to Andreas, responding to each other, and responding to your comments.  Look for commentary by Bill Bahng Boyer (NYU), Maile Colbert(Binaural/Nodar, Faculdade de Belas Artes da Universidade do Porto), Adriana Knouf(Cornell University), Primus Luta (AvantUrb, Concrète Sound System), Alejandro L. Madrid (University of Illinois at Chicago), Tara Rodgers (University of Maryland), Jonathan Skinner (ecopoetics),  Jonathan Sterne (McGill University), Aaron Trammell (Rutgers University, Sounding Out!) and yours truly (Binghamton University, Sounding Out!).  Full bios of our special respondents follow the post. We wholeheartedly wish to entice you this Monday to play. . .and listen. . .and then share your thoughts via the comment page. . .and play again. . .listen again. . .read the comments. . .and share more thoughts. . .yeah, just go ahead and loop that.  –JSA, Editor-in-Chief

—

I’m a musician and an economist. Sometimes you will find me playing acoustic folk rock and blues on guitar, harmonica and voice. And at other times I will be at work, where I apply my expertise in game theory to the computer modeling of social phenomena. I create simulations of people interacting – such as how people decide which way to vote on an issue such as a tax levy, or how people learn to sort objects given to them in an experiment. In these simulations, the user can set up characteristics of the environment, such as the number of people and their individual goals. After things are set up, users watch these interactions unfold. The simulation is a little story, and one need only tweak the inputs to see how the story changes.

As a musician, I was curious if a program that generates social stories could be refashioned to generate musical pieces. I wanted to build a music-generation engine that the listener could tweak in order to get a different piece each time. But not just any tune – a piece with some flow, some story. I like that tension between randomness and structure. On one hand, I want every song to vary in unpredictable ways; on the other hand, I want to create music and not structureless noise.

I created a basic story of predators and prey, whimsically naming the prey “Peters,” represented by rabbits, and the predators “Wolves.” My simulation depicts a plain in the savannah with a green oasis. The prey seek the oasis and the predators seek the prey. Each character has its own goals and the closer they are to achieving them, the happier they are. Both predators and prey want to have stomachs full of food, so naturally they want to be close to their target (be it prey or oasis). As they travel through the savannah, they learn what choices (directions of movement) make them happier, and use this experience to guide them.

Photo by bantam10 @Flickr

So how does this story become music? To this question there are two answers: a technical one and an intuitive one. The intuitive answer is that in real life the story of predators and prey plays out geographically on the savannah, but musically this is a story that plays out over a sonic landscape. To elaborate, I abstracted the movement of the prey and predator on the geography of the plain into the musical geometry of a sonic landscape. The farther north an agent travels, the higher the pitch. And, the farther east an agent travels the longer the duration. In other words, as an agent travels to the northwest, she makes longer-lasting tones that are higher pitched. I also mapped happiness to volume, so that happy agents make louder tones. Finally, so that each agent would have a distinct voice as they traveled through this space, I chose different instruments for each agent.

In the video below I assigned the “church organ” sound to prey, and the “brass section” sound to predators.

Ultimately, there are some things that I like about this piece and others that I do not.

As a harmonica player, I improvise by creating and resolving tension. I think this piece does that well. The predator will pursue the prey into a quiet, low-pitch corner, creating a distant, rumbling sound – only to watch prey escape to the densely polyphonic northwest corner. There is an ebb and flow to this chase that I recognize from blues harmonica solos. In contrast to my experience as a harmonica player, however, I have found that some of the most compelling parts of the dynamics come from the layering of notes. The addition of notes yields a rich sonic texture, much like adding notes to a chord on an organ.

Unfortunately, for largely technical reasons, there is a lack of coherent rhythm and pacing. The programming platform (agent-based modeling software called NetLogo) is not designed to have the interface proceed in real-time. Basically, the overall speed of the piece can change as the processing load increases or decreases. I found that as agents learnt more about their surroundings (and more system resources are allocated to this “memory”), they became slower and slower. To fix this, I capped the size of their memory banks so that they would forget their oldest memories. The closest I have come to a rhythmic structure is by ordering the way that the agents play. This technique makes the piece have a call-and-response feel. If only the piece to had a coherent rhythm,  then I could imagine playing harmonica along with it.

One last comment on pitch: while an earlier version of this piece mapped each step in space to a semitone, things sounded too mechanical. Even though this was the easiest and most intuitive decision from a technical standpoint, it was aesthetically lacking, so I have now integrated traditional musical scales. The minor scale, in my opinion, is the most interesting as it makes the predator/prey dynamic sound appropriately foreboding.

Photo by deivorytower @Flickr.

You can play this piece yourself. Simply go to this link with Java enabled in your browser (recommended: Google Chrome). Pressing “Setup” then “Go” will create your own run of the piece. As it is running, you can adjust the slider above the graphic window to change the speed. Press “Go” again to stop the model, adjust any parameters you wish and press “Setup” and “Go” again to see how the piece changes. Here are some parameters to try: instA and instB to change the instruments associated with prey and predators; PlayEveryXSteps to change the pace of the piece (higher results in a slower paced piece); Num-PackAs and Num-PackBs changes the number of prey and predators; the vertical PeterVol and WolfVol adjust the overall volume of prey and predators.

In regards to my version of “Peter and the Wolf,” I have a number of things that I’m curious about.

First, how does this relate to what you think of as music? Do you like listening to it? Which elements do you like and which do you dislike? For example, what do you think about about the tension and rhythm – do you agree the first works and that the second could be improved? Would you listen to this for enjoyments’ sake, and what would it take for this to be more than a novelty? What do you think about the narrative that drives the piece? I chose the predator and prey narrative, admittedly, on a whim. Do you think there might be some other narrative or agent specific goals that might better drive this piece? Is there any metaphor that might better describe this piece? As a listener do you enjoy the experience of being able to customize and configure the piece? What would you like to have control over that is missing here? Would you like more interaction with the piece or less interaction?

Finally, and perhaps most importantly, what do you think of the premise? Can simple electronic agents (albeit ones which interact socially) aspire to create music? Is there something promising in this act of simulation? Is music-making necessarily a human activity and is this kind of work destined to be artificial and uncanny?

Thanks for listening. I look forward to your thoughts.

“The Birth of Electronic Man.” Photo by xdxd_vs_xdxd @Flickr.

– – –

Andreas Duus Pape is an economist and a musician. As an economist, he studies microeconomic theory and game theory–that is, the analysis of strategy and the construction of models to understand social phenomena–and the theory of individual choice, including how to forecast the behavior of agents who construct models of social phenomena. As a musician, he plays folk in the tradition of Dylan and Guthrie, blues in the tradition of Williamson and McTell, and country in the tradition of Nelson and Cash. Pape is an assistant Professor in the department of Economics at Binghamton University and is a faculty member of the Collective Dynamics of Complex Systems (CoCo) Research Group.

– – –

Guest Respondents on the Comment Page (in alphabetical order)

Bill Bahng Boyer is a doctoral candidate in music at New York University who is completing a dissertation on public listening in the New York City subway system.

Maile Colbert  is an intermedia artist with a concentration in sound and video, living and working between New York and Portugal. She is an associated artist at Binaural/Nodar.

N. Adriana Knouf is a Ph.D. candidate in information science at Cornell University.

Primus Luta is a writer and an artist exploring the intersection of technology and art; he maintains his own AvantUrb site and is a founding member of the live electronic music collective Concrète Sound System.

Alejandro L. Madrid is Associate Professor of Latin American and Latino Studies at the University of Illinois at Chicago and a cultural theorist and music scholar whose research focuses on the intersection of modernity, tradition, globalization, and ethnic identity in popular and art music, dance, and expressive culture from Mexico, the U.S.-Mexico border, and the circum-Caribbean.

Tara Rodgers is an Assistant Professor of Women’s Studies and a faculty fellow in the Digital Cultures & Creativity program at the University of Maryland. As Analog Tara, she has released electronic music on compilations such as the Le Tigre 12″ and Source Records/Germany, and exhibited sound art at venues including Eyebeam (NYC) and the Museum of Contemporary Canadian Art (Toronto).

Jonathan Skinner founded and edits the journal ecopoetics, which features creative-critical intersections between writing and ecology. Skinner also writes ecocriticism on contemporary poetry and poetics.

Jonathan Sterne teaches in the Department of Art History and Communication Studies and the History and Philosophy of Science Program at McGill University. His latest book, Mp3 The Meaning of a Format comes out this fall from Duke University Press.

Jennifer Stoever-Ackerman is co-founder, Editor-in-Chief and Guest Posts Editor for Sounding Out! She is also Assistant Professor of English at Binghamton University and a former Fellow at the Society for the Humanities at Cornell University (2011-2012).

Aaron Trammell is Multimedia Editor of Sounding Out! and a Ph.D. Candidate in Media and Communications at Rutgers University.

August 13, 2012  

The Sound of Radiolab: Exploring the “Corwinesque” in 21st Century Public Radio

Editor’s Note: Today, radio scholar Alex Russo, author of Points on the Dial: Golden Age Radio Beyond the Networks , continues our summer series “Tune In to the Past,” which explores the life and legacy of radio broadcaster Norman Lewis Corwin, the “poet laureate of radio” who died last summer at the age of 101.   Sounding Out!‘s three-part exploration of his legacy by radio scholars Neil Verma (June), Shawn VanCour (July), and Russo (August) not only gives Corwin’s work new life (and critique), but also speaks to the growing vitality of radio studies itself. And now, hey everyone, you are listening to . . .Alex Russo  Alright? Okay? Alright?–JSA  

P.S. Look for a special bonus fall installment of the Corwin series in September!

—

Voice 1: What if you were the best in the world at something…

Multiple Voices: [background] He is the greatest….most stupendous…. most thrilling…most inventive

Voice 1: and then your entire industry collapsed.

Voice 2: [continuing and fading out] Radio[?] Writer.

Voice 1: But you kept on working?

SFX: Typewriter, continuing until coming to a dead stop when return bell rings and the carriage returns with a clunk on “pass away”

Voice 1: Outliving all your peers, until, 77 years later, you pass away?

Voice 3: Norman Corwin? Never heard of him. He defined a generation’s engagement with sound?

Voice 1: And there is no one left to eulogize you? What is your legacy?

This post is the third in a series that engages with the legacy of Norman Corwin, a – perhaps the – preeminent radio writer and producer of the late 1930s and 1940s. Specifically, it picks up on Neil Verma’s challenge back in June to consider the legacy of the “Corwin-esque.” Verma devotes considerable space to mapping the aesthetic syle of Corwin in his post and his incredibly insightful and astute book, Theater of the Mind.

The analysis that follows leans on Verma’s argument with a caveat. The question of legacy stems in part from Verma’s assertion that Corwin lived for so long, few were left to speak for his legacy. Corwin may not have the name recognition that he should within the broader public, but for radio practitioners, he is regarded with considerable reverence.  In this sense, the Corwinesque style lives on by inspiring contemporary radio producers, especially, I will argue, in the aural style of the syndicated WNYC public radio program Radiolab, hosted by Jad Abumrad and Robert Krulwich. Radiolab describes itself as “a show about curiosity. Where sound illuminates ideas, and the boundaries blur between science, philosophy, and human experience.” While ostensibly a science program, designed to make complicated scientific phenomena comprehensible to a general audience, the show engages in fundamental questions about nature, being, and experience in creative ways.

Certainly, Abumrad and Krulwich regard Corwin as an inspiration, such as when Krulwich responded to a claim by This American Life‘s Ira Glass that the turn of the 21st century is the true Golden Age of Radio, by describing Corwin as “Homer in a modern form. . .a lyrical reporter who wrote and spoke like he was wearing a toga and sometimes was so spectacular you’d get dizzy listening and sometimes seems a little too old fashioned and oratorical.”   In his earlier post, Verma defines Corwin’s aesthetic style through a number of formal elements, including what he describes as a kind of “overworked literary calisthenics.”  Putting their own spin on Corwin’s dizzy oratory, Abumrad and Krulwich mark Radiolab with complicated and intentionally convoluted speech patterns. The program features Abumrad and Krulwich in rapid fire banter – far faster than typical public radio fare.  Often, this onslaught of language crowds and overlaps, producing a highly staged simulation of conversational flow. Often, Abumrad is a voice of enthusiastic discovery, while Krulwich plays the role of skeptic, particularly in the early seasons.  Abumrad’s voice is more nasal, higher pitched and, notably, recognizably younger than that of grizzled veteran Krulwich, creating a contrapuntal effect.

Radiolab Producers/Hosts Robert Krulwich (l) and Jad Abumrad (r), Image by Flickr User ThirdCoast Festival

These voices usually interact with a third voice, what typically radio documentary calls the “actuality.” However, instead of than separating “the real” from the narration’s voice of authority, Radiolab juxtaposes sentence fragments from all the voices (analysis, counter-argument, evidence) to create a conversation that proceeds dialectically, on parallel parts that intersect at points to lead to a thematic conclusion.  While Radiolab’s dialogic style has been explored by other radio scholars, like Andrew Bottomley and Eleanor Patterson, its link to Corwin’s model of radio drama deserves more attention. While not exactly the same as Corwin’s signature “choral” vocal style, with voices chiming in from all directions, it performs a similar function, aurally representing a multiplicity of viewpoints.

Furthemore, Abumrad and Krulwich work hard to create a feeling of liveness and connection with Radiolab‘s listeners, much like Corwin did.   Radiolab is certainly not a live program, but we must also remember that much of Corwin’s work was also developed to be recorded and sold–as Shawn VanCour discussed in his offering to this series. Although violating typical news protocols, mangled sentences, mis-matched vocal levels, and cross-talk are not removed during Radiolab‘s editing process; rather they are left in to create the feeling of spontaneity. Krulwich and Abumrad as quite conscious of this effect, with the latter noting in a New York Times profile, “It’s a funny thing, when you find yourselves laboring for weeks to create what you felt at that first moment.”

Abumrad and Krulwich, performing a live version of Radiolab, Image by Flick’r User Jared Kelly

A final connection, Abumrad and Krulwich blend two aural styles, “intimate” and “kaleidosonic,” descriptors Verma coins in Theater of the Mind as the hallmark of Corwin’s formal mastery.  Verma defines broadcast intimacy through radio’s address to the listener as an individual, its placement of a program’s “audioposition” alongside the narrator, as well as its emphasis on place-centered narratives. Kaleidosonic style addresses the listener as a public, uses a multiplicity of auditing positions, and creates a broad model of engagement with narratives centered on events (70). A wonderful representative example of this combination of styles on Radiolab can be heard at several points in season two’s episode, “Detective Stories.”  First, the end of the opening beat features the stylized repetition of a New York Sanitation official describing the Fresh Kills sump as a “time capsule.” As the phrase “time capsule” echoes eight times, Krulwich begins to chant “time capsule” in a lightly mocking and metallic sounding tone. Abumrad tells him, “You can stop that now.”

Later in that episode, a segment entitled “Goat on a Cow,” follows Laura Starcheski across the country as she investigates the twelve-year story behind of a box of old letters found by the side of the road.

This segment takes place at different locations, a hallmark of the intimate style. At the same time, it also uses elements of the kaleidosonic style because the narrative turns on particular events, moments where new evidence is found and new theories of the story of Ella Chase, the letters’ recipient. Throughout this segment Starcheski’s voice fades in and around those of her actualities. When she intervenes to provide context, the other voices are not stopped, they continue, telling their story under hers until at specific moment both voices say an identical phrase. This juxtaposition suggests that the letters hold different meanings for the individuals who come in contact with them: For Starcheski they are a reminder of her childhood desire to invent life stories of strangers; For Erick Gordon, an English teacher who found the letters, they are a great mystery on which he can project his own imagined histories and build a teaching curriculum; Finally, for Robert Chase, they represent a relief that he is no longer the archivist of his grandmother’s life. Like Corwin’s work, “Goat on a Cow” combines intimate and kaleidosonic styles, creating pleasures that are linked not to narrative closure but to the process of sonically representing investigation and theorization.

Letters, by Flickr user aroid

In allowing the pleasures of aural storytelling  to enable the show’s narrative, Radiolab’s Corwin connection expands conceptions of the imagination.   Like Corwin (and radio writers of the network-era), Abumrad sees radio as both an act of “co-authorship” and “co-imagining” between the writer/performer and the listener.  However, he also sees his “job” as “put[ting] certain images and feelings in your head.” This link to discourses of the imagination is clear in the series’ opening episode, “Who Am I?” One segment in this episode, “The Story of Me,” suggests that what defines humanity is “introspective consciousness,” the ability to abstract images or events into a story of self.

Citing neuroscientist Dr. V. S. Ramachandran, Krulwich notes: “Only humans can take images from the real world, pull them into their heads, divide them into parts, and take those parts and turn them into abstractions.” To demonstrate, Krulwich leads Abrumrad through an example where the latter conjures the image purple striped red canary in his head. Ramachandran follows, noting that only humans can rearrange and manipulate “tokens” of “bird,” “striped,” and “red” to “imagine” something that doesn’t exist. The “peculiar human muscle” is that “ability to experience things and abstract them into a story. This definition is telling, while ostensibly it is about human consciousness, I would argue it could just as easily be seen as a description of the job of radio writing, taking recognizable symbolic tokens, manipulating them, and turning them into story. By equating human consciousness with radio, Krulwich and Abumrad exemplify a final theme that Verma attributes to network-era radio drama, its evolution “from being a theater in the mind to being a theater about the mind” (3).

Indeed, the segment of “The Story of Me” finishes by noting that neural actions can only be understood in a group: “Even the thought ‘I am a one’ springs from a hundred million cells connecting through a trillion synapses and that all of this multiple activity paradoxically creates the you of this moment. You are always plural.” I imagine that Corwin, no stranger to celebrations of plurality, would completely agree.

—

Featured Image by Flickr User Jared Kelly

—

Alexander Russo is an Associate Professor in the Department of Media Studies at The Catholic University of America in Washington, DC. He is the author of Points on the Dial: Golden Age Radio Beyond the Networks (Durham, NC: Duke University Press, 2010) as well as assorted articles and book chapters. His research interests include the technology and cultural form of radio and television, the aesthetics of sound, the development of “old” new media, the history of music and society, the relationship between media and space, and the history of popular culture.

« Older Posts
Newer Posts »