Tag Archive | Primus Luta

Further Experiments in Agent-based Musical Composition

Photo by whistler1984 @Flickr.

Editor’s Note:  WARNING: THE FOLLOWING POST IS INTERACTIVE!!!  This week’s post is especially designed by one of our regulars, Andreas Duus Pape, to spark conversation and provoke debate on its comment page.  I  have directly solicited feedback and commentary from several top sound studies scholars, thinkers, artists, and musicians, who will be posting at various times throughout the day and the week–responding to Andreas, responding to each other, and responding to your comments.  Look for commentary by Bill Bahng Boyer (NYU), Maile Colbert(Binaural/Nodar, Faculdade de Belas Artes da Universidade do Porto), Adriana Knouf(Cornell University), Primus Luta (AvantUrb, Concrète Sound System), Alejandro L. Madrid (University of Illinois at Chicago), Tara Rodgers (University of Maryland), Jonathan Skinner (ecopoetics),  Jonathan Sterne (McGill University), Aaron Trammell (Rutgers University, Sounding Out!) and yours truly (Binghamton University, Sounding Out!).  Full bios of our special respondents follow the post. We wholeheartedly wish to entice you this Monday to play. . .and listen. . .and then share your thoughts via the comment page. . .and play again. . .listen again. . .read the comments. . .and share more thoughts. . .yeah, just go ahead and loop that.  –JSA, Editor-in-Chief

I’m a musician and an economist. Sometimes you will find me playing acoustic folk rock and blues on guitar, harmonica and voice. And at other times I will be at work, where I apply my expertise in game theory to the computer modeling of social phenomena. I create simulations of people interacting – such as how people decide which way to vote on an issue such as a tax levy, or how people learn to sort objects given to them in an experiment. In these simulations, the user can set up characteristics of the environment, such as the number of people and their individual goals. After things are set up, users watch these interactions unfold. The simulation is a little story, and one need only tweak the inputs to see how the story changes.

As a musician, I was curious if a program that generates social stories could be refashioned to generate musical pieces. I wanted to build a music-generation engine that the listener could tweak in order to get a different piece each time. But not just any tune – a piece with some flow, some story. I like that tension between randomness and structure. On one hand, I want every song to vary in unpredictable ways; on the other hand, I want to create music and not structureless noise.

I created a basic story of predators and prey, whimsically naming the prey “Peters,” represented by rabbits, and the predators “Wolves.” My simulation depicts a plain in the savannah with a green oasis. The prey seek the oasis and the predators seek the prey. Each character has its own goals and the closer they are to achieving them, the happier they are. Both predators and prey want to have stomachs full of food, so naturally they want to be close to their target (be it prey or oasis). As they travel through the savannah, they learn what choices (directions of movement) make them happier, and use this experience to guide them.

Photo by bantam10 @Flickr

So how does this story become music? To this question there are two answers: a technical one and an intuitive one. The intuitive answer is that in real life the story of predators and prey plays out geographically on the savannah, but musically this is a story that plays out over a sonic landscape. To elaborate, I abstracted the movement of the prey and predator on the geography of the plain into the musical geometry of a sonic landscape. The farther north an agent travels, the higher the pitch. And, the farther east an agent travels the longer the duration. In other words, as an agent travels to the northwest, she makes longer-lasting tones that are higher pitched. I also mapped happiness to volume, so that happy agents make louder tones. Finally, so that each agent would have a distinct voice as they traveled through this space, I chose different instruments for each agent.

In the video below I assigned the “church organ” sound to prey, and the “brass section” sound to predators.

Ultimately, there are some things that I like about this piece and others that I do not.

As a harmonica player, I improvise by creating and resolving tension. I think this piece does that well. The predator will pursue the prey into a quiet, low-pitch corner, creating a distant, rumbling sound – only to watch prey escape to the densely polyphonic northwest corner. There is an ebb and flow to this chase that I recognize from blues harmonica solos. In contrast to my experience as a harmonica player, however, I have found that some of the most compelling parts of the dynamics come from the layering of notes. The addition of notes yields a rich sonic texture, much like adding notes to a chord on an organ.

Unfortunately, for largely technical reasons, there is a lack of coherent rhythm and pacing. The programming platform (agent-based modeling software called NetLogo) is not designed to have the interface proceed in real-time. Basically, the overall speed of the piece can change as the processing load increases or decreases. I found that as agents learnt more about their surroundings (and more system resources are allocated to this “memory”), they became slower and slower. To fix this, I capped the size of their memory banks so that they would forget their oldest memories. The closest I have come to a rhythmic structure is by ordering the way that the agents play. This technique makes the piece have a call-and-response feel. If only the piece to had a coherent rhythm,  then I could imagine playing harmonica along with it.

One last comment on pitch: while an earlier version of this piece mapped each step in space to a semitone, things sounded too mechanical. Even though this was the easiest and most intuitive decision from a technical standpoint, it was aesthetically lacking, so I have now integrated traditional musical scales. The minor scale, in my opinion, is the most interesting as it makes the predator/prey dynamic sound appropriately foreboding.

Photo by deivorytower @Flickr.

You can play this piece yourself. Simply go to this link with Java enabled in your browser (recommended: Google Chrome). Pressing “Setup” then “Go” will create your own run of the piece. As it is running, you can adjust the slider above the graphic window to change the speed. Press “Go” again to stop the model, adjust any parameters you wish and press “Setup” and “Go” again to see how the piece changes. Here are some parameters to try: instA and instB to change the instruments associated with prey and predators; PlayEveryXSteps to change the pace of the piece (higher results in a slower paced piece); Num-PackAs and Num-PackBs changes the number of prey and predators; the vertical PeterVol and WolfVol adjust the overall volume of prey and predators.

In regards to my version of “Peter and the Wolf,” I have a number of things that I’m curious about.

First, how does this relate to what you think of as music? Do you like listening to it? Which elements do you like and which do you dislike? For example, what do you think about about the tension and rhythm – do you agree the first works and that the second could be improved? Would you listen to this for enjoyments’ sake, and what would it take for this to be more than a novelty? What do you think about the narrative that drives the piece? I chose the predator and prey narrative, admittedly, on a whim. Do you think there might be some other narrative or agent specific goals that might better drive this piece? Is there any metaphor that might better describe this piece? As a listener do you enjoy the experience of being able to customize and configure the piece? What would you like to have control over that is missing here? Would you like more interaction with the piece or less interaction?

Finally, and perhaps most importantly, what do you think of the premise? Can simple electronic agents (albeit ones which interact socially) aspire to create music? Is there something promising in this act of simulation? Is music-making necessarily a human activity and is this kind of work destined to be artificial and uncanny?

Thanks for listening. I look forward to your thoughts.

“The Birth of Electronic Man.” Photo by xdxd_vs_xdxd @Flickr.

– – –

Andreas Duus Pape is an economist and a musician. As an economist, he studies microeconomic theory and game theory–that is, the analysis of strategy and the construction of models to understand social phenomena–and the theory of individual choice, including how to forecast the behavior of agents who construct models of social phenomena. As a musician, he plays folk in the tradition of Dylan and Guthrie, blues in the tradition of Williamson and McTell, and country in the tradition of Nelson and Cash. Pape is an assistant Professor in the department of Economics at Binghamton University and is a faculty member of the Collective Dynamics of Complex Systems (CoCo) Research Group.

– – –

Guest Respondents on the Comment Page (in alphabetical order)

Bill Bahng Boyer is a doctoral candidate in music at New York University who is completing a dissertation on public listening in the New York City subway system.

Maile Colbert  is an intermedia artist with a concentration in sound and video, living and working between New York and Portugal. She is an associated artist at Binaural/Nodar.

N. Adriana Knouf is a Ph.D. candidate in information science at Cornell University.

Primus Luta is a writer and an artist exploring the intersection of technology and art; he maintains his own AvantUrb site and is a founding member of the live electronic music collective Concrète Sound System.

Alejandro L. Madrid is Associate Professor of Latin American and Latino Studies at the University of Illinois at Chicago and a cultural theorist and music scholar whose research focuses on the intersection of modernity, tradition, globalization, and ethnic identity in popular and art music, dance, and expressive culture from Mexico, the U.S.-Mexico border, and the circum-Caribbean.

Tara Rodgers is an Assistant Professor of Women’s Studies and a faculty fellow in the Digital Cultures & Creativity program at the University of Maryland. As Analog Tara, she has released electronic music on compilations such as the Le Tigre 12″ and Source Records/Germany, and exhibited sound art at venues including Eyebeam (NYC) and the Museum of Contemporary Canadian Art (Toronto).

Jonathan Skinner founded and edits the journal ecopoetics, which features creative-critical intersections between writing and ecology. Skinner also writes ecocriticism on contemporary poetry and poetics.

Jonathan Sterne teaches in the Department of Art History and Communication Studies and the History and Philosophy of Science Program at McGill University. His latest book, Mp3 The Meaning of a Format comes out this fall from Duke University Press.

Jennifer Stoever-Ackerman is co-founder, Editor-in-Chief and Guest Posts Editor for Sounding Out! She is also Assistant Professor of English at Binghamton University and a former Fellow at the Society for the Humanities at Cornell University (2011-2012).

Aaron Trammell is Multimedia Editor of Sounding Out! and a Ph.D. Candidate in Media and Communications at Rutgers University.

On Donuts, Sandwiches and Beattapes: Listening for J Dilla Six Years On

"J Dilla aka Jay Dee R.I.P." by Flickr user Ohm 17 under Creative Commons License

It has been six years this week since the passing of James “J Dilla” Yancey, considered by many in hip-hop as the quintessential producer’s producer.  Over the course of his career the Detroit-born beatmaker garnered production credits with artists ranging from The Pharcyde to Janet Jackson. Since his passing there has been a substantial amount of posthumous output, including a Yancey Boys album with his brother Illa J, Ruff Draft, The Shining and Jay Stay Paid. There have also been the tons of unofficial releases by artists using material from his beattapes without prior permission.  An unofficial discography of projects ‘featuring’ Dilla’s work could eclipse his official one.

Dilla’s beattapes, which he shared amongst friends and associates via CDs, eventually traveled the globe via message boards years prior to his passing.  His legacy became what it is, at least in part, due to the reach of these CDs, but unfortunately it has also made monetizing the work after his passing a difficult task. There were early issues between Dilla’s family and the legal estate, but for the last couple of years there has been a process established which allows for the use of tracks from his vaults.  They are currently set to release The Rebirth of Detroit, which boasts unheard Dilla beats featuring the Detroit artists he came up with:

In addition to posthumous releases under Dilla’s name the estate also licenses tracks for  projects by other artists.  With over 4000 tracks in their possession, it stands to reason there will be plenty more Dilla in the future.  Yet still there is a sense that ‘new Dilla’ will never be new again, as in the future we will only be able to look at Dilla’s past. How would his process as an artist have grown?  Surely whatever he was doing before he passed sounds nothing like what he would be doing in 2012.

Fortunately, the creativity of Dilla lives on through his influence on others.  In the years since his passing, that influence has gone beyond hip-hop into jazz, indie rock, classical, and electronic music; some might argue Dilla’s influence has spawned new styles or even genres of music .  The LA beat scene was seemingly born in homage to him; with its off kilter drums and wild sample chops, it extends beyond the initial influence, projecting into the future a lineage which will forever trace back to Dilla.  Another of those lineages takes Dilla to perhaps the least likely place for a hip-hop producer: late-night television, through the figure of Ahmir “?uestlove” Thompson of The Roots.

At the end of the 90s until around 2001, Dilla was a member of The Soulquarians creative team that produced albums for Erykah Badu, D’Angelo, Common, and Bilal:

During this time Dilla worked closely with drummer, producer, and founding member of The Roots ?uestlove.  There was a musical bond established over countless studio hours which allowed for a fusion of styles between them that carried Yancey from his Jay Dee period into his J Dilla period, and which ?uestlove continues to carry to this day.

Since Dilla’s passing, ?uest has been an instrumental voice in keeping Dilla’s legacy alive.  He regularly DJ’s events celebrating Dilla’s work.  On all of The Roots albums except for the most recent one, there have been musical dedications to Dilla.  It is when ?uest goes into the studio with The Roots, however, that the living continuation of their musical fusion can be found.

The studio is where ?uest spends a lot of his time, rehearsing The Roots for their role as the house band on the Late Night with Jimmy Fallon show;  ?uest records the sessions to listen back before and after the show. On Late Night The Roots play new songs in front of a live audience five nights a week. These songs only air for ten to twenty seconds going in and out of commercials. If you run to grab something from the refrigerator you might miss them.  Or, coming back you might find your head nodding to them. Not only are they original works (other than walk on music for show guests, and musical performances), they are an insight into the creative process which shaped both ?uest and Dilla.

?uest names the tracks Sandwiches, a nod to his former collaborator’s Donuts. Donuts was the last official project that Dilla worked on, quite literally on his death bed, and is considered his instrumental opus.  It opened up the notion of the short-form instrumental hip-hop work, which traces its own lineage to the history of beattapes. Today, a beattape is a collection of hip-hop instrumentals released as a product through distribution channels (free or paid).  In the beginning however, beattapes were physical cassette tapes (and later CD-Rs) passed around from hand to hand.  Tracks from beattapes were snippets of beats often recorded right after they were made so the producer could listen to them again outside of the studio setting.  They were passed amongst friends and eventually within the industry as a means of selling the producer’s beats.

Early beattapes were not meant for public consumption or as cohesive projects. It’s important to remember that at the time you didn’t finish productions in a home or project studio. Artists, labels, producers etc. would listen to a beattape and select tracks to be purchased for a project. If a beat was bought, the producer would meet the artist in a large studio with an engineer, which is where the beat went into production.  The beattape at the time was not considered a final anything, but a sketch of what could become a production.

In addition, beattapes had a secondary purpose as a measure of skill and technique.  They became a format for rehearsal and practice.  Where a traditional instrumentalist may practice chord changes on their instrument, a beat maker makes beats and records them for easy playback later.  For example, a producer could decide to sample the same record as another producer to show how they would use the sample differently.  There would be no intent to turn such a track into a full fledged song (though it could happen), instead it would be recorded so they could play it back to a friend or even the producer who originally used the sample for bragging rights.

Dilla was an active participant in this trade.  His beat CDs became his calling card particularly for the techniques displayed on them.  Donuts was his expansion of that beattape format.  Rather than a display of short rough sketches that serve as indications of productions to come, Dilla produced intricate and layered flaunts of technique compacted into short sketches.

The most recognized technique from Donuts is the chop.  The chop comes out of the stab line of techniques.  A stab is a single instrumental hit played on a sampler.  On the MPC line of samplers (which Dilla was famous for using), stabs could be spread across trigger pads pitch shifted chromatically allowing melodic sequences to be played using a single stab.  The chop takes that a step further by using multiple samples from the same source (chops) to replace the chromatic stabs, and play melodically.  What Dilla displayed on Donuts however, is not merely the chop but the variety of techniques available by which a producer can chop.  Working outside the limitations of loops and stabs, new techniques like drum and instrument isolation, de-quantization, vocal stabs and more come at you, one layered technique after the other.

Many of these techniques have been canonized today, but some quality has been lost with that normalization.  With de-quantization by example, overuse has practically rendered the technique cliché because its depth was reduced by its definition.  De-quantization translates to simply turning off the preference in software programs or hardware beat machines that align all sound triggers to the grid of the tempo and time signature.  That definition speaks nothing to what Dilla actually did with that preference off, which was impose his own humanized sense of timing onto the de-quantized patterns of the machine.

Of those that followed Dilla, most got the de-quantization part but missed his sense of time. While de-quantization has shown influence, outside of the ‘stock Dilla’ pattern, his sense of timing has been continued by only a few. At the top of that list is ?uestlove, as he is as responsible for the development of that sense of timing as Dilla is his own.  The root of that development can be found in the The Soulquarians period, which can be marked as the time both artists came into their own by working together.  That they would come together at all was quite serendipitous, as no player has a better sense of timing than a drummer.  It was the mutual sense of timing between Dilla and ?uest that worked to produce the amazing material that resulted.

In The Soulquarians studio sessions ?uest and Dilla created a feedback loop between the drum machine and the drums.  This pushed their sense of time as they fused a sonic texture for their drums, which can be heard between their productions.  There is a shuffling urgency with a tick of hats between pulses that lead one into the other; the snare or clap crisp, never aggressively cracking, the kick big but not over dominant. It is sequence-based music turned into grooves that maintain the variable constraints of the sequence.  They each took these elements with them in their post Soulquarians work, and after Dilla’s passing, you can frequently hear ?uest calling back to those days through his music.

Take a Sandwich like “Gross Understatement.”  At the onset a drum loop with a prominent clap is layered into the snare on alternate hits, while a keyboard moves through presets until an organ sound is found.  The bass noodles patiently until, with a chord, they meet.  When ?uest comes in it takes a couple of bars of him pushing the drums to get everyone else to fall in on his time, but once it hits he can’t control himself, letting out a holler, “something flew out the gate.” What follows is three minutes of magic as the band jams to a grove that is the perfect cross between Dilla and ?uest.

Gross Understatement (G minor) #Sandwich 1397

Up until November 2011, by ?uest’s count, The Roots had created almost 1800 Sandwiches.  He has released a stream of Sandwiches through his Swift FM account (the page is currently down until the site relaunches). By his own admission though, all of the Sandwiches aren’t as good as “Gross Understatement.” Out of the 2 to 23 they record each day, he says only about 1 in 19 are bangers.  At 94 out of 1800 it isn’t a bad count, enough for nine albums.  The only format in these tracks exist however, is as they appear on Late Night, on ?uest’s harddrive and whatever Sandwiches he decides to share. What would a studio project of this material sound like?  As big of an audience as they receive on Late Nite, Sandwiches are buried in the mix of television things where it’s not easy to give them the musical attention they deserve.  Perhaps in the future an official release of a project from this line will emerge.  In the meantime catch them on NBC when you can and stay tuned to ?uest’s social stream.

Primus Luta is a husband and father of two (maybe three by the time this goes up).  He is a writer and an artist exploring the intersection of technology and art, and their philosophical implications.  He is a regular guest contributor to the Create Digital Music website, and maintains his own AvantUrb site.  Luta is a regular presenter for the Rhythm Incursions Podcast series with his monthly show RIPL. As an artist he is a founding member of the live electronic music collective Concrète Sound System, which spins off into a record label for the exploratory realms of sound in 2012. Luta is currently working on completing his first book, BeatGenealogy: A History of the Electronic Beat From WWII to Now.