Machinic Ballads: Alan Lomax’s Global Jukebox and the Categorization of Sound Culture
Today, SO! continues its series reconsidering the life and work of Alan Lomax in his centenary year, edited by Tanya Clement of The University of Texas at Austin. We started out with Mark Davidson‘s reflections on what it means to raise questions about the politics behind Lomax’s efforts to record and collect folk music, and continued a few weeks later with Parker Fishel‘s consideration of Lomax’s famous “Southern Journey” and how it has been appropriated by musicians more recently.
With Clement’s own article below, the series begins to rethink Lomax as a touchstone in current and continuing drives to collect, measure and compute sonic cultures, something that seems hot all of a sudden (see, for instance, coverage of recent digital analysis of trends in pop music at Queen Mary University of London). In her thoughtful, illuminating and inspiring article below, Clement challenges us to consider the politics behind these efforts to search, retrieve and analyze audio, something that the case of Lomax throws into stark relief.
— Special Editor Neil Verma
—
When the Association for Cultural Equity, an organization that Alan Lomax founded in 1983, announced the release of 17,000 music tracks from Lomax’s fieldwork collections, the New York Times heralded the release as a manifestation of Lomax’s Global Jukebox project, a computational experiment for accessing and studying his vast multimedia collection of the world’s culture. The Times piece likens Lomax’s project to Pandora, which allows the listener to search for music “like” music she has already found. Lomax’s biographer, John Szwed, also makes this comparison but modifies his description by proclaiming that unlike Pandora’s recommendations which are “based on personal taste” and “tend to lead sideways . . . to production style,” Lomax’s Global Jukebox idea held the potential to point a listener to “deeper principles of cultural and musical organization” (The Man Who Recorded the World 391).
Gobsmacked by whizbang possibilities, neither the Times nor Szwed discuss the deeper principles behind Lomax’s attempt to represent culture as a global search engine. In the context of the powerful work being accomplished in the Music Information Retrieval (MIR) community and my own project (HiPSTAS) to develop software for making sound collections searchable and accessible, In this article I will argue that how we build systems for searching and retrieving and browsing cultural artifacts as data is a profoundly political act. Recognizing such politics suggests that Lomax’s Global Jukebox project serves as a cautionary tale for how social and cultural contexts — or what Donna Haraway calls our “ways of being” — are reflected in the systems we develop.
John A. Lomax Collection in UT Folklore Center Archives, Small Multiples. Instrumental sections are in red, spoken sections are in green, and sung sections are in blue. Click to see a full-size version.
The Singer with the Song
The year that Alan Lomax was born (1915), his father John Alan Lomax published a landmark piece heralding seven new types of American ballads for study. American ballads, he argues “reveal the mode of thinking, the character of life, and the point of view, of the vigorous, red-blooded, restless Americans, who could no more live life contented shut in by four walls than could Beowulf and his clan, who sailed the seas around the coasts of Norway and Sweden” (“Some Types of American Folk-Song”, 3). Unlike any other collection of ballads, John’s “American ballad” included the ballads of the miner, the lumbermen, the inland sailor, the soldier, the railroader, “the ballads of the negro; and the ballads of the cowboy . . . [and] the songs of the down-and-out classes, — the outcast girl, the dope fiend, the convict, the jail-bird, and the tramp” (3). Governed by a laudable goal to record the songs of folk cultures at the fringes of mainstream society, the senior Lomax’s view of the communities where he would collect his songs (including jails and state farms), was complex, and can fairly be called both progressive as well as racist (Porterfield 170).
John and Alan went on seven collecting trips together between 1934 and 1936 and co-authored five books on their return. On these trips, they collected songs from people on the street in cities like New Orleans and people in the country, from both church-goers and prisoners. While John held romanticized views of the “noble” southern black man, Alan, on the other hand, indicated a more nuanced understanding of the complexities inherent to his father’s attempt to generalize patterns of “folk” for study. Alan linked “the singer with the song” and was interested in the politics behind prisoners made to sing with guns at their backs and in the cultural lives of people that were so poor in means but so rich in “beautiful harmony, with enormous volume, with total affection” (Szwed 49). While Alan maintained that he was interested in the individual’s story, John believed that “a genuine ballad has no one author. It is therefore the expression of no one mind: it is the product of the folk . . . It might have been written by any one” (“Some Types of American Folk-Song”, 1).
John A. Lomax Collection in UT Folklore Center Archives, Small Multiples. Instrumental sections are in red, spoken sections are in green, and sung sections are in blue. Click to see a full-size version.
Taxonomies
The Global Jukebox project demonstrates an almost complete reversal in Alan’s concerns. The studies behind the Global Jukebox include Alan’s Cantometrics and Choreometrics, in which he produces taxonomies for studying song and dance and his Parlametrics project, an “experiment in metalinguistics,” which Alan and his collaborators describe as a taxonomy of “patterns of style” in speech based on dynamic changes in pitch, loudness, speed, spacing, rhythm, and timbre (“A stylistic analysis of speaking”). These taxonomies show that Alan’s early consideration for the individual performer gave way to a desire to make folk study more scientific as a cultural mapping like what his father espoused rather than what Szwed and others have seen as Alan’s concerns with the situated politics of individuals.
Alan’s Parlametric study serves as good example. Approaching delegates from the United Nations and soliciting mail-in samples from regions not covered by the U.N. volunteers, Alan and his team collected representative recordings of 114 languages. Then, in order to study the “generally neglected meta-communicational level” in these recordings, the team designed a rating system including 50 codes that (1) “described the distinctive features of each recording,” and (2) “tended to cluster the recordings into sets of similars” that Alan maintains anyone could “readily use” to record “salient differences in conversation style” (19). These clusters pointed to 14 factors that Alan and his team would use to categorize the cultures from which they received samples:
- Repetitiveness
- Timing
- Speech length
- Upglides
- Descending cadence
- Syllabification
- Drawl
- Empathy
- Space
- Dominance/Sharing
- Relaxed/Tense
- Noise
- Breathy
- Forceful
Using these factors, Alan makes some broad assertions. The association of clear syllabification” (the degree to which syllables run together) “is most strongly predicted among gardeners with domesticated animals” and “[t]he association of clear syllabification to feminine autonomy is suggested by the discovery that this mode of speaking predicts and is predicted by permissive rather than restrictive premarital sexual mores” (27). Further, “Dominance vs. Sharing of conversation space” is strongly correlated with settlement size and severity of sexual sanctions,” a statement that Alan immediately rationalizes by noting that “this relation between a more crowded social space, high sexual tension and increased rate of interaction seems to make good sense, even if it does not account for every possibility” (31).
These spurious and broad generalizations were what Lomax hoped to facilitate for all with his Global Jukebox as the access point for “the first numerical models of the full range of global cultural variation in holistic form” for “the scientist, the layman, and the student to explore, experience, and manipulate the broad universe of culture and creativity in a systematic fashion, with audio-visual illustrations at every turn of the road” (“The Global Jukebox,” 318). By leveraging his taxonomies of song, dance, and speech in the computer age, Alan could suddenly associate and differentiate cultures holistically and en masse.
A visualization of a song in ARLO. Click to see a full-size version.
Machinic Methods / Humanistic Questions
As someone who works in the liminal spaces between the humanities and technology, between cultural studies and critique and the machines that increasingly function both as access points and barriers to our cultural artifacts, I see Alan’s switch to generalizable taxonomies as par for the course in the digital age. My own >HiPSTAS project’s primary objective is to develop a virtual research environment in which users can better access and analyze spoken word collections of interest to humanists. We understand that in order for us to search digital sound artifacts, we have to create taxonomies, metadata, keywords and other generalizable frameworks that facilitate discovery.
At the same time that we are using machinic methods, however, we can still ask humanistic questions that open up rather than close down debates and dialogues. In a recent test for the HiPSTAS project, for example, we used machine learning to analyze the recordings in the UT Folklore Center Archives, which comprises 219 hours of field recordings collected by John and Alan Lomax, Américo Paredes, and Owen Wilson, among others (UT Folklore Center Archives, ca. 1928-1981, Dolph Briscoe Center for American History, University of Texas at Austin, Box 2.325/R). In our attempt to predict the presence of different sonic patterns including instrumental music, singing, and speech, the results of our analysis are noteworthy as the visualization shown in this brief movie demonstrates.
from Tanya Clement on Vimeo
Within the results, we see a visualization of how many seconds comprise each file (in blue) and how many of those seconds for each file our software has predicted the presence of instruments (green), speech (red), and song (purple). A subtle yet striking difference emerges in the comparison between the Lomax recordings (created 1926-1941), which are the oldest in the collection, and the others, which were created up until 1968. The Lomax recordings (primarily created by John Lomax) consistently contain the least amount of speech in comparison to what the other files contain.
Of course, there are a number of ways you can read these results. Given the conversation above, one could hypothesize that perhaps the Lomaxes were primarily interested in their participants’ songs rather than their stories. One could also think about it in terms of recording capabilities across time. When the Lomaxes were first recording, John Lomax writes, “The amplifier weighed more than one hundred pounds; the turntable case weighed another one hundred; two Edison batteries weighed seventy-five pounds each. The microphone, cable, the tools, etc., accounted for sufficient weight to make the total five hundred pounds. . . . In order to carry them in the car I tore out the back seat . . .” Even in 1967, forty years later, good recorders still weighed 70 pounds and required a car battery, but tapes were longer and costs were less. More tape and more time at less cost both financially and physically had a big impact on what researchers recorded. At the same time, the data shows that the later recordings are not much longer, but do seem to have more seconds of speech.
There is a danger in these kinds of machine-generated generalities. We employed taxonomies (instrumental, sung, speech) to teach the machine to categorize these patterns, but why these patterns? Are there others? Or did I choose these based on what I already wanted to say about the Lomaxes’ practices? And, I haven’t even mentioned here the subjective practices inherent to choosing algorithms for such work.
These kinds of questions require more research, and more contextualization than this aggregated data set can show. Just as the ballads that John and Alan Lomax once collected were written and sung by someone, so were the communities that Alan interpreted through his Parlametrics made up of individuals, not types. Perhaps Alan’s desire “to record the world” was just and Google, the collector, categorizer, and interface for all things on the Internet, isn’t evil. But the Global Jukebox Project serves as a cautionary tale about the politics behind the speed and efficiency that machinic methods seem to promise, a politics that needs to be far less opaque about its deeper principles and problems.
—
Tanya Clement is an Assistant Professor in the School of Information at the University of Texas at Austin. She has a PhD in English Literature and Language and an MFA in fiction. Her primary area of research is scholarly information infrastructure. She has published widely on digital humanities and digital literacies as well as scholarly editing, modernist literature, and sound studies. Her current research projects include High Performance Sound Technologies in Access and Scholarship (HiPSTAS).
—
Featured image: “Day 21 – Waveform” by Flickr user evil_mel, CC BY-NC 2.0
—
REWIND! . . .If you liked this post, you may also dig:
Revising the Future of Music Technology — Aaron Trammell
SO! Amplifies: Carleton Gholz and the Detroit Sound Conservancy — Carleton Gholz
Sounds of Science: The Mystique of Sonification — Margaret Anne Schedel
Share this:
Workshopping the Derry Soundscape: Mobile technologies as Creative Tools for Third Age Adults
This April forum, Acts of Sonic Intervention, explores what we over here at Sounding Out! are calling “Sound Studies 2.0”–the movement of the field beyond the initial excitement for and indexing of sound toward new applications and challenges to the status quo.
Two years ago at the first meeting of the European Sound Studies Association, I was inspired by the work of scholar and sound artist Linda O’Keeffe and her compelling application of the theories and methodologies of sound studies to immediate community issues. In what would later become a post for SO!, “(Sound)Walking Through Smithfield Square in Dublin,” O’Keeffe discussed her Smithfield Square project and how she taught local Dublin high school students field recording methodologies and then tasked them with documenting how they heard the space of the recently “refurbished” square and the displacement of their lives within it. For me, O’Keeffe’s ideas were electrifying, and I worked to enact a public praxis of my own via ReSounding Binghamton and the Binghamton Historical Soundwalk Project. Both are still in their initial stages; the work has been fascinating and rewarding, but arduous, slow, and uncharted. Acts of Sonic Intervention stems from my own hunger to hear more from scholars, artists, theorists, and/or practicioners to guide my efforts and to inspire others to take up this challenge. Given the exciting knowledge that the field has produced regarding sound and power (a good amount of it published here), can sound studies actually be a site for civic intervention, disruption, and resistance?
Acts of Sonic Intervention began with “Listening to and Through Need” by Assistant Director at Binghamton University’s Center for Civic Engagement, Christie Zwahlen, who argues that any act of intervention must necessarily begin with self-reflexivity and examination of how one listens. Last week, artist/scholar Luz María Sánchez gives us the privilege of a behind-the-scenes discussion of her latest work, detritus.2/ V.F(i)n_1–1st prize winner at the 2015 Biennial of the Frontiers in Matamoros, Mexico —which uses found recordings and images to break the deleterious silence created by narco violence in Mexico. Next week, we will close with from artist, theorist, and writer Salomé Voegelin, who will treat us to a multimedia re-sonification of the keynote she gave at 2014’s Invisible Places, Sounding Cities conference in Viseu, Portugal, “Sound Art as Public Art,” which revivified the idea of the “civic” as a social responsibility enacted through sound and listening. Today, Linda O’Keeffe catches us up with her newest public project, a pilot workshop with older people at the U3A (University of the Third Age) centre in Foyle, Derry, “grounded in an examination of the digital divide, social inclusion and the formation of artists collectives.”
–JS, Editor-in-Chief
—
In 2014, the Irish Research Council funded a project that looked to increase the access of older people to creative opportunities while at the same time generating interest in research examining the social implications of sound, music, and performance produced by older people. The project ran over a 9-month period and included a two-week workshop with a group of third age adults based in Derry, Northern Ireland. This fulltime workshop consisted of training three people aged between 65-70 in the area of gesture based audio technologies on iOS devices.
My initial impetus behind the project was to find different ways to engage older adults with technologies outside of the typical education programs which focus on internet training and learning how to use communication applications like email and VOIP software. I designed the workshop to introduce the participants to a range of audio-based applications designed specifically for an iPad. They learned how to use digital audio recorders, including the different file types associated with sound quality, such as compressed audio mp3 and mostly uncompressed audio WAV (windows audio video format). For clarity, I organized the audio applications into three distinct types: audio editing apps, gesture based performance apps and sound synthesis apps.
Participants working with Auria and Dropbox // Photo by author
Learning sound production, I felt, would offer elder people a different kind of value than basic workplace digital skills, something perhaps even more important for third age adults, what Fisher and Specht describe as a “positive sense of future” in “Successful Aging And Creativity In Later Life” (459). Training in digital activities such as multi-track editing, performance and synthesis applications, the use of digital audio recorders, soundscape recording, using cloud based applications for sound sharing, and mastering finished works of sound offered more than just a “skill” for workshop participants, it also held out a new sense of purpose, a means to continue engaging with community, continued intellectual stimulation, and the possibility of a new period of productivity in their lives.
Work Shopping Sound
One of the key components to the workshop involved talking about sound and sound art, and discussing the kinds of art made from sound, including work made for radio. Such conversation presented difficulties for people who were largely unfamiliar with fine art, a problem compounded by the fact that, as an emerging art form, sound is not always visible in mainstream cultural spaces.
To ease the transition, I centered our early discussions on important sounds in the participants’ lives: sounds remembered and now lost, the difference between rural and urban soundscapes, and unique perhaps for this particular group, the sounds of civil war. All of the participants had lived in Derry most of their lives and experienced some aspect of the violence within Northern Ireland; through our conversations, sound became an interesting way to memorialize and process this event. We then discussed how these soundscapes could be documented, changed and presented as works of art. Later, workshop conversation consisted of listening to sound art pieces. This helped the group get a sense of the potential of sound as an expressive art form.
Sound as Process
During the workshop, I emphasized the process and practice of sound making over the technology required to undertake the production of their art works. In this way, by focusing on an artistic concept, the technology just became the means in which they could be creative. Each participant was given a digital audio recorder (Zoom), which they brought home to record sounds they found interesting. Every meeting, the group discussed how–through the act of recording and listening–their perception of familiar sounds was being altered. They began also to experiment when recording, using their voices – singing – reading poetry etc. in different spaces, getting close up to sounds – exhaust pipes in cars, for example—and placing the microphone in unusual places such as a neighbours pig shed. Gradually, participants began to think of the sounds they collected as being part of a larger project and they became much more selective about what they would record. In addition, the group began to critique the sounds they recorded as well as sharing their sounds using Dropbox folders. These recordings became the basis for their final works; even if their sounds were eventually altered beyond recognition, the sounds inspired their artistic concepts.
The first Saturday of the two-week workshop included a soundscape recording day in Derry city. Each participant was asked to walk the city, recording sounds they found interesting. What emerged during the sound walks was unexpected. Members of the group began to engage with spaces and people, interviewing some, asking others to make sounds. For example, two participants went into a music store and asked the staff to sing or play an instrument so that they could record these sounds. They also went to the main cathedral in Derry and had the bells rung especially for them and a trainee organist play some traditional organ music. One participant, a poet, had different people read lines from a selection of his poems. He stated later that he was hoping to collect the sounds of women, children and men, as well as the multiple accents of Derry people, because his poetry was about Derry and therefore Derry should be its voice. I had not anticipated this engagement with community and space when I designed the workshop.
Participants recording water feature, Photo by author
During the focus group discussion after the sound walk, each participant talked primarily about how the recorder allowed them access to sounds and people. The technology acted as an interface between them and a sound that they wanted; it gave them the confidence to approach strangers, because they felt they were working on something important.
Gesture Based Performance Applications
Still from Auria, a gesture based performance app
In addition to conversation and artistic process, the first week of the workshop introduced participants to three applications: Auria audio editor, TC11 gesture based performance app and Animoog (a music synth app designed for iPad). A number of papers argue that it is the complexity of software applications, including the internet, which proves difficult to older users. Overlapping and contrasting colours are defined as difficult to engage with and can be distracting to users whose vision is in any way impaired through ageing. The Auria editor is as complex visually as most computer DAW’s, with one key difference: all interactions are gestural. This simple difference meant that each of the users found engaging with the application less difficult than if they had to deal with a mouse, keyboard, shortcuts and OS’s (see figure). 
None of the participants felt that the screen and its multiple windows were so difficult that they could not engage. In fact, we had initially worked with a much simpler audio editing app, Hokusai, which they felt was too simple in its design and usability. By the end of the two-week workshop, the participants had produced at least one complete work of sound, with some creating up to 4. Selected works were compiled in a CD that was launched in November 2014 at the U3A in Derry. Listen to a sampling below.
.
Track Two: “Made in Belfast” by Sam Burnside, read by John Dunlop
Track Four: “The Haunted Valley,” by Florence Forbes
.
In a final focus group discussion, the participants all responded very positively to the experience while offering suggestions about future workshops. Most agreed that the digital audio recorders allowed them to open their ears to the possibility of working with sound, but from an ethnographic perspective. The recorders allowed the participants engage actively with people and spaces in a way that had not been anticipated, empowering them with a sense of purpose, and allowed them give voice to both their creative ideas and the voices and soundscapes of Derry. In addition, the iPADs and audio recorders allowed them a sense of technological and creative mobility; they could access sounds on the move, place and share them in the cloud, perform/compose and edit in different spaces.
Participants working with their iPads, Photo by the author
Working on this project altered a number of preconceptions I had inadvertently brought with me about older peoples’ capabilities, even though my proposed project challenged other assumptions about aging. For example, I chose some of the audio applications for their simple design, mostly because previous research had highlighted older adults’ limitations in regards to the digital, based on principles of design, where technology is often shaped for a younger, often male, user. The participants in this workshop proved they could learn and even be creative with complicated applications such for synthesis and sophisticated editing. Even though I have written about older peoples use of audio technologies dating back to the 1940s–and how they developed sophisticated hacked mechanisms in order to broaden their sound/media sphere (O’Keeffe 2015)–I failed to consider that my participants would also have a contemporary relationship to mobile technologies. Yet all three participants, in varying degrees, used some form of mobile technology, from tablets to android phones. But what was evidenced through our conversations was the limited way in which they used their tech. After the workshop, most talked about buying and using audio applications or recording technology for creative or documentary use.
The author, recording sounds in the workshop
Prior to the workshop, I myself rarely used iPad audio apps; for me, it required thinking differently about mobility and sound design, and it was only on seeing the very creative ways in which the participants used the iPad that I started to rethink how IOS apps could support my sound practice. Following from this project, I am now in the process of developing a performance collective with third age adults. We will examine ways in which sounds can be assigned meaning and then used in a performance setting. The project will take about a year to complete and the hope is that, when finished, the performance collective will continue, with a tool kit to sustain their practice.
—
Featured Image: “Workshop participant interviewing poetry readers,” photo by Author
—
Linda O Keeffe isis a lecturer in sound at Lancaster Institute of Contemporary Art. She is also secretary to the Irish Sound Science and Technology Association and editor of the Interference Journal. She has several papers and book chapters published and due for release in the fields of sound studies. Her practice is concerned with an exploration, both academic and creative, of the ways in which sound alters our experience of different spaces. Her art training was within the sculpture department of IADT under the tutelage of Finola Jones. She completed a Masters in Virtual Reality in NCAD with Kevin Atherton, and just finished a PhD in sociology in NUIM. Her research examined the urban of Dublin city soundscape as socially and technologically co-constructed. She has composed for dance, theatre, quartets, and new instrument performers, installed sound installations for commissions in Ireland, China and Holland, and has had radio works performed both nationally and internationally. In 2008 she was mentored under Eric Leonardson in Chicago, a sound artist and performer. More recently, she was commissioned by Resonance FM to create a work for radio for the 2013 Derry city of culture event. In November 2014 Linda had a solo exhibition called “Spaces of Sound and Radio Spaces” for the Limerick Sculpture Centre, a creative realization of her PhD research.She will be releasing an album next year with the composer Tony Doyle on spatialisation and sonified memories with Farpoint Recordings, her third album. You can find her at www.lindaokeeffe.com.
—
REWIND! . . .If you liked this post, you may also dig:
Of Sound Machines and Recording, Sharing that Transcends Time and Space–Maile Colbert
Audio Culture Studies: Scaffolding a Sequence of Assignments–Jentery Seyers
“We wanted to tell stories about sound”: Opening Ears Through the “Everything Sounds” Podcast–Craig Shank and George Drake Jr.
Share this:
Current Top Posts
April 2021
January 2020
November 2019
October 2019
August 2019
April 2014
November 2017
March 2015
December 2017
October 2015
Sounding Out! 
Recent Comments