Archive | Digital Media RSS for this section

Technological Interventions, or Between AUMI and Afrocuban Timba

Editors’ note: As an interdisciplinary field, sound studies is unique in its scope—under its purview we find the science of acoustics, cultural representation through the auditory, and, to perhaps mis-paraphrase Donna Haraway, emergent ontologies. Not only are we able to see how sound impacts the physical world, but how that impact plays out in bodies and cultural tropes. Most importantly, we are able to imagine new ways of describing, adapting, and revising the aural into aspirant, liberatory ontologies. The essays in this series all aim to push what we know a bit, to question our own knowledges and see where we might be headed. In this series, co-edited by Airek Beauchamp and Jennifer Stoever you will find new takes on sound and embodiment, cultural expression, and what it means to hear. –AB

In November 2016, my colleague Imani Wadud and I were invited by professor Sherrie Tucker to judge a battle of the bands at the Lawrence Public Library in Kansas. The battle revolved around manipulation of one specific musical technology: the Adaptive Use Musical Instruments (AUMI). Developed by Pauline Oliveros in collaboration with Leaf Miller and released in 2007, the AUMI is a camera-based software that enables various forms of instrumentation. It was first created in work with (and through the labor of) children with physical disabilities in the Abilities First School (Poughkeepsie, New York) and designed with the intention of researching its potential as a model for social change.

AUMI Program Logo, University of Kansas

Our local AUMI initiative KU-AUMI InterArts forms part of the international research network known as the AUMI Consortium. KU-AUMI InterArts has been tasked by the Consortium to focus specifically on interdisciplinary arts and improvisation, which led to the organization’s commitment to community-building “across abilities through creativity.” As KU-AUMI InterArts member and KU professor Nicole Hodges Persley expressed in conversation:

KU-AUMI InterArts seeks to decentralize hierarchies of ability by facilitating events that reveal the limitations of able-bodiedness as a concept altogether. An approach that does not challenge the able-bodied/disabled binary could dangerously contribute to the infantilizing and marginalization of certain bodies over others. Therefore, we must remain invested in understanding that there are scales of mobility that transcend our binary renditions of embodiment and we must continue to question how it is that we account for equality across abilities in our Lawrence community.

Local and international attempts to interpret the AUMI as a technology for the development of radical, improvisational methods are by no means a departure from its creators’ motivations. In line with KU-AUMI InterArts and the AUMI Consortium, my work here is that of naming how communal, mixed-ability interactions in Lawrence have come to disrupt the otherwise ableist communication methods that dominate musical production and performance.

The AUMI is designed to be accessed by those with profound physical disabilities. The AUMI software works using a visual tracking system, represented on-screen with a tiny red dot that begins at the very center. Performers can move the dot’s placement to determine which part of their body and its movement the AUMI should translate into sound. As one moves, so does the dot, and, in effect, the selected sound is produced through the performer’s movement.

 

Could this curious technology help build radical new coalitions between researchers and disabled populations? Mara Mills’s research examines how the history of communication technology in the United States has advanced through experimentation with disabled populations that have often been positioned as an exemplary pretext for funding, but then they are unable to access the final product, and sometimes even entirely erased from the history of a product’s development in the name of universal communication and capitalist accumulation. Therefore, the AUMI’s usage beyond the disabled populations first involved in its invention always stands on dubious historical, political, and philosophical ground. Yet, there is no doubt that the AUMI’s challenge to ableist musical production and performance has unexpectedly affected and reshaped communication for performers of different abilities in the Lawrence jam sessions, which speaks to its impressive coalitional potential. Institutional (especially academic) research invested in the AUMI’s potential then ought to, as its perpetual point of departure, loop back its energies in the service of disabled populations marginalized by ableist musical production and communication.

Facilitators of the library jam sessions, including myself, deliberately avoid exoticizing the AUMI and separating its initial developers and users from its present incarnations. To market the AUMI primarily as a peculiar or fringe musical experience would unnecessarily “Other” both the technology and its users. Instead, we have emphasized the communal practices that, for us, have made the AUMI work as a radically accessible, inclusionary, and democratic social technology. We are mainly invested in how the AUMI invites us to reframe the improvisational aspects of human communication upon a technology that always disorients and reorients what is being shared, how it is being shared, and the relationships between everyone performing. Disorientations reorient when it comes to our Lawrence AUMI community, because a tradition is being co-created around the transformative potential of the AUMI’s response-rate latency and its sporadic visual mode of recognition.

In his work on the AUMI, KU alumni and sound studies scholar Pete Williams explains how the wide range of mobility typically encouraged in what he calls “standard practice” across theatre, music, and dance is challenged by the AUMI’s tendency to inspire “smaller” movements from performers. While he sees in this affective/physical shift the opportunity for able-bodied performers to encounter “…an embodied understanding of the experience of someone with limited mobility,” my work here focuses less on the software’s potential for able-bodied performers to empathize with “limited” mobility and more on the atypical forms of social interaction and communication the AUMI seems to evoke in mixed-ability settings. An attempt to frame this technology as a disability simulator not only demarcates a troubling departure from its original, intended use by children with severe physical disabilities, but also constitutes a prioritization of able-bodied curiosity that contradicts what I’ve witnessed during mixed-ability AUMI jam sessions in Lawrence.

Sure, some able-bodied performers may come to describe such an experience of simulated “limited” mobility as meaningful, but how we integrate this dynamic into our analyses of the AUMI matters, through and through. What I aim to imply in my read of this technology is that there is no “limited” mobility to experientially empathize with in the first place. If we hold the AUMI’s early history close, then the AUMI is, first and foremost, designed to facilitate musical access for performers with severe physical disabilities. Its structural schematic and even its response-rate latency and sporadic visual mode of recognition ought to be treated as enabling functions rather than limiting ones. From this position, nothing about the AUMI exists for the recreation of disability for able-bodied performers. It is only from this specific position that the collectively disorienting/reorienting modes of communication enabled by the AUMI among mixed-ability groups may be read as resisting the violent history of labor exploitation, erasure, and appropriation Mills warns us about: that is, when AUMI initiatives, no matter how benevolently universal in their reach, act fundamentally as a strategy for the efficacious and responsible unsettling of ableist binaries.

The way the AUMI latches on to unexpected parts of a performer’s body and the “discrepancies” of its body-to-sound response rate are at the core of what sets this technology apart from many other instruments, but it is not the mechanical features alone that accomplish this. Sure, we can find similar dynamics in electronics of all sorts that are “failing,” in one way or another, to respond with accuracies intended during regular use, or we can emulate similar latencies within most recording software available today. But what I contend sets the AUMI apart goes beyond its clever camera-based visual tracking system and the sheer presence of said “incoherencies” in visual recognition and response rate.

Image by Ray Mizumura-Pence at The Commons, Spooner Hall, KU, at rehearsals for “(Un)Rolling the Boulder: Improvising New Communities” performance in October 2013.

What makes the AUMI a unique improvisational instrument is the tradition currently being co-created around its mechanisms in the Lawrence area, and the way these practices disrupt the borders between able-bodied and disabled musical production, participation, and communication. The most important component of our Lawrence-area AUMI culture is how facilitators engage the instrument’s “discrepancies” as regular functions of the technology and as mechanical dynamics worthy of celebration. At every AUMI library jam session I have participated in, not once have I heard Tucker or other facilitators make announcements about a future “fix” for these functions. Rather, I have witnessed an embrace of these features as intentionally integrated aspects of the AUMI. It comes as no surprise, then, that a “Battle of the Bands” event was organized as a way of leaning even further into what makes the AUMI more than a radically accessible musical instrument––that is, its relationship to orientation.

Perhaps it was the competitive framing of the event––we offered small prizes to every participating band––or the diversity among that day’s participants, or even the numerous times some of the performers had previously used this technology, but our event evoked a deliberate and collaborative improvisational method unfold in preparation for the performances. An ensemble mentality began to congeal even before performers entered the studio space, when Tucker first encouraged performers to choose their own fellow band members and come up with a working band name. The two newly-formed bands––Jayhawk Band and The Human Pianos––took turns, laying down collaboratively premeditated improvisations with composition (and perhaps even prizes) in mind. iPad AUMIs were installed in a circle on stands, with studio monitor headphones available for each performer.

Jayhawk Band’s eponymous improvisation “Jayhawks,” which brings together stylized steel drums, synthesizers, an 80’s-sounding floor tom, and a plucked woodblock sound, exemplifies this collaborative sensory ethos, unique in the seemingly discontinuous melding of its various sections and the play between its mercurial tessellations and amalgamations:

In “Jayhawks,” the floor tom riffs are set along a rhythmic trajectory defiant of any recognizable time signature, and the player switches suddenly to a wood block/plucking instrument mid-song (00:49). The composition’s lower-pitched instrument, sounding a bit like an electronic bass clarinet, opens the piece and, starting at 00:11, repeats a melodically ascending progression also uninhibited by the temporal strictures of time signature. In fact, all the melodic layers in “Jayhawk,” demonstrate a kind of temporally “unhinged” ensemble dynamic present in most of the library jam sessions that I’ve witnessed. Yet unexpected moves and elements ultimately cohere for jam session performers, such as Jayhawk Band’s members, because certain general directions were agreed upon prior to hitting “record,” whether this entails sound bank selections or compositional structure. All that to say that collective formalities are certainly at play here, despite the song’s fluid temporal/melodic nuances suggesting otherwise.

Five months after the battle of the bands, The Human Pianos and Jayhawk Band reunited at the library for a jam session. This time, performers were given the opportunity to prepare their individual iPad setup prior to entering the studio space. These customized setup selections were then transferred to the iPads inside the studio, where the new supergroup recorded their notoriously polyrhythmic, interspecies, sax-riddled composition “Animal Parade”:

As heard throughout the fascinating and unexpected moments of “Animal Parade,” the AUMI’s sensitivity can be adjusted for even the most minimal physical exertion and its sound bank variety spans from orchestral instruments, animal sounds, synthesizers, to various percussive instruments, dynamic adjustments, and even prefabricated loops. Yet, no matter how familiar a traditionally trained (and often able-bodied) musician may be with their sound selection, the concepts of rhythmic precision and musical proficiency––as they are understood within dominant understandings of time and consistency––are thoroughly scrambled by the visual tracking system’s sporadic mode of recognition and its inherent latency. As described above, it is structurally guaranteed that the AUMI’s red dot will not remain in its original place during a performance, but instead, latch onto unexpected parts of the body.

Simultaneously, the dot-to-movement response rate is not immediate. My own involvement with “the unexpected” in communal musical production and performance moulds my interpretation of what is socially (and politically) at work in both “Jayhawks” and “Animal Parade.” While participating in AUMI jam sessions I could not help but reminisce on similar experiences with the collective management of orientations/disorientations that, while depending on quite different technological structures, produced similar effects regarding performer communication.

Being a researcher steeped in the L.A. area Salsa, Latin Jazz, and Black Gospel scenes meant that I was immediately drawn to the AUMI’s most disorienting-yet-reorienting qualities. In Timba, the form of contemporary Afrocuban music that I most closely studied back in Los Angeles, disorientations and reorientations are the most prized structural moments in any composition. For example, Issac Delgado’s ensemble 1997 performance of “No Me Mires a Los Ojos” (“Don’t Look at Me In the Eyes”)– featuring now-legendary performances by Ivan “Melon” Lewis (keyboard), Alain Pérez (bass), and Andrés Cuayo (timbales)—sonically reveals the tradition’s call to disorient and reorient performers and dancers alike through collaborative improvisations:

Video Filmed by Michael Croy.

“No Me Mires a los Ojos” is riddled with moments of improvisational coalition formed rather immediately and then resolved in a return to the song’s basic structure. For listeners disciplined by Western musical training, the piece may seem to traverse several time signatures, even though it is written entirely in 4/4 time signature. Timba accomplishes an intense, percussively demanding, melodically multifaceted set of improvisations that happen all at once, with the end goal of making people dance, nodding at the principle tradition it draws its elements from: Afrocuban Rumba. Every performer that is not a horn player or a vocalist is articulating patterns specific to their instrument, played in the form of basic rhythms expected at certain sections. These patterns and their variations evolved from similar Rumba drum and bell formats and the improvisational contributions each musician is expected to integrate into their basic pattern too comes from Rumba’s long-standing tradition of formalized improvisation. The formal and the improvisational function as single communicative practice in Timba. Performers recall format from their embodied knowledge of Rumba and other pertinent influences while disrupting, animating, and transforming pre-written compositions with constant layers of improvisation.

What ultimately interests me the most about the formal registers within the improvisational tradition that is Timba, is that these seem to function, on at least one level, as premeditated terms for communal engagement. This kind of communication enables a social set of interactions that, like Jazz, grants every performer the opportunity to improvise at will, insofar as the terms of engagement are seriously considered. As with the AUMI library jam sessions, timba’s disorientations, too, seem to reorient. What is different, though, is how the AUMI’s sound bank acts in tandem with a performer’s own embodied musical knowledge as an extension of the archive available for improvisation. In Timba, the sound bank and knowledge of form are both entirely embodied, with synthesizers being the only exception.

Timba ensembles and their interpretations of traditional and non-Cuban forms, like the AUMI and its sound bank, use reliable and predictable knowledge bases to break with dominant notions of time and its coherence, only to wrangle performers back to whatever terms of communal engagement were previously decided upon. In this sense, I read the AUMI not as a solitary instrument but as a partial orchestration of sorts, with functions that enable not only an accessible musical experience but also social arrangements that rely deeply on a more responsible management of the unexpected. While the Timba ensemble is required to collaboratively instantiate the potential for disorientations, the AUMI provides an effective and generative incorporation of said potential as a default mechanism of instrumentation itself.

Image from “How do you AUMI?” at the Lawrence Public Library

As the AUMI continues on its early trajectory as a free, downloadable software designed to be accessed by performers of mixed abilities, it behooves us to listen deeply to the lessons learned by orchestral traditions older than our own. Timba does not come without its own problems of social inequity––it is often a “boy’s club,” for one––but there is much to learn about how the traditions built around its instruments have managed to centralize the value of unexpected, multilayered, and even complexly simultaneous patterns of communication. There is also something to be said about the necessity of studying the improvisational communication patterns of musical traditions that have not yet been institutionalized or misappropriated within “first world” societies. Timba teaches us that the conga alone will not speak without the support of a community that celebrates difference, the nuances of its organization, and the call to return to difference. It teaches us, in other words, to see the constant need for difference and its reorganization as a singular practice.

The work started with the AUMI’s earliest users in Poughkeepsie, New York and that involving mixed-ability ensembles in Lawrence, Kansas today is connected through the AUMI Consortium’s commitment to a kind of research aimed at listening closely and deeply to the AUMI’s improvisational potential interdisciplinarily and undisciplinarily across various sites. A tech innovation alone will not sustain the work of disrupting the longstanding, rooted forms of ableism ever-present in dominant musical production, performance, and communication, but mixed-ability performer coalitions organized around a radical interrogation of coherence and expectation may have a fighting chance. I hope the technology team never succeeds at working out all of the “discrepancies,” as these are helping us to build traditions that frame the AUMI’s mechanical propensity towards disorientation as the raw core of its democratic potential.

Featured Image: by Ray Mizumura-Pence at The Commons, Spooner Hall, KU, at rehearsals for “(Un)Rolling the Boulder: Improvising New Communities” performance in October 2013.

Caleb Lázaro Moreno is a doctoral student in the Department of American Studies at the University of Kansas. He was born in Trujillo, Peru and grew up in the Los Angeles area. Lázaro Moreno is currently writing about methodological designs for “the unexpected,” contributing thought and praxis that redistributes agency, narrative development, and social relations within academic research. He is also a multi-instrumentalist, composer, and producer, check out his Soundcloud.

 

REWIND! . . .If you liked this post, you may also dig:

Introduction to Sound, Ability, and Emergence Forum –Airek Beauchamp

Unlearning Black Sound in Black Artistry: Examining the Quiet in Solange’s A Seat At the Table — Kimberly Williams

Experiments in Agent-based Sonic Composition — Andreas Duus Pape

“Don’t Be Self-Conchas”: Listening to Mexican Styled Phonetics in Popular Culture*

*Dedicated to the love we hear in our mothers’ accents. This post is co-authored by Sara V. Hinojos and Dolores Inés Casillas

The Cinco de Mayo season showcases troubling instances of Spanish being mocked. Corporate ‘merica profits from Drinko de Mayo when menus advertise “el happy hour”; words like “fiesta” and “amigo” are overused; and Spanish hyperanglicized for laughs (one of the worst: “COM-PREN-DAY”).  These acts of linguistic privilege, according to Jane Hill, elevate whiteness in public spaces. What is heard as playful for the dominant ear is simply an acoustic representation of the racist appropriation of mustaches, sombreros, and sarapes.

CinKO de Mayo(naise)

Fiesta like there’s no mañana

Said no Juan ever

That said, bilennials have struck back.

Last year, the Latino digital platform, we are mitú, published a list that resonated with its young, bicultural readers, those long accustomed to hearing Spanish Accented English (SAE) as part of their everyday speech: 17 Popular Brand Logos If They Looked The Way Your Parents Pronounce Them.  This humorous phonetic play in the face of complaints about foreign accents being unintelligible or moral indignation over immigrants who do not learn English with native-like proficiency re-directs our attention to digital, engaged Spanish-English bilingual communities. Like Chicana/o listening practices, these digital memes, gifs, and lists embrace how these accents invoke sounds of survival, solidarity and place making.

Con Fleis (Corn Flakes)

Gualmar (Wal-Mart)

Feisbu (Facebook)

Cosco (Costco)

 

 

The witty Buzzfeed-ish list re-spelled English-language global logos in Mexican, immigrant styled phonetics to reflect how said stores, brands, and social media sites are heard within Spanish-dominant or bilingual speaking communities. The absence of letters (Cosco) and/or the substitution of letters (Gualmar) induce an “accented” non-English dominant speech, dislodging standard rules about English-language spelling and pronunciation. Readers chuckled at seeing immigrant, ESL (English as a Second Language), phonetic speech in print – a tactic Sara V. Hinojos refers to in her media writings as a visual accent, or a visual vocabulary based on sound.

In order to “get” the humor behind the wave of memes and gifs that use Spanish Accented English (SAE), Chicana/o readers rely much more on their listening ears than their eyes to understand how these accents are voiced in print. Here, listening to accents operates as a popular form of literacy, one that registers the audible, racialized experiences of Spanish-speaking immigrants.  Of course, the use of creative, rasquache forms of humor have long been a hallmark aspect of Chicana/o humor. Yet listening to these digital literacies, especially within the contemporary “build the wall yet eat the taco” era, help make these accents legible.

Estop (Stop)

Eschool (School)

Espray (Sprite)

 

Certainly, some vocal accents are audibly more patent to select ears than others. Accents work to socially and geographically locate speakers; for instance, often racially indexing Spanish Accented English speakers as Mexican (regardless of nationality), immigrant (regardless of citizenship), and/or poor (regardless of occupation). Sociocultural linguists remind us that accents, word choice, vocal tone and other sound qualities of language are a part of a larger Bourdieu-ian rubric of linguistic capital.  Social psychologists consistently demonstrate that listeners make “moral, intellectual, and aesthetic judgments of others based on language use and accent alone.” For scholars of race and sound, accents comprise part of a sonic color line; a socially constructed aural boundary that aligns accented English speech as non-white and non-accented (or Midwestern) English as white.  Vocal neutrality, like whiteness itself, operates invisibly as privilege usually does.

Jess (Yes)

Brefas (Breakfast)

Effectively “reading” a visual accent does not privilege a bilingual speaker but rather an accented listener, one raised or surrounded by immigrant speakers. The humorous phonetic play of a visual accent symbolically challenges the capitalist logic that a “neutral accent” or non-accent in English holds immense Western value.  For those of us with accented speakers in our families and communities, accents function as emotional markers; vocal or vernacular archives that trace an individual or family’s migration, travels and/or histories.  As Denice Forham shares poetically about her Puerto Rican mother’s accent, “even when her lips can barely stress themselves around English, her accent is a stubborn compass, always pointing her towards home.” For our families, accents evince the affective labor entailed in retraining tongues, in learning new idioms, and general struggles to converse in Inglish.

(when your grandmother wants to motivate you)

Using the name of a popular Mexican sweet bread (conchas) as a substitute for “conscious” upsets Western, phonetic understandings of “scious” in favor of a phonetic, Mexican stand-in. Concha, a sea shelled shaped sweet bread, associated with female genitalia and used in digital Latino communities has become a symbol for body positive inclusion; an insistence to not feel “self conchas” when eating (see Nalgona Positivity and SOMAR ATX). These memes privilege an accented listener, a feminist sensibility, as well as a panadería connoisseur.

The mega-for-profit-English-teaching-colonial organization, known as Teaching English as a Foreign Language (TEFL), explains that the lack of distinction in the Spanish language between a short and long vowel – for instance ship/sheep  – causes miscomprehension for assumed-yet-never-named native English listeners. Those learning English as a Second Language are encouraged to first reorient their own ears to listen to the subtlety between pull/pool before grasping the complexities of yacht/jot. The communicative burden lies on the accented speaker rather than the non-accented listener. The visual accent places the onus on the English-dominant listener, effectively excluding them.

Trico Tri, Japi Jalogüín!

(Trick or Treat, Happy Halloween!)

Despite the fact that the United States represents the second largest Spanish-speaking country in the world, Spanish maintains a racialized, classed and “second-tiered” status within the United States imaginary (see Bonnie Urciuoli; Jane Hill; Jonathan Rosa; and D. Inés Casillas). These disparaging attitudes are evident when Spanish is prohibited in work places; when bilingual education and English Language Learner (ELL) programs are eliminated at ballot boxes; or when public school teachers are removed from posts based on their “heavy accents.” Institutional efforts to tame bilingual, accented tongues are less about speech and much more about accommodating the dominant, white listening ear.

According to Jennifer Stoever, the listening ear refers to dominant listening practices. Listening, she argues, is an embodied cultural practice that influences one’s position to power. “As the dominant ‘listening ear’ is disciplined to process white male ways of sounding as default—natural, normal, and desirable—alternate ways of listening and sounding are deemed aberrant and, depending upon the historical context, as excessively sensitive, strikingly deficient, or impossibly both.” Therefore the dominant listening ear not only tunes out “other” sounds but also treats them as illegitimate because they deviate from what sounds “normal” (read: white).

Cálmate Carnal, Tey Quirisi

(Relax Friend, Take it easy)

Gail Shuck found that white, native English-speaking college students construct an ideological distinction between Us and Them; gesturing to a sonic color line. Compellingly, she reported how American tourists in Mexico would describe native Spanish speakers as “heavily accented.” Yes. The communicative proficiency of Spanish by Mexicans in Mexico continued to be scrutinized by native English-language listeners.

Churro Know My Life

Cinco de Mayo has versed us too well on the visual markers of racism like oversized sombreros, felt mustaches, and cheap beer pursuits, all a part of the commercial exploitation of Mexican communities in the U.S. But then phrases such as “Grassy Ass” or “No Problem-o” are heard bitterly as recurrent reminders that our language and accents are policed with the same fervor as our bodies. The inventive use of the visual accent archives how we listen, privileging the accented ear.  The loving jest that enwraps these digital literacies reminds us to never lose our accents.

Sara Veronica Hinojos is currently a Visiting Assistant Professor and Scholar with the Center for Mexican American Studies and Jack J. Valenti School of Communication at the University of Houston (2016-2018). She received her Ph.D. from the University of California, Santa Barbara in Chicana and Chicano Studies. Her research focuses on Chicana/o and Latina/o Media, the Politics of Language, and Humor. 
.
Dolores Inés Casillas is associate professor in the Department of Chicana and Chicano Studies and a faculty affiliate of Film & Media Studies at the University of California, Santa Barbara. She writes and teaches courses on Latina/o sound practices, popular culture, and the politics of language.  Her book, Sounds of Belonging: U.S. Spanish-language Radio and Public Advocacy (2014) was published by New York University Press as part of their Critical Cultural Communication series.