Editor’s Note: Today we start off a series, a propos for World Listening Day 2016 on digital humanities and listening. As I mentioned in my Call for Abstracts in March, this forum considers the role of “listening” in the digital humanities (DH, for short). We at Sounding Out! are stoked to hear about (and listen to) all the new projects out there that archive sound, but we wonder whether the digital humanities engage enough with the the notion of listening. After all, what’s a sound without someone to listen to it? The posts this month consider: how have particular digital studies, projects, apps, and online archives addressed, challenged, expanded, played with, sharpened, questioned, and/or shifted “listening”? What happens to digital humanities when we use “listening” as a keyword rather than (or alongside) “sound”?
We will be hosting the work of DH scholars who are doing exactly that: prompting readers to consider what it means to listen in the context of DH projects. Fabiola Hanna will be reflecting upon what DH means when it talks about participatory practices. Emmanuelle Sonntag, who has written for SO! before, will be addressing listening from the starting point of the documentary Chosen (Custody of the Eyes). Today, however, we start things off with a collaborative piece from the Vibrant Lives team on the ethics of listening to 20th century sterilization victims’ records.
Don’t just stand there. Take a seat and listen.-Liana M. Silva, Managing Editor
In the 1920s a young woman was admitted by her mother to a mental institution in California. The local doctor recommended her for sterilization with the following notes:
has been reported to have interest in sexual encounters
Mother is pregnant and cannot care for her (thinks she may be able to post-sterilization).
This brief note is representative of the stories of the roughly 20,000 people who were sterilized in California institutions of mental health. The soundscape of these institutions is largely lost to the past. We cannot recover the sounds of treatment spaces, family visits, recreation, and everyday life of those in the care of the state of California who were considered feeble, insane, or otherwise out of control.
Like the conversations about illness and reproduction presumably had in those halls, the sounds of salpingectomies (removal of fallopian tubes), vasectomies (severing the vas deferens), and, later, tubal ligations are lost to us. In the absence of human rights violations, this is perhaps as it should be; we cannot collect the minutiae of everyday life. But in situations where reproductive and disability rights have been limited, where we can see race and gendered bias, we may well have need of telling such stories.
Reparative justice best practices dictate that survivors should be able to tell their own stories on their own terms. How can we listen to such stories when the majority of our survivors have died and we have little to nothing in their own words?
While conversations between patients, parents, and doctors might be lost to us in terms of playback, they have embodied traces in the nearly 20,000 people sterilized in California between 1919 and the 1950s under eugenic sterilization laws. The 19,995 sterilization recommendations and notes, brought together under the project Eugenic Rubicon: California’s Sterilization Stories, cannot currently be made publicly available due to U.S. patient privacy laws. Important documentary films like No Más Bebés, which tells the story of Mexican-American women sterilized without consent at Los Angeles County – USC Medical Center in the 1960s and 1970s, have made it possible for us to hear accounts of such reproductive injustice first hand. But for the thousands of people sterilized between 1909 and the repeal of eugenics laws in 1979, we must find other ways to listen and to hear.
Given the privacy restrictions on working with this dataset and our concerns to care for the people who are represented therein, we (the Vibrant Lives team) felt it was important to find alternative methods that did more than de-identified and quantified graphs could do. We know all too well that we can’t recover the past “as it was.” Nevertheless, we are working to bring the emotional and intellectual power of sound and critical listening to a largely unheard history of sterilization of Latinx people. Specifically, our project prompts listeners to consider how listening fits into reparative justice for the victims of sterilization.
Listening Toward under the Law
That eugenics laws and their surgical enactments played out in racialized and gendered ways is not surprising but bears repeating. For example, according to work by Alexandra Minna Stern, Nicole Novak, Natalie Lira, and Kate O’Connor, patients with Spanish or Hispanic surnames were three times as likely to be sterilized as their non-Hispanic counterparts. Those lost sounds have traces in California’s Latinx communities, both in terms of the community structures themselves, but also in terms of soundscapes that never were because of sterilization. This acoustic ecosystem in which the politics of race, gender, nation, and mental health converged in dramatic fashion is recorded only in the bodies and medical records of the patients and the 21st century communities shaped by the children, born and unborn, of these patients.
Not only are we limited to working with the textual, institutionally generated remnants of the past, we are also constrained by 21st century health and personal data privacy laws. Our archive is a set of medical records and as such this collection contains sensitive patient data that must be de-identified and used in accordance with contemporary HIPAA (Health Information Portability and Accountability Act) regulations and IRB protocols.
This means that we cannot reveal names, dates, and other identifying information regarding those who were sterilized in the first half of the 20th century. We are unable to tell individual stories of sterilization lest the individual be identified. Traditionally, historians have used fictional composites to tell such stories and our collaborator Alexandra Minna Stern used this method in her 2015 second edition of Eugenic Nation.
The HIPAA guidelines and their impact on how we tell the history of medicine raises important legal questions about how we might balance a public right to know about practices (we’d call them abuses) within state-run facilities with the need to protect patients’ rights to privacy regarding their own reproductive and mental health. In some cases, it seems as though the privacy guidelines protect the state more than they protect any individual patient. In fact, we have seen a remarkable lack of concern for these records in their discovery and transmission. The records themselves were largely abandoned when Stern discovered the microfilm reels in the 2000s. They were lost again after she returned them to the state after having made a copy. The originals are lost as far as we know.
Listening Toward the Past
Vibrant Lives is working not with sounds found, but with archival records found and then sonified (transformed into sound) as a way of listening toward those rooms, conversations, and procedures. In brief, this sonification entails the following steps
- Selecting a subset of the large data set (we can’t currently process the whole)
- Selecting between two and four axes of information, such as gender, race, age at sterilization recommendation, consent, or nationality
- Mapping the informational values into numerical space – sonification requires the creation of a dataset whose limits are 1 and -1 (based on how the speakers work)
This work has been done to date using two tools: Sonification Sandbox, an open source tool developed at the University of Georgia, and GarageBand, a proprietary music making tool that comes with Macintosh computers. We use Sonification Sandbox to create the score first and then turn to GarageBand because it has a greater range of instrumentation available. The sonification process is still very experimental and exploratory. Team member Jacqueline Wernimont does all of our sonifications for us and she is trained as a historian of literature and technology. While she has extensive experience within digital humanities methodologies, sonification is a new effort for us.
We have begun producing short sample tracks that allow us to enact the kind of listening toward that we’re advocating for. In the track below, we have data from the age, gender, and consent axes for the period 1940-1949. Additionally, this sample draws only from what we’ve described as “Spanish surname” patients, the vast majority of whom were American-born of Mexican descent, although they also include some other Latinx national communities.
Latinx Eugenics Sample Track
As you listen, each note represents one Spanish-surnamed person recommended for sterilization. The children, both boys and girls under 18, who were sterilized without consent are the highest notes, and the adult men who were sterilized with consent are the lowest.
Listening Toward as Ethical and Communal
Listening is always about an ethical relationship and it is particularly fraught when the effort to listen and to encourage others to listen entails hearing about a person’s most intimate health information and experiences. This is particularly true when those experiences may include trauma from unwanted surgery or other experiences.
While we might think of patient privacy as a form of care, in this instance we find ourselves wondering who these regulations actually serve. According to the updated 2013 HIPAA guidelines, personal health records are no longer considered sensitive information 50 years after death (it was previously 100 years). Preliminary estimates by our team indicate that as many as 1,000 survivors might be alive in 2016. However, while the vast majority of the people discussed in the records are no longer alive, family and friends may well be.
We respect the need for family members and friends to privacy when it comes to the health records of their loved ones. At the same time, an essential component of most restorative justice programs, like those undertaken for North Carolina eugenic sterilizations, is an articulation of the violations, which HIPAA blocks in many ways (North Carolina’s cases were revealed by investigative journalists who are not subject to HIPAA and the IRB regulations that we must adhere to as academics). As a consequence, those who might most benefit from reparations – sterilized individuals and their immediate families, including children – are likely to die before the privacy laws enable us to draw attention to the individual impacted by the racialized and gendered discrimination evident in the records.
The sonification of these records and the companion participatory performances that we facilitate allow us to intervene and share these important stories before all of the survivors and family members have passed away. We have the opportunity to drive justice-oriented processes forward while there is still time.
Consent/Non-consent Sample Track (entire population)
Vibrant Lives focuses not just on the stories but also on the people who listen to the audio. We spend time watching how our audiences participate in listening toward the history of eugenic sterilization in California. Below are images of recent presentations of this work in which we’ve incorporated both haptic (touch-based) and sonic performance.
Part of what we see here is the attentive posture of our participants – leaning in to feel a history of sterilization. The haptics are being shared with a thin, red metal wire that the participants have to touch lightly in order to not dampen the signal for others. For us, this is an effort to bring care for the experiences of others into the performance. The history of eugenics has impacted communities and we are creating communal aural and tactile experiences as a way to disrupt the notion that academic work and knowledge is a solitary endeavor.
The performance captured above is also an exercise in patience and as such expresses a willingness on the part of the participants to sit with a disturbing history. The sample people are listening to and feeling here is 100 seconds long with each note/vibration corresponding to one person who was sterilized. In most performances the participants stay for the duration of the piece, but there have been instances where people have touched a haptic piece and then walked quickly away. We can’t know why some have chosen to walk away.
Some of those who have stayed have shared with us that they felt responsible to feel and hear each person. It’s an abstraction, to be sure, but we are intrigued by the power of listening and feeling to encourage people to not simply look and walk away. As one participant at a Michigan performance noted, the “tingling (from the haptics) lingers, it’s spooky.” Another participant at the same performance indicated that she felt “more implicated” having engaged with a multi-media experience than with a visual like a graph or chart. When asked why, she responded “I’ve felt it and will continue to remember that, but still will likely do nothing in response.”
In creating performances where participants have to care for one another and care enough about the people represented in the data to stay through a durational piece, we are working to redress the extraordinary lack of care that the records represent, both in terms of testifying to the violence done to men’s and women’s bodies and in terms of the State of California’s lack of regard for this history.
Sounds Felt, Sounds Touched
Our work is an ongoing experiment. We’ve moved from haptics along a wire, to haptic spheres that vibrate with the sonification. The image above is from one of these events this spring. We’ve retained the communal effect while transforming the embodied structure of the event. Participants now gather around, encircling the object as they listen toward a history of reproductive injustices. People still tend to lean in – to have heads lowered in a posture of intense focus. The sphere itself demands that someone cradle it and it also requires that people touch lightly once again so as to not dampen the experience for others.
We plan to expand our durational events in our next iteration known as “Safe Harbor” in which we hope to explore how to best care for those people sterilized by the state by caring for their data. In this instance we are thinking of sounds (and more) that we’ll make together with impacted communities. For this work we are particularly interested in engaging audience members in the hosting and care of the eugenics data and, by extension, the survivors.
As a way of enacting a site-specific response to both historical and contemporary human and reproductive rights violations that have occurred in the state, we plan to stage this durational event in California. We’ll begin by inviting audiences to help build and shape an empty warehouse space with us, transforming the empty space into a place of care where we can listen toward these histories. The audience will be invited to converse about the research and reflect upon conversations through making, creating, and ultimately building up our safe harbor.
We plan to listen to and co-create with impacted communities through collective making of the space. As a result, Safe Harbor will enact a cooperative improvisational process shaping socially responsive dialogue – performing, hearing, listening, documenting, and rebuilding notions of care in real time. What we hope to discover here are shared sounds of resistance, repair, and healing. Sounds that might let us listen toward the past, while also creating more just futures.
Featured image: “Water under 12.5 Hz vibration” by Jordi Torrents, CC BY-SA 4.0, via Wikimedia Commons
Vibrant Lives is a collaborative team that makes, stages, and performs as part of interactive multimedia installations. Jessica Rajko and Eileen Standley are both professors in the Dance area of the School of Film, Theater, and Dance at Arizona State University (ASU). Jacqueline Wernimont’s home department at ASU is English and she’s a digital humanities and digital archives specialist. Wernimont and Rajko are also multimedia artists/faculty working in Arts, Media, and Engineering.
The data derives from a larger project, known as Eugenic Rubicon: California’s Sterilization Stories, a multidisciplinary collaboration among Arizona State University, University of Illinois Urbana-Champaign, and University of Michigan. This larger collaboration includes historical demography and epidemiology, public health, history of medicine, digital storytelling, data visualization, and the construction of interactive digital platforms. This team is quite large, with our center of gravity residing at the University of Michigan where historian of science Alexandra Minna Stern directs the Eugenic Rubicon lab. Stern discovered the microfilms of more than 20,000 eugenic sterilization patient records in 2013. Stern and her team have created a dataset with this unique set of patient records that includes 212 discrete variables culled from over 30,000 individual documents. This resource is the first of its kind, encompassing almost one-third of the total sterilizations performed in 32 states in the U.S. in the 20th century.
REWIND!…If you liked this post, you may also dig:
EPISODE LI: Creating New Words from Old Sounds–Marcella Ernest, Candace Gala, Leslie Harper, and Daryn McKenny
Justin Bieber caught me off guard last year. There I was, minding my own business, listening to a pop station, and this breathy little thing, this delicate vocal wrapped in a halo of shimmering effects starts piping through my car. I didn’t even realize it was him at first; it had been so long since I’d heard a new Bieber song. And I had no clue the production was from Skrillex and Diplo (from their 2015 Skrillex and Diplo Present Jack Ü), which is why I was probably also not ready for the drop, that moment when the song’s tension releases and I’m suddenly gliding across a syncopated bass synth while Bieber’s vocals are pinched into a dolphin call. Somehow, two of the most notoriously unsubtle producers and the posterboy for “too much, too soon” had snuck up on me with “Where Are Ü Now” (WAÜN).
WAÜN’s drop from nowhere isn’t brand new. Subtle soars and understated drops are officially A Thing. More importantly, they do work beyond the sonic aesthetic. In this case, I want to listen to WAÜN in the context of Bieber’s performance of gender, specifically with an ear toward the way Skrillex and Diplo mix elements from dancepop’s 2015 toolkit to produce a track that plays on feminine tropes, which articulate a kind of masculinity. Listening to WAÜN alongside Robin James’s Resilience & Melancholy (2015) amplifies the male privilege at play in WAÜN. James calls attention to the way drops can sonify feminine resilience, and WAÜN’s surprise drop toys with that resilience in a thoroughly heteromasculine way. I’ll first set up how drops usually work, then read James in the context of Bieber’s gender performance as heard in WAÜN.
Drops, at their most basic, are climactic moments when a song’s full instrumental measure hits (hence “drop”), often after some key elements of the instrumental have been removed so that the climax can sound more intense. At that broad level, any genre can employ a drop of some sort. EDM and dancepop drops—the kind that most directly inform the music of Skrillex, Diplo, and Bieber—are bass-heavy and typically follow a soar that intensifies volume, texture, rhythm, and/or pitch: you soar to a sonic plateau or a cliff, and with a “YEEEEEES!!!!!” coast on some wobbly goodness to the next verse.
The pre-chorus soar in the Messengers/Sir Nolan/Kuk Harrell-produced “All Around the World” from Bieber’s 2012 Believe is a solid example. In the video below, the soar starts at 0:45, the chorus enters at 1:00, and the drop lands at 1:15. It’s textbook: the instrumental is stripped back and filtered, and in the opening moments, we hear a descending bass glide. A filter does what its name suggests–it filters out a prescribed set of frequencies so that we only hear a certain range, and in this case it’s the low end that comes through. The effect makes the synths sound like they’re pulsating through water, and the higher frequency overtones take on a shimmery quality. Over the course of the 8-measure soar, the higher frequency range is brought into earshot, and then, on the second half of the eighth measure…nothing. This nothingness is integral to James’s central argument in Resilience & Melancholy: nothingness intensifies what follows. In these eight measures, we’ve glided down to the low end only to soar up up up until all that’s left is Bieber’s voice, confident, nasally, with just a touch of autotune as he sings the titular line that will take us to the chorus. That chorus bangs harder because of the soar to oblivion before it.
WAÜN’s drop lands at 1:09. For full context, start from the beginning and listen for the soar. (If you also need to stare dreamily into Bieber’s eyes, then by all means.)
There’s not really a soar there. No intensifying volume, texture, rhythm, pitch. The not-soar (starting at 0:48) is even a weird length, clocking in at 12 measures after an 8-measure intro and 16-measure verse have established a multiples-of-8 structural rhythm; even if we were expecting a drop, it comes four measures early. The clearest sign we get that a drop is imminent is that moment where the instrumental reduces to a quiet hiss for two measures as Bieber sings “Where are you now?” That hiss is the structural equivalent of the nothingness we hear just before “All Around the World”’s chorus, and with no traditional soar before it, we have just enough time to think “Oh shit, are they gonna….?” before we’re off, clutching tight to Justin Bieber as we ride a dolphin through the more tender parts of Skrillex’s and Diplo’s musical oceans.
Until that nothingness, this could just as easily be one of those heartfelt Bieber tunes where he reaches to the high end of his range for a chorus full of feels. That Bieber? He’s incredibly self-assured, bearing his soul because he’s certain you’ll love him. The bait-and-switch of WAÜN’s soarless drop highlights Bieber’s insecurity in this song—he’s just dolphin calls and “Where are you now”s—by creating expectations for a different persona.
So what we have here is an atypical drop, a drop that calls attention to itself by behaving differently than we expect it to, a drop that’s a study in understatement–all courtesy of three of dancepop’s resident maximalists.
Atypical soars and drops aren’t new, as producers will always toy with musical conventions as a way to disrupt expectations. Skrillex’s own “Scary Monsters and Nice Sprites” (2010) includes a pre-drop that doesn’t soar at all. In 2015, two big acts in the dance scene, Disclosure and The Chemical Brothers, released singles that don’t soar right, either. Disclosure, whose big 2013 hit “Latch” soared rather traditionally into Sam Smith’s chorus, is coyer on “Bang That” and “Jaded.” “Bang That” includes three separate 8-measure phrases (at 0:30, 0:45, and 1:01, respectively, in the linked video) that never take off, finally settling into a descending bass line (starting at 1:09) that just repeats a rhythmic motif, running out the clock on the final four measures before the chorus. “Jaded,” at the other end of the spectrum, includes only a 4-measure pre-chorus (1:18-1:27) that seems to be sweeping upward like a traditional soar, then roller coasters down and back up over the final two measures. The instability of this soar/not-soar is punctuated with an additional eighth note tacked onto the end of the fourth measure, throwing the chorus off-kilter. The Chemical Brothers employ a similar roller coaster sweep in “Sometimes I Feel So Deserted” that marks out an even eight measures (0:58-1:13) without either intensifying rhythmically or pushing to a pitch ceiling at the drop.
These soars and drops stand out precisely because, like WAÜN’s, they aren’t the norm. To help theorize WAÜN’s not-soar, I want to think with Robin James, whose Resilience & Melancholy hears soars and drops in the context of contemporary race and gender politics. James situates soars and drops as the sonic equivalent of resilience–a performance of feminine overcoming that ultimately only strengthens the white supremacist capitalist patriarchy that inflicts the damage that is being surmounted. In other words, women can only attempt to overcome through the damage that white supremacist capitalist patriarchy inflicts upon them. Sonically, the soar is an accrual of damage that is spectacularly (and profitably) overcome in the drop, the music that resiliently endures on the other side of nothingness. Melancholy, on the other hand, is failed resilience, a handling of damage that does not directly profit white supremacist patriarchy and that could sound any number of ways, including like a non-traditional soar. While admittedly these soars and drops aren’t always about gender politics, R&M opens space for us to think about gender and soars/drops together.
I don’t think WAÜN’s non-soar/drop is resilient or melancholic, but I do think it’s helpful to think of it as being about resilience and melancholy. This is where Bieber’s performance of masculinity comes into play. From his earliest poofy-headed, babyfaced performances, Biebs has done a modified bro thing: his heart’s on his sleeve, but mostly as a strategy for sexual conquest. “All Around the World,” again, is exemplary. In the lyrics, Bieber uses his worldly experiences to woo a potential lover, who he also negs, keeping himself in a position of power as someone who knows more, has seen more, and is willing to accept this woman despite her obvious flaws.
In WAÜN, though, I hear his performance of masculinity complicated further, as he tries out a number of more feminized tropes all at once. Lyrically, Bieber is the scorned lover who claims to have done all the care work in his relationship. Visually, he’s the pop icon whose body is ogled, scrutinized, and marked. Vocally, he receives the pitch-shift treatment that has most recently been associated with DJ Snake’s production of diva vocals (think “You Know You Like It” and “Lean On”). He also sings in a breathy style that James has elsewhere noted mimics Ellie Goulding’s vocals. Musically, Skrillex and Diplo give him the soar/drop construction to undergird his pain, a musical technique that most often signifies feminine resilience.
What bubbles up is a heteromasculine play on resilience and melancholy. Skrillex and Diplo liquidate the soar until all that’s left is a nothing-hiss before the drop. In the context of the other feminized tropes Bieber is messing with in WAÜN, this failed soar could feel melancholic, a refusal to spectacularly overcome. Overcome what, though? Bieber gets to sound resilient or melancholic without ever experiencing damage. That’s his male privilege. James points out that one of the most violent outcomes of resilience discourse is the re-enforcement of damage. If resilience is the way women become legible and profitable, then the damage inflicted by ablist white cisheteropatriarchy becomes a necessity, something that must be endured to gain access to power and resources. This is the lynchpin of James’s critique: resilience is a harmful discourse because it ultimately benefits the system it purports to overcome. Melancholy turns resilience logic on its head by refusing to treat damage as something an individual is responsible for overcoming. WAÜN, though, erases damage altogether in its initial drop. WAÜN’s feminized tropes ultimately highlight instead of unsettle Bieber’s performance of hetero-masculinity: what’s more man-ly than accessing power and resources without the threat of institutional violence?
Importantly, these feminized tropes don’t undermine Bieber’s heteromasculine performance; rather, they only seem to add nuance to the slightly bro-ier [that’s a word] Bieber performance we’ve become accustomed to. That’s what I mean when I say WAÜN is about resilience and melancholy; Skrillex and Diplo use the markers of queer or feminine overcoming and failed overcoming to re-construct Bieber’s masculinity, to toss some more ingredients into his manly mix, and the not-soar is a big component of that. Skrillex and Diplo tap into this soar experimentation, then drop it into the middle of a slightly more gender-fluid Bieber.
WAÜN’s high water mark is a few months behind us at this point, but Bieber remains hotter than ever, with “What Do You Mean?,” “Sorry” (another Skrillex production credit), and “Love Yourself” still dominating US and UK charts. Several more singles from Purpose (including two more Skrillex collaborations) are poised to do the same in 2016. Each of these singles extends some of the same tropes Bieber, Skrillex, and Diplo explore in WAÜN—breathy vocals, misunderstood and mistreated pop icon, resilience and contrition and care in the face of a failed relationship—and I hear WAÜN’s initial drop as the sonic moment that preps Bieber’s return to the pop charts. He wades back into the mainstream with a more complex performance of heteromasculinity and reaps the profits that come with it.
Justin D Burton is Assistant Professor of Music at Rider University, and a regular writer at Sounding Out!. His research revolves around critical race and gender theory in hip hop and pop, and his current book project is called Posthuman Pop. He is co-editor with Ali Colleen Neff of the Journal of Popular Music Studies 27:4, “Sounding Global Southernness,” and with Jason Lee Oakes of the Oxford Handbook of Hip Hop Music Studies (2017). You can catch him at justindburton.com and on Twitter @justindburton. His favorite rapper is Right Said Fred.
REWIND!…If you liked this post, you may also dig: