“A focus on listening [with technology] shifts the idea of freedom of speech from having a platform of expression to having the possibility of communication” (K. Lacey)
One of the biggest social media event of the past decade, #metoo stands out as a pivotal shift in the future of gender relations. Despite its persistence since October 2017, #metoo is still under-theorized, and since its permutations generate countless hashtag sub-categories each passing week, making sense of it presents a conceptual quagmire. Tracing its history, identifying key moments, mapping its pro- and counter-currents present equally tough challenges to both data science and feminist scholars.
Meta-communication about #metoo abounds. Infographics and visualizations attempt to contain its organic growth into perceivable maps and charts; pop news media constantly report on its evolution in likes, counts, and retweets, as well as—and increasingly—in number of convictions, lawsuits, and reports. At the same time, #metoo has arguably created a discernible listening public in the way that Kate Lacey (2013) argues emerged with national radio: women’s stories have never been listened to with such wide reach and rapt attention.
The project I discuss here takes ‘hearing’ #metoo a step further into the auditory realm in the form of data sonification so as to to re-imagine an audience compelled to earwitness not just the scope but the emotional impact of women’s stories. Data sonification is a growing field, which from its inception has crossed between art and science. It involves a conceptual or semantic translation of data into relevant sonic parameters in a way that utilizes perceptual gestalts to convey information through sound.
Brady Marks and I created the #metoo sonification you’ll hear below by drawing from a public dataset spanning October 2017 to the early Spring of 2018 obtained from data.world. Individual tweets using the hashtag are sonified using female battle cries from video games; the number of retweets and followers forms a sort of swelling and contracting background vocal texture to represent the reach of each message. The dataset is then sped up anywhere between 10x to 1000x in order to represent perceivable ebbs and flows of the hashtag’s life over time. The deliberate aim in this design was to convey a different sensibility of social media content, one that demands emotional and intellectual attention over a duration of time. Given Twitter’s visual zeitgeist whereby individual tweets are perceived at a glance and quickly become lost in the noise of the platform the affective attitude towards “contagious” events becomes arguably impersonal. A sonification such as this asks the listener to spend 30 minutes listening to 1 month of #metoo: something impossible to achieve on the actual platform, or in a single visualization. The aim, then, is to interrupt social media’s habitual and disposable engagements with pressing civic debates.
A critique of big data visualization
To date, there have been more than 19 million #MeToo tweets from over 85 countries; on Facebook more than 24 million people participated in the conversation by posting, reacting, and commenting over 77 million times since October 15, 2017. In a global information society ‘big data’ is translated into creative infographics in order to simultaneously educate an overwhelmed public and elicit urgency and accord for political action. Yet ideological and political considerations around the design of visual information have lagged behind enthusiasm for making data ‘easy to understand’. At the other end of the spectrum, social media delivers personalized micro-trends directly and in real time to always-mobile users, reinforcing their information silos (Rambukkana 2015). Between these extremes, the mechanisms by which relevant local, marginalized or emergent issues come to be communicated to the wider public are constrained.
With this big idea in mind, the question we ask here is what would it mean to hear data? Emergent work in sonification suggests that sound may afford a unique way to experience large-scale data suitable for raising public awareness of important current issues (Winters & Weinberg 2015). The uptake of sonification by the artistic community (see Rory Viner, Robert Alexander, among many others) signals its strengths in producing affective associations to data for non-specialized audiences, despite its shortcomings as a scientific analysis tool (Supper, 2018). Some of the more esoteric uses of sonification have been in the service of capturing what Supper calls ‘the sublime’ – as in Margaret Schedel’s “Sounds of Science: The Mystique of Sonification.”
Who’s listening on social media?
Within the Western canon of sound studies “constitutive technicities” (Gallope 2011) or what Sterne calls “perceptual technics” embody historically situated ways of listening that center technology as a co-defining factor in our relationship with sound. Within this frame, media sociologist Kate Lacey traces the emergence of the modern listening public through the history of radio. Using the metaphor of ‘listening in” and “listening out,” Lacey reframes media citizenship by pointing out that listening is a cultural as well as a perceptual act with defined political dimensions:
Listening out is the practice of being open to the multiplicity of texts and voices and thinking of texts in the context of and in relation to a difference and how they resonate across time and in different spaces. But at the same time, it is the practice and experience of living in a media age that produces and heightens the requirement, the context, the responsibilities and the possibilities of listening out (198)
According to Lacey, a focus on listening instead of spectatorship challenges the implicit active/passive dualism of civic participation in Western contexts. More importantly, she argues, we need to move away from the notion of “giving voice” and instead create meaningful possibilities to listen, in a political sense. Data sonification doesn’t so much ‘give voice to the voiceless’ but creates a novel relationship to perceiving larger patterns and movements.
Our interactions with media, therefore, are always already presumptive of particular dialogical relations. Every speech act, every message implies a listening audience that will resonate understanding. In other words, how are we already listening in to #metoo? How and why might data sonification enable us to “listen out” for it instead? In order to get a different hearing, what should #metoo sound like?
Sonifying #metoo: the battle cries of gender-based violence
It is unrealistic to expect that your everyday person will read large archives of testimony on sexual harassment and gender-based violence. Because of their massive scale, archives of #metoo testimony pose a significant challenge to the possibility for meaningful communication around this issue. Essentially drowning each other out, individual voices remain unheard in the zeitgeist of media platforms that automates quantification while speeding up engagement with individual contributions. To reaffirm the importance of voice would mean to reaffirm inter-subjectivity and to recognize polyphony as an “existential position of humanity” (Ihde 2007, 178). This was the problem to sonify here: how to retain individual voices while creating the possibility for listening to the whole issue at hand. Inspired by the idea of listening out, myself and artist collaborator Brady Marks set out to sonify #metoo as a way of eliciting the possibility for a new listening public.
The #metoo sonification project intersected deeply with my work on the female voice in videogames. My choice to use a mixed selection of battle cry samples from Soul Calibur, an arcade fighting game, was intuitive. Battle cries are pre-recorded banks of combat sounds that video game characters perform in the course of the story. Instances of #metoo on Twitter presumably represent the experiences of individual women, pumping a virtual fist in the air, no longer silent about the realities of gender-based violence. So hearing #metoo posts as battle cries of powerful game heroines made sense to me. But it’s the meta layers of meaning that are even more intuitive: as I’ve discussed elsewhere, female battle cries are notoriously gendered and sexualized. Listening to a reel of sampled battle cries is almost indistinguishable from listening to a pornographic soundscape. Abstracted in this sonification, away from the cartoonish hyper-reality of a game world, these voices are even more eerie, giving almost physical substance to the subject matter of #metoo. Just as the female voice in media secretly fulfils the furtive desires of the “neglected erogenous zone” of the ear (Pettman 2017, 17), #metoo is an embodiment of the conflation of sex with consent: the basis of what we now call ‘rape culture.’
Sonifying real-time data such as Twitter presents not only semantic (how should it sound like) but also time-scale challenges. If we are to sonify a month – e.g. the month of November 2017 (just weeks after the explosion of #metoo) – but we don’t want to spend a month listening, then that involves some conceptual time-scaling. Time-scaling means speeding up instances that already happen multiple times a second on a platform as instantaneous and global as Twitter. Below are samples of three different sonifications of #metoo data, following different moments in the initial explosion of the hashtag and rendered at different time compressions. Listen to them one at a time and note your sensual and emotive experience of tweets closer to real-time playback, compared to the audible patterns that emerge from compressing longer periods of time inside the same length audio file. You might find that the density is different. Closer to real-time the battle cries are more distinctive, while at higher time compressions what emerges instead is an expanding and contracting polyphonic texture.
Vocalizations of female pleasure/affect, video game battle cries already have a special relationship to technologies of audio sampling and digital reproduction as Corbett & Kapsalis describe in “Aural sex: the female orgasm in popular sound.” This means that the perceptual technics involved in listening to recorded female voices are already coded with sexual connotations. Battle cries in games are purposely exaggerated so as to carry the bulk of emotional content in the game’s experiential matrix. Roland Barthes’ notion of the “grain of the voice”—the presence of the body in (singing) voice—is frequently evoked in describing the substantive role that game voices play in the construction of game world immersion and realism. In the #metoo sonification, I decontextualize the grain of the voice—there are no visual images, narrative, or gameplay; the battle cries are also acousmatic, in that there are no bodies visually represented from which these sounds emanate.
The battle cry in this #metoo sonification is the ultimate disembodied voice, resisting what Kaja Silverman (1988) calls the “norm of synchronization” with a female body in The Acoustic Mirror (83). As acousmatic voices, these battle cries could be said to exist on a different conceptual and perceptual plane, “disturbing the taxonomies upon which patriarchy depends,” to quote Dominic Pettman in Sonic Intimacy. (22). In other words, the sounds exist in a boundary space between combat sounds and orgasmic sounds highlighting for the listener the dissonance between the supposed empowerment of ‘speaking out’ within a culture that remains staunchly set up to sexualize women; something one can hardly ignore given the media’s reserved treatment of #metoo.
Liberated from the game world these voices now speak for themselves in the #metoo sonification, their sensuality all the more hyper-real. The player has no control here, as the battle cries are not linked to specific game actions, rather they are synchronized autonomously to instances of #metoo confessionals. In fact, the density of the sonification as time speeds up will overwhelm listeners with its boundlessness; echoing how contemporary media treats the sounds of the female orgasm as a renewable and inexhaustible resource, even as reports of sexual harassment and gender-based violence continue to pile on in 2021. Yet we intend that the subject matter resists pleasure, rendering the sonic experience traumatic as the chilling realization sets in that listeners are hailed to accountability by #metoo. The experience should instead be unsettling, impactful, grotesque, and deeply embodied.
Listening both metaphorically and literally goes to the very heart of questions to do with the politics and experience of living and communicating in the media age. In her paper on the sonic geographies of the voice, AM Kanngieser notes in “A Sonic Geography of Voice“: “The voice, in its expression of affective and ethico-political forces, creates worlds” (337). It is not just in the grain but in the enunciation that battle cries find their political significance in this sonification. As the hyper-real gasps and moans of game heroines animate individual moments of #metoo the codification of cartoonish voices resists being subconsciously “absorbed into the dialogic exchange” (342) of habitual media consumption. Listening to the sonification is instead an experience of re-coding the voice, reconfiguring the embedded meanings of game sound to a new and contradictory context: a space that challenges neoliberal appropriations of radical communication and discourse (348). This is not data sonification that delights the listener or simply grants them access to ‘information’ in a different format; rather it calls on the listener to de-normalize their received technicity and perceptions and to connect to the emotional inter-subjectivity of this call to action.
Most importantly, the #metoo sonification invites the auditeur to listen in, to take an active role in the reconfiguration of meanings and absorb their political dimensions. These are the stories of #metoo; these are the voices of women, of men, of marginalized peoples, emerging from the zeitgeist of Twitter to ask us to earwitness gender-based violence. We are a new listening public, wanting and needing to create new worlds. A critical bandwidth is the smallest perceivable unit of auditory change, in psychology terms. This sonification begs the question, how many battle cries will it take for us to end gender-based violence by fostering equitable worlds?
Milena Droumeva is an Assistant Professor and the Glenfraser Endowed Professor in Sound Studies at Simon Fraser University specializing in mobile media, sound studies, gender, and sensory ethnography. Milena has worked extensively in educational research on game-based learning and computational literacy, formerly as a post-doctoral fellow at the Institute for Research on Digital Learning at York University. Milena has a background in acoustic ecology and works across the fields of urban soundscape research, sonification for public engagement, as well as gender and sound in video games. Current research projects include sound ethnographies of the city (livable soundscapes), mobile curation, critical soundmapping, and sensory ethnography. Check out Milena’s Story Map, “Soundscapes of Productivity” about coffee shop soundscapes as the office ambience of the creative economy freelance workers.
Milena is a former board member of the International Community on Auditory Displays, an alumni of the Institute for Research on Digital Learning at York University, and former Research Think-Tank and Academic Advisor in learning innovation for the social enterprise InWithForward. More recently, Milena serves on the board for the Hush City Mobile Project founded by Dr. Antonella Radicchi, as well as WISWOS, founded by Dr. Linda O Keeffe.
REWIND! . . .If you liked this post, you may also dig:
Hearing Eugenics—Vibrant Lives
Learning from other scholars’ work on Haitian radio was, and still is, one of the greatest pleasures in the process of writing Isles of Noise: Sonic Media in the Caribbean (UNC 2016). People living in or from Haiti widely acknowledged and almost took for granted radio’s outsized role in public and political life. Edwidge Danticat and Jonathan Demme also understood this and paid tribute in Claire of the Sea Light and The Agronomist respectively, but historians remained largely fixated, understandably, on pivotal moments in Haiti’s rich history. Radio is different. Not pivotal, but witnessing the pivotal. Less dramatic and more long lasting and adhering to the same format for days, years, decades. It speaks to people who wouldn’t read newspapers or books. It floods private and public space with the sounds of music, talking, ruling, dissenting, explaining, satirizing, creating, crying, testifying, lying. But it leaves few archival traces. This is why the work of the five scholars in this series is so important. They allow us to hear a little and honor the listeners who make the medium what it is.
Liveness, and company: Ian Coss’s finely tuned account of a “day in the life” of a radio station follows the programming rhythm of days and nights, from rollicking to quiet and back again. Radio is a predictable presence, an intimate friend who anticipates your needs even before you do. Coss draws from his years of listening to the listeners as he marks radio time and space in Cap Haïtien. Guest Editor– Alejandra Bronfman
Fabrice Joseph is a mender, set up on a street corner in Cap Haïtien, Haiti’s second largest city. He shows me a red plastic toolbox filled with supplies — thread, wires, scraps of fabric—which he can use to fix a jammed zipper or stitch up a torn backpack strap. I stop because he’s cradling a radio set in his hands, tuned to the city’s most popular station: Radio Venus.
We meet on a quiet day; Fabrice has been sitting on the stoop for five hours already with no work. Another day he’s engrossed in assembling a large umbrella—the kind food vendors use for shade—but the radio is still on, now propped on a ledge just behind his head. He replaces the batteries almost weekly, because the radio is always on. In the morning Radio Venus plays news, Fabrice tells me, followed by music as the day heats up. Then in the afternoon he’ll hear sports or perhaps a religious program, before the station returns to music in the evening.
This arc Fabrice describes is designed to follow the arc of his day. In this post, I trace that link: between the rhythms of radio programming and the rhythms of daily life, to show how formatting choices create a heightened sense of ‘liveness’ on Haiti’s airwaves, with all content located in a specific moment: the present moment.
In a technical sense, terrestrial radio broadcasting has always been defined by real time or ‘live’ transmission (an dirèk in Creole), a characteristic that is often invoked in discussions of the medium’s capacity to create shared experiences or even ‘imagined communities.’ And yet where I live in the United States, the passage of time is barely discernible on most commercial stations. Where radio schedules once varied from hour to hour (often reflecting gendered and classed norms of listening), today market research has driven the rise of so-called “format stations” that target specific interest groups and demographics with an equally targeted form of programming: non-stop sports, news, top 40, easy listening, etc.
When I first visited Haiti in 2015, I was surprised to find a radio format unlike any I had grown up with, and not unlike those broadcast schedules of the 1920s and 1930s. While doing research in Cap Haïtien, I conducted a series of bandscans—systematic reviews of the entire radio dial—in order to identify the different types of programming heard on stations throughout the day there. I found the full range of talk and music-oriented shows you might expect, and yet of the 31 stations I picked up, only a handful carried the same type of programming all day. The vast majority carried every kind of program, including Fabrice’s favorite station, Radio Venus.
The Radio Venus studio sits on top of a three-story building, with a door leading straight out onto an open roof deck where the transmitter tower rises several more stories up in the air. That tower operates at 10 watts, just enough to relay the signal to a nearby mountain, where it’s then rebroadcast at roughly 450 watts, blanketing the country’s whole Northern Department. The person in charge of this whole system, as well as the overall flow of the day’s programs, is known as the opérateur. The station employs four operators—Molliere, Louis, Wilkonson and Simon—who work in shifts to cover the 24-hour schedule. This rotation provides stability as the hosts (or animateur) of different programs come and go—often showing up late, and sometimes not showing up at all. For long stretches of the day there is no host, so the operator just cues up a folder of songs in Windows Media Player, occasionally leaning over to trigger a station ID: a chesty voice that declares, “W’ap koute Radio Tele-Venus”—‘You are listening to Radio Tele-Venus.’
One day, while sitting behind the board of the cramped control room, Simon explains that the goal of the station’s format is to satisfy all of the listeners’ interests and to provide “stability” in their often unstable lives. That last descriptor, “estabilite,” strikes me as somewhat ironic, given that the station’s programming is constantly changing. But for Haitians like Fabrice, who listen all day while they work, the description fits: he never needs to touch the dial, and at the same time he knows exactly what he will hear. Indeed, most of the radio listeners I meet in Cap Haïtien praise the medium’s consistently variable nature; if they wanted to hear the same thing all day they could get a stereo that takes a kat memwa—a memory card—and load it up with their favorite mp3s. Radio should change with the hours of the day; that’s part of what makes it radio.
Many of the staff at Radio Venus describe the art of matching programming to the mood of the moment, in terms of ‘hotness’ (cho). For example, it’s important to have a lively host on the air between about 10am to noon, usually playing konpa music, so that the radio ‘heats up’ to give listeners more energy for their day. This shift takes place simultaneously across virtually every station on the dial, such that it’s literally audible on the street, from countless battery-powered radio sets. The timeliness of this ‘heating up’ is further emphasized by the host—at Venus, a local favorite named Don Lolo—who constantly reads the exact hour and minute off of a large analog clock on the studio wall. Lolo’s job is to make the music live in the moment; to make it ‘hot.’ By the same token, when I interview the overnight operator, Louis, he tells me that since many listeners keep the radio on all night, it’s important that he doesn’t play any music that’s ‘too hot,’ so as not to disturb their sleep. Everything in its right time.
The most dramatic shift in programming, however, begins on Friday evening. For the entire weekend, the station drops most of its talk-oriented shows and plays constant music—almost all of which is bootlegged recordings of live concerts. The idea is to convey the freewheeling mood of a night out on the town, even for those who won’t be at a bar or concert. To keep up this atmosphere, the station operators can choose from whole folders of “konpa live” tracks dating back decades—most of which run twelve to fifteen minutes long. Again, this programming convention of playing live recordings on weekends is ubiquitous across the dial, and indeed across Haiti. Turn on the radio on a Saturday night and you will be hard pressed to find any music that was recorded in a studio.
My first weekend at Radio Venus, I step out of the studio at dusk, and find the station’s signal is suddenly all around me—far more present than just a few hours earlier. Around the corner from the station, an electronics store has set up a row of folding chairs in the street, and is blasting Radio Venus for a small audience. At the end of the same block is a barbershop; there too the stereo is tuned to Venus, with one cabinet speaker set in its arched entryway.
At this hour, both the street and the shop are definitively male spaces—save for some market women packing goods and a mother overseeing her son’s haircut, those listening in public are men. A cell card vendor is perched on top of the stereo speaker itself; a man with two live chickens—their heads poking out of the bottom of plastic shopping bags—stops by and quickly exchanges some money with one of the barbers, who plays some air guitar as the next customer takes his seat. One of the other remaining barbers is perched sideways in his stool, feet in the air and a bottle of Barbancourt rum in one hand. The energy is loose, encouraged by the radio announcer.
Back at the station, the small studio is lit only by a single fluorescent bulb, whose harsh light spills through the glass pane into the neighboring control room. Don Lolo is on the air once again, but his style is different. No more telling the time or giving long monologues. Instead he sings along in a full-throated voice, occasionally adding personal shout-outs. We learn that Gerald is celebrating a birthday today, just as Claire and Alex are marking their anniversary. When his phone then rings, instead of picking it up Lolo silences the call and responds by radio: “Sorry, I can’t talk now!”
It’s late when Don Lolo wraps up his show and we head out of the studio, leaving Louis alone to cool the music back down for the overnight shift. The evening operator, Simon, offers to walk me home. At this hour, we can stroll down the middle of the street side by side, the city’s elaborate facades cast in silhouette by the occasional streetlight. As we head up the hill towards my place, Simon cocks his head and gestures across the street. I turn just in time to catch the station ID—“W’ap koute Radio Tele Venus”—coming out of a barbershop. The radio is still on.
Tune into a livestream of Radio Tele-Venus via Tune In: https://tunein.com/radio/Radio-Tele-Venus-1043-s181945/
Featured Image: “An electronics vendor in Cap Haïtien, Haiti” by Ian Coss
Ian Coss is an audio producer, composer and sound designer whose work spans the worlds of podcasting and performance. He has produced several critically acclaimed series with the Radiotopia network, including Ways of Hearing, The Great God of Depression, and Over the Road. His audio work has been reviewed by the New Yorker and the Guardian; featured on NPR, Al Jazeera and the BBC; and recognized with an Edward R. Murrow Award for ‘excellence in sound.’ Additionally, Ian has premiered live sound works at the Boston Museum of Science and Harvard University, and collaborated on immersive audio tours for the Isabella Stewart Gardner Museum, Richmond ICA, and other major art institutions. Ian holds a PhD in ethnomusicology from Boston University, where he conducted research on Haitian radio broadcasting and Indonesian shadow-puppetry. He continues this work as musical director for The Brothers Čampur, an international puppetry collaborative that has performed at major festivals in Indonesia, and at universities throughout the eastern United States. More on all these projects at iancoss.com.
REWIND! . . .If you liked this post, you may also dig:
Radio Ambulante: A Radio that Listens –Carolina Guerrero