“A focus on listening [with technology] shifts the idea of freedom of speech from having a platform of expression to having the possibility of communication” (K. Lacey)
One of the biggest social media event of the past decade, #metoo stands out as a pivotal shift in the future of gender relations. Despite its persistence since October 2017, #metoo is still under-theorized, and since its permutations generate countless hashtag sub-categories each passing week, making sense of it presents a conceptual quagmire. Tracing its history, identifying key moments, mapping its pro- and counter-currents present equally tough challenges to both data science and feminist scholars.
Meta-communication about #metoo abounds. Infographics and visualizations attempt to contain its organic growth into perceivable maps and charts; pop news media constantly report on its evolution in likes, counts, and retweets, as well as—and increasingly—in number of convictions, lawsuits, and reports. At the same time, #metoo has arguably created a discernible listening public in the way that Kate Lacey (2013) argues emerged with national radio: women’s stories have never been listened to with such wide reach and rapt attention.
The project I discuss here takes ‘hearing’ #metoo a step further into the auditory realm in the form of data sonification so as to to re-imagine an audience compelled to earwitness not just the scope but the emotional impact of women’s stories. Data sonification is a growing field, which from its inception has crossed between art and science. It involves a conceptual or semantic translation of data into relevant sonic parameters in a way that utilizes perceptual gestalts to convey information through sound.
Brady Marks and I created the #metoo sonification you’ll hear below by drawing from a public dataset spanning October 2017 to the early Spring of 2018 obtained from data.world. Individual tweets using the hashtag are sonified using female battle cries from video games; the number of retweets and followers forms a sort of swelling and contracting background vocal texture to represent the reach of each message. The dataset is then sped up anywhere between 10x to 1000x in order to represent perceivable ebbs and flows of the hashtag’s life over time. The deliberate aim in this design was to convey a different sensibility of social media content, one that demands emotional and intellectual attention over a duration of time. Given Twitter’s visual zeitgeist whereby individual tweets are perceived at a glance and quickly become lost in the noise of the platform the affective attitude towards “contagious” events becomes arguably impersonal. A sonification such as this asks the listener to spend 30 minutes listening to 1 month of #metoo: something impossible to achieve on the actual platform, or in a single visualization. The aim, then, is to interrupt social media’s habitual and disposable engagements with pressing civic debates.
A critique of big data visualization
To date, there have been more than 19 million #MeToo tweets from over 85 countries; on Facebook more than 24 million people participated in the conversation by posting, reacting, and commenting over 77 million times since October 15, 2017. In a global information society ‘big data’ is translated into creative infographics in order to simultaneously educate an overwhelmed public and elicit urgency and accord for political action. Yet ideological and political considerations around the design of visual information have lagged behind enthusiasm for making data ‘easy to understand’. At the other end of the spectrum, social media delivers personalized micro-trends directly and in real time to always-mobile users, reinforcing their information silos (Rambukkana 2015). Between these extremes, the mechanisms by which relevant local, marginalized or emergent issues come to be communicated to the wider public are constrained.
With this big idea in mind, the question we ask here is what would it mean to hear data? Emergent work in sonification suggests that sound may afford a unique way to experience large-scale data suitable for raising public awareness of important current issues (Winters & Weinberg 2015). The uptake of sonification by the artistic community (see Rory Viner, Robert Alexander, among many others) signals its strengths in producing affective associations to data for non-specialized audiences, despite its shortcomings as a scientific analysis tool (Supper, 2018). Some of the more esoteric uses of sonification have been in the service of capturing what Supper calls ‘the sublime’ – as in Margaret Schedel’s “Sounds of Science: The Mystique of Sonification.”
Who’s listening on social media?
Within the Western canon of sound studies “constitutive technicities” (Gallope 2011) or what Sterne calls “perceptual technics” embody historically situated ways of listening that center technology as a co-defining factor in our relationship with sound. Within this frame, media sociologist Kate Lacey traces the emergence of the modern listening public through the history of radio. Using the metaphor of ‘listening in” and “listening out,” Lacey reframes media citizenship by pointing out that listening is a cultural as well as a perceptual act with defined political dimensions:
Listening out is the practice of being open to the multiplicity of texts and voices and thinking of texts in the context of and in relation to a difference and how they resonate across time and in different spaces. But at the same time, it is the practice and experience of living in a media age that produces and heightens the requirement, the context, the responsibilities and the possibilities of listening out (198)
According to Lacey, a focus on listening instead of spectatorship challenges the implicit active/passive dualism of civic participation in Western contexts. More importantly, she argues, we need to move away from the notion of “giving voice” and instead create meaningful possibilities to listen, in a political sense. Data sonification doesn’t so much ‘give voice to the voiceless’ but creates a novel relationship to perceiving larger patterns and movements.
Our interactions with media, therefore, are always already presumptive of particular dialogical relations. Every speech act, every message implies a listening audience that will resonate understanding. In other words, how are we already listening in to #metoo? How and why might data sonification enable us to “listen out” for it instead? In order to get a different hearing, what should #metoo sound like?
Sonifying #metoo: the battle cries of gender-based violence
It is unrealistic to expect that your everyday person will read large archives of testimony on sexual harassment and gender-based violence. Because of their massive scale, archives of #metoo testimony pose a significant challenge to the possibility for meaningful communication around this issue. Essentially drowning each other out, individual voices remain unheard in the zeitgeist of media platforms that automates quantification while speeding up engagement with individual contributions. To reaffirm the importance of voice would mean to reaffirm inter-subjectivity and to recognize polyphony as an “existential position of humanity” (Ihde 2007, 178). This was the problem to sonify here: how to retain individual voices while creating the possibility for listening to the whole issue at hand. Inspired by the idea of listening out, myself and artist collaborator Brady Marks set out to sonify #metoo as a way of eliciting the possibility for a new listening public.
The #metoo sonification project intersected deeply with my work on the female voice in videogames. My choice to use a mixed selection of battle cry samples from Soul Calibur, an arcade fighting game, was intuitive. Battle cries are pre-recorded banks of combat sounds that video game characters perform in the course of the story. Instances of #metoo on Twitter presumably represent the experiences of individual women, pumping a virtual fist in the air, no longer silent about the realities of gender-based violence. So hearing #metoo posts as battle cries of powerful game heroines made sense to me. But it’s the meta layers of meaning that are even more intuitive: as I’ve discussed elsewhere, female battle cries are notoriously gendered and sexualized. Listening to a reel of sampled battle cries is almost indistinguishable from listening to a pornographic soundscape. Abstracted in this sonification, away from the cartoonish hyper-reality of a game world, these voices are even more eerie, giving almost physical substance to the subject matter of #metoo. Just as the female voice in media secretly fulfils the furtive desires of the “neglected erogenous zone” of the ear (Pettman 2017, 17), #metoo is an embodiment of the conflation of sex with consent: the basis of what we now call ‘rape culture.’
Sonifying real-time data such as Twitter presents not only semantic (how should it sound like) but also time-scale challenges. If we are to sonify a month – e.g. the month of November 2017 (just weeks after the explosion of #metoo) – but we don’t want to spend a month listening, then that involves some conceptual time-scaling. Time-scaling means speeding up instances that already happen multiple times a second on a platform as instantaneous and global as Twitter. Below are samples of three different sonifications of #metoo data, following different moments in the initial explosion of the hashtag and rendered at different time compressions. Listen to them one at a time and note your sensual and emotive experience of tweets closer to real-time playback, compared to the audible patterns that emerge from compressing longer periods of time inside the same length audio file. You might find that the density is different. Closer to real-time the battle cries are more distinctive, while at higher time compressions what emerges instead is an expanding and contracting polyphonic texture.
Vocalizations of female pleasure/affect, video game battle cries already have a special relationship to technologies of audio sampling and digital reproduction as Corbett & Kapsalis describe in “Aural sex: the female orgasm in popular sound.” This means that the perceptual technics involved in listening to recorded female voices are already coded with sexual connotations. Battle cries in games are purposely exaggerated so as to carry the bulk of emotional content in the game’s experiential matrix. Roland Barthes’ notion of the “grain of the voice”—the presence of the body in (singing) voice—is frequently evoked in describing the substantive role that game voices play in the construction of game world immersion and realism. In the #metoo sonification, I decontextualize the grain of the voice—there are no visual images, narrative, or gameplay; the battle cries are also acousmatic, in that there are no bodies visually represented from which these sounds emanate.
The battle cry in this #metoo sonification is the ultimate disembodied voice, resisting what Kaja Silverman (1988) calls the “norm of synchronization” with a female body in The Acoustic Mirror (83). As acousmatic voices, these battle cries could be said to exist on a different conceptual and perceptual plane, “disturbing the taxonomies upon which patriarchy depends,” to quote Dominic Pettman in Sonic Intimacy. (22). In other words, the sounds exist in a boundary space between combat sounds and orgasmic sounds highlighting for the listener the dissonance between the supposed empowerment of ‘speaking out’ within a culture that remains staunchly set up to sexualize women; something one can hardly ignore given the media’s reserved treatment of #metoo.
Liberated from the game world these voices now speak for themselves in the #metoo sonification, their sensuality all the more hyper-real. The player has no control here, as the battle cries are not linked to specific game actions, rather they are synchronized autonomously to instances of #metoo confessionals. In fact, the density of the sonification as time speeds up will overwhelm listeners with its boundlessness; echoing how contemporary media treats the sounds of the female orgasm as a renewable and inexhaustible resource, even as reports of sexual harassment and gender-based violence continue to pile on in 2021. Yet we intend that the subject matter resists pleasure, rendering the sonic experience traumatic as the chilling realization sets in that listeners are hailed to accountability by #metoo. The experience should instead be unsettling, impactful, grotesque, and deeply embodied.
Listening both metaphorically and literally goes to the very heart of questions to do with the politics and experience of living and communicating in the media age. In her paper on the sonic geographies of the voice, AM Kanngieser notes in “A Sonic Geography of Voice“: “The voice, in its expression of affective and ethico-political forces, creates worlds” (337). It is not just in the grain but in the enunciation that battle cries find their political significance in this sonification. As the hyper-real gasps and moans of game heroines animate individual moments of #metoo the codification of cartoonish voices resists being subconsciously “absorbed into the dialogic exchange” (342) of habitual media consumption. Listening to the sonification is instead an experience of re-coding the voice, reconfiguring the embedded meanings of game sound to a new and contradictory context: a space that challenges neoliberal appropriations of radical communication and discourse (348). This is not data sonification that delights the listener or simply grants them access to ‘information’ in a different format; rather it calls on the listener to de-normalize their received technicity and perceptions and to connect to the emotional inter-subjectivity of this call to action.
Most importantly, the #metoo sonification invites the auditeur to listen in, to take an active role in the reconfiguration of meanings and absorb their political dimensions. These are the stories of #metoo; these are the voices of women, of men, of marginalized peoples, emerging from the zeitgeist of Twitter to ask us to earwitness gender-based violence. We are a new listening public, wanting and needing to create new worlds. A critical bandwidth is the smallest perceivable unit of auditory change, in psychology terms. This sonification begs the question, how many battle cries will it take for us to end gender-based violence by fostering equitable worlds?
Milena Droumeva is an Assistant Professor and the Glenfraser Endowed Professor in Sound Studies at Simon Fraser University specializing in mobile media, sound studies, gender, and sensory ethnography. Milena has worked extensively in educational research on game-based learning and computational literacy, formerly as a post-doctoral fellow at the Institute for Research on Digital Learning at York University. Milena has a background in acoustic ecology and works across the fields of urban soundscape research, sonification for public engagement, as well as gender and sound in video games. Current research projects include sound ethnographies of the city (livable soundscapes), mobile curation, critical soundmapping, and sensory ethnography. Check out Milena’s Story Map, “Soundscapes of Productivity” about coffee shop soundscapes as the office ambience of the creative economy freelance workers.
Milena is a former board member of the International Community on Auditory Displays, an alumni of the Institute for Research on Digital Learning at York University, and former Research Think-Tank and Academic Advisor in learning innovation for the social enterprise InWithForward. More recently, Milena serves on the board for the Hush City Mobile Project founded by Dr. Antonella Radicchi, as well as WISWOS, founded by Dr. Linda O Keeffe.
REWIND! . . .If you liked this post, you may also dig:
Hearing Eugenics—Vibrant Lives
In 2015 a video of a child in an Internet café in the Philippines began to trend on social media sites. Titled, Kanta ng isang Anak para sa kanyang inang OFW “Blank Space“ (“Song of a child for her overseas foreign worker mother”), the video shows a girl singing via Skype to her mother who is working in an unnamed location, presumably outside of the Philippines. “Ma kakantahan ulit kita ha?” (I’ll sing for you again mom), she says, and starts singing Taylor Swift’s “Blank Space”. Her mother attentively watches and listens to her song, soon beginning to cry in longing for a daughter she has not seen in a long time. The girl’s attention is divided between the screen that shows the lyrics, the camera that films her singing, and her mother who quietly observes. This video has over 110,000 views and is one of many archived messages from a child singing or speaking to their mother who labours transnationally. Despite the videos’ jittery framing and low quality, the intended message of shared longing across cyber and transnational borders is clear.
The Spanish-American war (1899-1902) resulted in the relinquishment of the colony of the Philippines from Spain to the United States. This transfer of power instituted the imperial specter that continues to grip the archipelago. The many performances of American pop music on Youtube and on stages throughout the Philippines are what Christine Bacareza Balance calls the “musical aftermath of US imperial cultures” (2016). Having amassed over 97 million YouTube views in the Philippines, Taylor Swift’s overwhelming popularity is evidence of this continued imperial presence. In the video, the young Filipinx girl sings lyrics written by Swift: “I’m dying to see how this one ends. Grab your passport and my hand.” When sung by this child these lyrics take on different meaning than Swift likely intended. Perhaps she is anticipating an end to the necessity of separation between mother and daughter.
Using song, the video provides evidence of what Hannah Dyer calls the ‘asymmetries of childhood innocence’ (2019), reminding its audience of the ways transnational labour and global capital impact children’s experiences of kinship and development. Dyer suggests that some children are withheld the protective hold of childhood innocence. She writes:
“Childhood innocence is a seemingly natural condition but its rhetorical maneuvers are permeated by its elisions and attempted disavowals along the lines of race, class, gender and sexuality. That is, despite the familiar rhetorical insistence that children are the future, some children are withheld the benefits of being assumed inculpable (2)”
Ascriptions of childhood innocence thus require a child to replicate social norms including the production of the nuclear family. In the Philippines, where the liberalization of international trade and high levels of unemployment have disproportionately impacted the labour migration of women, structures of the nuclear family are being re-organized (Parreñas 2005; Tungohan 2013). Women who work outside of the Philippines and away from their families are paradoxically celebrated for their “sacrifice” while also subject to disapproval over their absence (Tungohan 2013). When mothers leave the Philippines, the care-arrangements for children are shifted. There is a growing recognition of the changing nature of motherhood within transnational contexts and the concomitant emotional consequences of negotiating “long distance intimacy” (Parreñas 2005). The demands for transnational labour reconfigure Filipinx family formations and necessitate fraught intimacies between parent and child across borders. Cyber technologies like cell phones and the Internet initiate creative opportunities for children to be “virtually present” in the lives of their mothers and vice versa.
Drawing from Dyer, we might think of children who live without the physical presence of their mothers as “queer” to normative theories of childhood development that affirm overwrought expectations of maternal presence. She suggests that discourses of childhood innocence intend to subjugate the queerness of childhood and that these elisions hold bio-political significance. Faced with social inequities, Dyer emphasizes the importance of a child’s symbolic expression. She argues that children express their psychic and social conflicts aesthetically. A child’s imagination elaborates resistances to the enclosure of childhood innocence as a barometer of value. In this way, this article suggests a child’s singing and dancing are aesthetic expressions that take notice of the entangled traces of colonialism and nation, while resisting hierarchal structures that deem some childhoods more valuable than others.
The child’s sonic performance in the YouTube video is a queer offering that creatively procures transnational connection. Her singing registers a queer frequency that destabilizes normative theories of child development that assume a mother’s physical presence as necessary to developmental success. The girl’s performance suggests that psychic and political reparations can occur in the sounds the child makes. The tactile, spatial and physical qualities of her voice forge a new relation to her mother. Her voice is affecting, seemingly moving her mother to tears and rousing the onlookers at the Internet café to reorganize their bodies and sing along. In this video, we are invited to witness a child whose world has been altered by globalization and the continued geo-political violence’s enacted by the American empire. Given these circumstances, her “creative re-interpretation[s] of kinship” serves as a reminder that the affective fortitude of her voice tests physical and emotional borders (Dyer 2019). The restraint of normative conceptions of family is ruptured when the child remakes her relation to her mother in ways that stir joy, collectivity, and pleasure.
By observing and listening to the child’s song more closely, we can listen for its potential to re-sound and re-imagine the parent-child relationship across borders. The sounds of “OFW Blank Space” linger after the clip has ended. By listening for what is in excess of the video’s content, we can consider the affective registers that enunciate alternative understandings of migration, family and belonging. There is a humming that is ubiquitous in the video. Perhaps, it is the sound of the electric fans that run to combat the tropical heat of the Philippines. Maybe it is the collective buzzing from the computers that have been set up to provide the Internet to its cybercafé patrons. The acoustics of the space are at once mundane and haphazard, and at the same time, cogent indicators of the geopolitical truths echoing throughout the scene. With limited access to Internet in the home, the cybercafé has been a site that children frequent to communicate with family working in another country. The convergence of sound, technology and diasporic subjectivity becomes audible when the practice of listening is attuned to these methods of transnational connection.
While listening to the pedagogical potential of the cybercafé more broadly, a focus on the vocal performance of the child reveals my investment in what the sound of her voice tells us. The video starts with greetings spoken in Tagalog, the primary language of the Philippines. When the backing track begins, the child makes a seamless transition into singing in English. In her vocal performance of the lyrics, her Filipino accent is almost undetectable. She sings with a dulcet tone that is clear and appealing. Her voice sounds well-trained and confident. If not for the video, one might believe the child to be a professional American performer. In this scene, it is her voice that is marked and constituted by a narrative of American imperial conquest and Filipino assimilation. But in a creative adaptation of American cultural production, the child re-writes this racialized script and uses American pop songs as a mechanism of care for both herself and her mother.
The economic instability in the Philippines has created a state instituted transnational workforce. Women have been disproportionately affected by the demand for work in care industries such as nursing, childcare and care for the elderly (Francisco-Menchavez 2018). These gendered and racialized structures of employment privilege the presence of Filipinx women in families other than their own. The child is withheld a future that assures her the presence of her mother and their physical proximity is denied as a result of the demand for labour and capital exchange between nation-states. However, despite these circumstances, the child uses her voice to summon a beautiful intimacy, one that does not disavow the imperial history that marks its possibility, but instead uses loss as a resource to creatively mourn their separation. For the child, the act of singing is a replacement for her lost object, her mother. In the video we witness a child who is full of joy and whose strength of voice quells, if not, temporarily, whatever longing for her mother she might have. Relatedly, the child is also perceptive of her mother’s needs and uses music as a method of offering her care. Her performance creatively re-routes the presumed directionalities of care (from mother to child) which globalization has fundamentally altered.
Featured image: “Children” by Flickr user Clive Varley, CC-BY-2.0
Casey Mecija is an accomplished multi-disciplinary artist, primarily working in the fields of music and film. She played in Ohbijou, the Canadian orchestral pop band, and released her first solo album, entitled Psychic Materials, in 2016. Casey is also an award winning filmmaker whose work has screened internationally. She is completing a PhD at The University of Toronto, where she researches sound, performance studies and Filipinx Studies as they relate to queer diaspora.
REWIND! . . .If you liked this post, you may also dig:
Hearing “Media-Capitalism” in Egypt–Ziad Fahmy