Editor’s Note: Welcome to the second installment in the “DH and Listening” blog series for World Listening Month, our annual forum that prompts readers to reflect on what it means to listen. This year’s forum considers the role of “listening” in the digital humanities (DH, for short). We at Sounding Out! are stoked to hear about (and listen to) all the new projects out there that archive sound, but we wonder whether the digital humanities engage enough with the the notion of listening. After all, what’s a sound without someone to listen to it?

On our opening week, Jacqueline Wernimont from the Vibrant Lives team shared with us about the ethics of listening to 20th century sterilization victims’ records. Then, Emmanuelle Sonntag introduces us to a figure from a long time ago, “la soeur écoute,” a nun whose was responsible for sitting in and listening when another nun had a visitor. This week, Fabiola Hanna reflects upon what DH means when it talks about participatory practices. –Liana Silva, Managing Editor

—

Germanic and Holocaust historian and Digital Humanist Todd Presner has worked through more than 52,000 testimonies of the Shoah Foundation’s Visual History Archive, perhaps the largest archive of testimony, to investigate “the ethics of the algorithm.” The scale of this participatory archive has prompted Presner to ask: is it possible for a computer to listen to testimony?

Digital Humanities (DH) projects are, in varying degrees, led by the desire to engage with a wider public. Some often include actions such as inviting participants to share their stories, images, audio clips, drawings, and videos. In order to avoid lumping all DH works under a broad category that includes, among others, text analysis, mapping, visualization, 3D, and archiving. Below I examine DH projects that collect oral histories: memories, stories, and testimonies.

I argue that it is not enough to share stories; it is also important to recognize how these stories are shared. A majority of these living histories end up in an audio or video database displayed in full on a webpage, not unlike oral history transcripts ending up in a dusty closet. Listening as an active mode of participation can provide us with a framework that reveals the relationships, aesthetics and politics engendered by participation. Although seemingly about access (and some have started questioning whether users of such an archive should have access by default, or whether you need to be part of a community in order to access certain stories, see Mukurtu CMS), my focus is rather on the medium that these stories are circulated in, how they are displayed to the user and what the user’s participation does to these stories.

I take the space here, on the one hand, to think through participation from two fields, archives and interactive documentary (i-docs), and on the other hand to write about how sound studies, particularly an attention to listening and its aesthetics, its affordances, and its politics, can offer another approach to participation.

SO! Screen Capture from Irene Lustzig’s “The WorryBox Project”

DH + participation: steps towards making place for popular

The work of requesting participation is in itself an accomplishment. It’s only been since the 1950s/60s, and perhaps more broadly since the 1990s, that ordinary peoples’ stories have been valued in the tradition that oral historians have established. It is possible to trace the field’s origins to Augusto Boal’s Theatre of the Oppressed (itself rooted in Paolo Friere’s work), to Howard Zinn’s A People’s History of the United States, or to postmodernism, the death of the author, and the end of grand narratives. With the arrival of Web 2.0, oral history seemed like the perfect medium for the ideals of participation on the Internet, precisely because it was about the everyday and involved “anyone” (with an internet connection). Video, audio and live streaming technologies made it possible for oral history to be recorded and displayed, and social media enabled unprecedented circulation through sharing. So the recent push to preserve everyday histories online, in DH projects, follows these ideals of stories from below.

Listening to stories as a mode of engagement is fitting with regards to oral history and testimony. Making space with openness and silence for someone’s testimony, especially when difficult, is a mode of participation that we aspire to. Media scholar Wendy Chun has argued that “a politics and practice of listening [is] a necessary complement to a politics of testifying.” In the case of Holocaust testimony, for instance, many scholars have argued that there is a responsibility to listen (Laub & Felman and Henry Greenspan).

I differentiate between two types of listening:

1. Listening on the part of the users of these DH projects. Is it realistic to expect that users will listen to large archives of testimony? In Listening Publics, Kate Lacey writes that listening has been absent from theories of the public sphere, even where “the objective of political agency is often characterized as being to find a voice – which surely implies finding a public that will listen, and that has a will to listen” (viii). Because of their scale, these large archives of testimony pose a significant design challenge to the user, which could be resolved through curation. To build on one of the most successful digital storytelling projects, the Storycorps team knows very well that if they didn’t curate and edit together shorter versions, then no one would listen to the longer interviews in full.

2. Listening on the part of the interface and its design. This involves questioning the medium and its effects on what it houses. Here I find Susan Bickford’s work very useful in her definition of listening and what it accomplishes: ‘the riskiness of listening comes partly from the possibility that what we hear will require change from us’ (1996, 149). If interfaces for stories pre-close any openness to what contributed stories could change, then listening is not being considered. This is more directly seen in the tagging of videos and their categorization without additional interpretational work. This will to not “add” to these stories seems to come from the premise that these testimonies should “speak for themselves” (I get to this point in a little bit); that no added interpretation is needed, even that any added interpretation distracts from the directness of the stories. But this often also means the medium and its effects on these stories are not carefully examined.

Contrary to Western cultural beliefs, listening can be seen as an active mode of participation in conversation. As Jodi Dean rightly argues, it is not enough to express one’s opinion, or for a message to be circulated: it is crucial to get a response to the message. Lisbeth Lipari writes that even in Dean’s formulation, however, the response as speech is still emphasized, thereby ignoring the work that happens beforehand: the listening. Apart from the major contribution of Susan Bickford, mentioned above, with the concept of political listening, little attention has been paid to listening in the field of political theory.

As arguably the most important philosopher on listening, Gemma Corradi Fiumara, writes: “listening involves the renunciation of a predominantly moulding and ordering activity; a giving up sustained by the expectation of a new and different quality of relationship” (as quoted by Lipari, 8). For Fiumara, listening is a mode of participation that is open and that does not pre-close potential possible contributions. Listening, therefore, as a mode of engagement can provide a useful method for thinking about participation in various contexts.

DH + Archives + i-docs

If a mission of a certain DH project is to engage with a wider public, then preservation of stories is not enough. More often than not, DH projects are already under difficult strain of resources, due to costs for developing technological projects and time for interviewing, collecting, indexing, tagging, uploading and making sense of these larger collections. DH have taken on a lot: preserving and archiving everyday stories with the mission to share with a wider public. It is useful to draw from experts who have been working through ideas of preservation and access: archivists. Archives generally have a mission of preservation, but when demands of sharing with a public arise, there are not many models from which to draw. Rick Prelinger writes that although the archive as a theoretical concept is overly theorized, its practice (in the plural form of the word) is under theorized.

Image of StoryCorps collection area by Aaron “tango” Tang (CC BY 2.0).

Francis X Blouin and William G. Rosenberg trace the intersection of history and archives and found that Ranke, during the enlightenment, conceptualized history as a scientific endeavor in that truth could be extracted from archives through rigorous methodologies. This led to the idea that documents could “speak for themselves” (Blouin, 24). As if simply making documents available, without providing context of any sort, would reveal their inner truth. This is one of many cases where the reading of documents is taken for granted. It also ignores the effect that archivists have on the collecting, saving, and indexing of documents. Influential archivists such as Terry Cooke, Richard Brown and Brian Brothman have brought about new attitudes to repositories with an acknowledgment of the effect that archivists have on documents (as quoted by Richard J Cox, 33). This relatively recent push in archival theory, therefore, points to the flaws in the claim that documents on their own can represent themselves: that would be ignoring all the various power relationships at play, as well as the medium itself in which the stories are communicated.

In thinking about collaboration, with the unstated but implied goal of providing knowledge of a given subject, non-fiction film has experimented by inviting self-interested participants online and offline to contribute to projects. Sandra Gaudenzi makes clear that interactive documentaries, also called i-docs (documentaries designed for online or mobile viewing), are very distinct and that it is important to recognize the varying strategies employed by these digital projects: “uploading content is the most common way to collaborate in the case of online documentary, but it is definitely not the only one. […] contributions of content lead to co-creation but not to co-authorship, since the latter require a degree of intervention in the overall concept (i.e., form) of the product.” In her differentiation of co-creation and co-authorship, Gaudenzi points to the medium-limiting effect that users have in their participation. The “degree of intervention,” as a coming in between that leads to change, which Gaudenzi requires for co-authored documentaries, might be attained through listening, a listening through the work itself, such as The WorryBox Project.

Listening in The WorryBox Project

Irene Lusztig’s The WorryBox Project (2011) web-based documentary invites mothers to write their worries in an online form, which Lusztig then individually writes down on a piece of paper, rolls-up and stores in a physical box. The act of writing down in analog form what was input into a digital box goes an extra step beyond collection. It is emblematic of an extended care for these worries. The additional layer of documenting these actions, as part of the artwork itself, not only points to the embodiment of these worries but also to their representation.

Because listening has often been thought of as passive and feminine, it is also associated with a specific kind of caring, also in its passive and feminine forms. But I don’t equate that definition of care with listening, which surely the readers of this blog will question. In this case, care extends as a mode of listening because it pushes against the active/passive binary for speaking/listening. I use care in the sense it gave to curating (care is its early root), where curating points to the work of engagement and conversation.  Curating as a form of listening.

This extended care would be an example of the listening I am thinking of. The work of translating the form’s digital input into the handwritten words and the documentation of that act stretch the layering of interpretation and with it the care given to these submissions. The change that occurs in this writing is definitely not an agreement or an endorsement of what is submitted but an open attitude of listening, of reception. This reinforces the notion that listening is not passive, but an active mode of participation. 

This mode of listening does not imply an understanding, as the receipt of information in cybernetics theory suggested by Shannon and Weaver. Rather this mode of communication embraces the notion that listening does not necessarily mean an understanding. The audio action collaborative Ultra-Red conveys this idea perfectly: “Sound possesses a palpable promiscuity in relation to the body. One may say what one means, but somewhere between the mouth that speaks and the ear that hears, sound always exceeds its master. Politically, it may be useful to say that we hear the truth in the voice or that we listen with obedience, but sound always transgresses such duties.” So for DH storytelling projects to be participatory, it is beneficial to allow stories the space for listening, in a similar sense to Hannah Arendt’s “distancing” in order to understand. This brings me to media and communication’s scholar Lisbeth Lipari’s term for this: “listening otherwise.”

SO! Screen Capture of Irene Lustzig’s “The Worry Project”

For Lipari, in engaging with difficult stories or perhaps stories that offer different perspectives: “It is […] a listening otherwise that suspends the willfulness of self- and foreknowledge in order to receive the singularities of the alterity of the other” (185, emphasis in original). For this “listening otherwise” to work online, I argue that it is important for the employed structures, systems and processes to reflect this specific kind of participation. In other words, in addition to placing “different voices” side-by-side, it is equally critical for these different perspectives to exist in a space where the medium, whether the recording, the software, the interface and its design, listens to what these differences are. An interface designed in order not to predetermine, not to predict or preclose what others might contribute would then be an example of this listening. Anthropomorphizing aside, for a computer to listen to testimony, as Presner asks, it must be designed to be open to changing itself.

—

Fabiola Hanna is a new media artist & software designer currently working towards a PhD in Film and Digital Media at UC Santa Cruz where she also holds an MFA in Digital Arts & New Media. Her doctoral work is on building an automatic editing machine that weaves together competing narratives about the history of Lebanon, which has led her to engage with software studies & digital humanities, archives & memory and new media art activism.  

Her work has been exhibited widely in California at the Museum of Art and History in Santa Cruz, the New Children’s Museum in San Diego, the SubZero Festival in San Jose, the Digital Arts Research Center in Santa Cruz, and the Maker Faire in San Mateo. She is also a 2015 fellow of the Institute for Critical Social Inquiry at the New School, New York and has previously taught at University of California, San Diego and at various maker spaces including FabLab San Diego and MakerPlace.

Her website is fabiolahanna.com and she can be reached by email fhanna {@} ucsc {dot} edu.

—

Featured Image: “Story Corps” by Steve Rhodes, (CC BY-NC-ND 2.0)

—

REWIND!…If you liked this post, you may also dig:

What Mixtapes Can Teach Us About Noise: Reading Shannon and Weaver in 2010–Aaron Trammell

Machinic Ballads: Alan Lomax’s Global Jukebox and the Categorization of Sound Culture–Tanya Clement

“Digital Analogies: Techniques of Sonic Play“-Roger Moseley