After a rockin’ (and seriously informative) series of podcasts from Leonard J. Paul, a Drrty South banger dropped by SO! Regular Regina Bradley, a screamtastic meditation from Yvon Bonenfant, a heaping plate of food sounds from Steph Ceraso, and crowd chants courtesy of Kariann Goldschmidt‘s work on live events in Brazil, our summer Sound and Pleasure comes to a stirring (and more intimate) conclusion. Tune into Justyna Stasiowska‘s frequency below. And thanks for engaging the pleasure principle this summer!--JS, Editor-in-Chief
One of my greatest pleasures is lying in bed, eyes closed and headphones on. I attune to a single stimuli while being enveloped in sound. Using sensory deprivation techniques like blindfolding and isolating headphones is a simple recipe for relaxation, but the website Digital Drugs offers you more. A user can play their mp3 files and surround themselves with an acoustical downpour that increases and then develops into gradient waves. The user feels as if in a hailstorm, surrounded by this constant gritty aural movement. Transfixed by the feeling of noise, the outside seems indistinguishable from inside.
Sold by the i-Doser company, Digital Drugs use mp3 files to deliver binaural beats in order to “simulate a desired experience.” The user manual advises lying in a dark and silent room with headphones on when listening to the recording. Simply purchase the mp3, and fill the prescription by listening. Depending on user needs, the experience can be preprogrammed with a specific scenario. This way users can condition themselves using Digital Drugs in order to feel a certain way. The user can control the experience by choosing the “student” or “confidence” dose suggestive of whether you’d like your high like a mild dose of marijuana or an intense dose of cocaine. The receiver is able to perceive every reaction of their body as a drug experience, which they themselves produced. The “dosing” of these aural drugs is restricted by a medical warning and “dose advisors” are available for consultation.
Thus, the overall presentation of Digital Drugs resembles a crisscross of medicine and narcotic clichés with the slogan “Binaural Brainwave doses for every imaginable mood.” While researching the phenomena of Digital Drugs, I have tried not to dismiss them as another gimmick or a new age meditation prop. Rather, I argue the I-Doser company offers a simulation of a drug experience by using the discourse of psychoactive substances to describe sounds: the user becomes an actor taking part in a performance.
By tracing these strategies on a macro and micro scale I show a body emerging from a new paradigm of health. I argue that we have become a psychosomatic creature called the inFORMational body: a body that is formed by information, which shapes practices of health undertaken to feel good and form us. This body is networked, much like a fractal, and connects different agencies operating both in macro (society) and micro (individual) scales.
Macroscale Epidemy: The Power of Drug Representation
Heinrich Wilhelm Dove described binaural beats in 1839 as a specific brain stimuli resulting in low-frequency pulsations perceivable when two tones at slightly different frequencies are presented separately through stereo headphones to each of the subject’s ears. The difference between tones must be relatively small, only up to 30 Hz, and the tones themselves must not exceed 1000 Hz. Subsequently, scientific authorities presented the phenomena as a tool in stimulating the brain in neurological affliction therapy. Gerard Oster described the applications in 1968 and the Monroe Institute later continued this research in order to use binaural beats in meditation and “expanding consciousness” as a crucial part of self-improvement programs.
I-Doser then molded this foundational research into a narrative presenting binaural beats as a brain stimulation for a desired experience. The binaural beats can be simply understood as an acoustic phenomena with application in practices like meditation or medical therapy.
I-Doser also employs the unverified claims about binaural beats into a narration that consists of the scattered information about research; it connects these authorities with YouTube recordings of human reactions to Digital Drugs. Video testimonies of Digital Drugs users caused a considerable stir among both parents and teachers in American schools two years ago. An American school even banned mp3 players as a precautionary measure. In the You Tube video one can see a person lying with headphones on. After a while we see an involuntary body movement that in some videos might resemble a seizure. Losing control over one’s body becomes the highlight of the footage alongside a subjective account also present in the video. The body movements are framed as a drug experience both for the viewer who is a vicarious witness and the participant who has an active experience.
This type of footage as evidence was popularized as early as the 1960s when military footage showed reactions to psychoactive substances such as LSD.
In the same manner as the Digital Drugs video, the army footage highlights the process of losing control over one’s body, complete with subjective testimonies as evidence of the psychoactive substance’s power.
This kind of visualization is usually fueled by paranoia, akin to Cold War fears, depicting daily attacks by an invisible enemy upon unaware subjects. The information of the authority agencies about binaural beats created a reference base that fueled the concern framing the You Tube videos as evidence of drug experience. It shows that the angst isn’t triggered by technology, in this case Digital Drugs, but by the form in which the “invisible attack” is presented: through sound waves. The manner of framing is more important than the hypothetical action itself. Context then changes recognition.
Microscale Paradigm Shift: Health as Feeling
On an individual level, did feeling better always mean being healthy? In Histoire des pratiques de santé. Le sain et le malsain depuis le MoyenAge, Georges Vigarello, continuator of the Foucault School of Biopolitics, explains that well-being became a medicalized condition in the 20th century with growing attention to mental health. Being healthy was no longer only about the good condition of the body but became a state of mind; feeling was important as an overall recognition of oneself. In the biopolitical perspective, Vigarello points out, health became more than just the government’s concern for individual well-being but was maintained by medical techniques and technologies.
In the case of Digital Drugs the well-being of children was safely governed by parents and media coverage creating prevention in schools from the “sound drugs.” Similarly, the UAE called for a ban on “hypnotic music” citing it as an illegal drug like cannabis or ecstasy. Using this perspective, I would add that feeling better, then, becomes a never-ending warfare; well-being becomes understood as a state (as in condition and as in governed territory).
Well-being is also an obligation to society, carried out by specific practices. What does a healthy lifestyle actually mean? Its meaning includes self-governance: controlling yourself, keeping fit, discipline (embodying the rules). In order to do it you need guidance: the need for authorities (health experts and trainers) and common knowledge (the “google it” modus operandi). All of these agencies create a strategy to make you feel good every day and have a high performance rate. Digital Drugs, then, become products that promise to boost up your energy, make you more endurable, and extend your mind capabilities. High performance is redefined as a state that enables instant access to happiness, pleasure, relaxation.
Vigarello reflects that understanding health in terms of low/high performance—itself based on the logic of consumption—created the concept of a limitless enhancement. Here, he refers to the information model, connecting past assumptions about health with a technique of self-governing. It is based on senses and an awareness of oneself using “intellectual” practices like relaxation and “probing oneself” (or knowing what vitamins you should take). The medical apparatus’s priority, moreover, shifted from keeping someone in good health to maintaining well-being. The subjective account became the crucial element of a diagnosis, supporting itself on information from different sources in order to imply the feeling of a limitless “better.” This strategy relies strongly on the use of technologies, the consideration of a sensual aspect and self-recognition—precisely the methodology used for Digital Drugs’ focus on enhancing wellbeing.
Still, this inFORMational body needs a regulatory system. How do we know that we really feel better? Apart from the media well-being campaign (and the amount of surveillance it involves), we are constantly asked about our health status in the common greeting phrase, but its unheimlich-ness only becomes apparent for non-anglo-saxon speakers. These checkpoint techniques become an everyday instrument of discipline and rely on an obligation to express oneself in social interactions.
So how do we feel? As for now, everything seems “OK.”
Featured image: “Biophonic Garden” by Flickr user Rene Passet, CC BY-NC-ND 2.0
Justyna Stasiowska is a PhD student in the Performance Studies Department at Jagiellonian University. She is preparing a dissertation under the working title: “Noise. Performativity of Sound Perception” in which she argue that frequencies don’t have a strictly programmed effect on the receiver and the way of experiencing sounds is determined by the frames or modes of perception, established by the situation and cognitive context. Justyna earned her M.A in Drama and Theater Studies. Her thesis was devoted to the notion of liveness in the context of the strategies used by contemporary playwrights to manipulate the recipients’ cognitive apparatus using the DJ figure. You can find her on Twitter and academia.edu.
REWIND!…If you liked this post, check out:
Papa Sangre and the Construction of Immersion in Audio Games–Enongo Lumumba-Kasongo
On Sound and Pleasure: Meditations on the Human Voice–Yvon Bonenfant
This is Your Body on the Velvet Underground–Jacob Smith
Today the SO! Thursday stream inaugurates a four-part series entitled Hearing the UnHeard, which promises to blow your mind by way of your ears. Our Guest Editor is Seth Horowitz, a neuroscientist at NeuroPop and author of The Universal Sense: How Hearing Shapes the Mind (Bloomsbury, 2012), whose insightful work on brings us directly to the intersection of the sciences and the arts of sound.
That’s where he’ll be taking us in the coming weeks. Check out his general introduction just below, and his own contribution for the first piece in the series. — NV
Welcome to Hearing the UnHeard, a new series of articles on the world of sound beyond human hearing. We are embedded in a world of sound and vibration, but the limits of human hearing only let us hear a small piece of it. The quiet library screams with the ultrasonic pulsations of fluorescent lights and computer monitors. The soothing waves of a Hawaiian beach are drowned out by the thrumming infrasound of underground seismic activity near “dormant” volcanoes. Time, distance, and luck (and occasionally really good vibration isolation) separate us from explosive sounds of world-changing impacts between celestial bodies. And vast amounts of information, ranging from the songs of auroras to the sounds of dying neurons can be made accessible and understandable by translating them into human-perceivable sounds by data sonification.
Four articles will examine how this “unheard world” affects us. My first post below will explore how our environment and evolution have constrained what is audible, and what tools we use to bring the unheard into our perceptual realm. In a few weeks, sound artist China Blue will talk about her experiences recording the Vertical Gun, a NASA asteroid impact simulator which helps scientists understand the way in which big collisions have shaped our planet (and is very hard on audio gear). Next, Milton A. Garcés, founder and director of the Infrasound Laboratory of University of Hawaii at Manoa will talk about volcano infrasound, and how acoustic surveillance is used to warn about hazardous eruptions. And finally, Margaret A. Schedel, composer and Associate Professor of Music at Stonybrook University will help readers explore the world of data sonification, letting us listen in and get greater intellectual and emotional understanding of the world of information by converting it to sound.
– Guest Editor Seth Horowitz
Although light moves much faster than sound, hearing is your fastest sense, operating about 20 times faster than vision. Studies have shown that we think at the same “frame rate” as we see, about 1-4 events per second. But the real world moves much faster than this, and doesn’t always place things important for survival conveniently in front of your field of view. Think about the last time you were driving when suddenly you heard the blast of a horn from the previously unseen truck in your blind spot.
Hearing also occurs prior to thinking, with the ear itself pre-processing sound. Your inner ear responds to changes in pressure that directly move tiny little hair cells, organized by frequency which then send signals about what frequency was detected (and at what amplitude) towards your brainstem, where things like location, amplitude, and even how important it may be to you are processed, long before they reach the cortex where you can think about it. And since hearing sets the tone for all later perceptions, our world is shaped by what we hear (Horowitz, 2012).
But we can’t hear everything. Rather, what we hear is constrained by our biology, our psychology and our position in space and time. Sound is really about how the interaction between energy and matter fill space with vibrations. This makes the size, of the sender, the listener and the environment, one of the primary features that defines your acoustic world.
You’ve heard about how much better your dog’s hearing is than yours. I’m sure you got a slight thrill when you thought you could actually hear the “ultrasonic” dog-training whistles that are supposed to be inaudible to humans (sorry, but every one I’ve tested puts out at least some energy in the upper range of human hearing, even if it does sound pretty thin). But it’s not that dogs hear better. Actually, dogs and humans show about the same sensitivity to sound in terms of sound pressure, with human’s most sensitive region from 1-4 kHz and dogs from about 2-8 kHz. The difference is a question of range and that is tied closely to size.
Most dogs, even big ones, are smaller than most humans and their auditory systems are scaled similarly. A big dog is about 100 pounds, much smaller than most adult humans. And since body parts tend to scale in a coordinated fashion, one of the first places to search for a link between size and frequency is the tympanum or ear drum, the earliest structure that responds to pressure information. An average dog’s eardrum is about 50 mm2, whereas an average human’s is about 60 mm2. In addition while a human’s cochlea is spiral made of 2.5 turns that holds about 3500 inner hair cells, your dog’s has 3.25 turns and about the same number of hair cells. In short: dogs probably have better high frequency hearing because their eardrums are better tuned to shorter wavelength sounds and their sensory hair cells are spread out over a longer distance, giving them a wider range.
Then again, if hearing was just about size of the ear components, then you’d expect that yappy 5 pound Chihuahua to hear much higher frequencies than the lumbering 100 pound St. Bernard. Yet hearing sensitivity from the two ends of the dog spectrum don’t vary by much. This is because there’s a big difference between what the ear can mechanically detect and what the animal actually hears. Chihuahuas and St. Bernards are both breeds derived from a common wolf-like ancestor that probably didn’t have as much variability as we’ve imposed on the domesticated dog, so their brains are still largely tuned to hear what a medium to large pseudo wolf-like animal should hear (Heffner, 1983).
But hearing is more than just detection of sound. It’s also important to figure out where the sound is coming from. A sound’s location is calculated in the superior olive – nuclei in the brainstem that compare the difference in time of arrival of low frequency sounds at your ears and the difference in amplitude between your ears (because your head gets in the way, making a sound “shadow” on the side of your head furthest from the sound) for higher frequency sounds. This means that animals with very large heads, like elephants, will be able to figure out the location of longer wavelength (lower pitched) sounds, but probably will have problems localizing high pitched sounds because the shorter frequencies will not even get to the other side of their heads at a useful level. On the other hand, smaller animals, which often have large external ears, are under greater selective pressure to localize higher pitched sounds, but have heads too small to pick up the very low infrasonic sounds that elephants use.
But you as a human are a fairly big mammal. If you look up “Body Size Species Richness Distribution” which shows the relative size of animals living in a given area, you’ll find that humans are among the largest animals in North America (Brown and Nicoletto, 1991). And your hearing abilities scale well with other terrestrial mammals, so you can stop feeling bad about your dog hearing “better.” But what if, by comic-book science or alternate evolution, you were much bigger or smaller? What would the world sound like? Imagine you were suddenly mouse-sized, scrambling along the floor of an office. While the usual chatter of humans would be almost completely inaudible, the world would be filled with a cacophony of ultrasonics. Fluorescent lights and computer monitors would scream in the 30-50 kHz range. Ultrasonic eddies would hiss loudly from air conditioning vents. Smartphones would not play music, but rather hum and squeal as their displays changed.
And if you were larger? For a human scaled up to elephantine dimensions, the sounds of the world would shift downward. While you could still hear (and possibly understand) human speech and music, the fine nuances from the upper frequency ranges would be lost, voices audible but mumbled and hard to localize. But you would gain the infrasonic world, the low rumbles of traffic noise and thrumming of heavy machinery taking on pitch, color and meaning. The seismic world of earthquakes and volcanoes would become part of your auditory tapestry. And you would hear greater distances as long wavelengths of low frequency sounds wrap around everything but the largest obstructions, letting you hear the foghorns miles distant as if they were bird calls nearby.
But these sounds are still in the realm of biological listeners, and the universe operates on scales far beyond that. The sounds from objects, large and small, have their own acoustic world, many beyond our ability to detect with the equipment evolution has provided. Weather phenomena, from gentle breezes to devastating tornadoes, blast throughout the infrasonic and ultrasonic ranges. Meteorites create infrasonic signatures through the upper atmosphere, trackable using a system devised to detect incoming ICBMs. Geophones, specialized low frequency microphones, pick up the sounds of extremely low frequency signals foretelling of volcanic eruptions and earthquakes. Beyond the earth, we translate electromagnetic frequencies into the audible range, letting us listen to the whistlers and hoppers that signal the flow of charged particles and lightning in the atmospheres of Earth and Jupiter, microwave signals of the remains of the Big Bang, and send listening devices on our spacecraft to let us hear the winds on Titan.
Here is a recording of whistlers recorded by the Van Allen Probes currently orbiting high in the upper atmosphere:
When the computer freezes or the phone battery dies, we complain about how much technology frustrates us and complicates our lives. But our audio technology is also the source of wonder, not only letting us talk to a friend around the world or listen to a podcast from astronauts orbiting the Earth, but letting us listen in on unheard worlds. Ultrasonic microphones let us listen in on bat echolocation and mouse songs, geophones let us wonder at elephants using infrasonic rumbles to communicate long distances and find water. And scientific translation tools let us shift the vibrations of the solar wind and aurora or even the patterns of pure math into human scaled songs of the greater universe. We are no longer constrained (or protected) by the ears that evolution has given us. Our auditory world has expanded into an acoustic ecology that contains the entire universe, and the implications of that remain wonderfully unclear.
Exhibit: Home Office
This is a recording made with standard stereo microphones of my home office. Aside from usual typing, mouse clicking and computer sounds, there are a couple of 3D printers running, some music playing, largely an environment you don’t pay much attention to while you’re working in it, yet acoustically very rich if you pay attention.
This sample was made by pitch shifting the frequencies of sonicoffice.wav down so that the ultrasonic moves into the normal human range and cuts off at about 1-2 kHz as if you were hearing with mouse ears. Sounds normally inaudible, like the squealing of the computer monitor cycling on kick in and the high pitched sound of the stepper motors from the 3D printer suddenly become much louder, while the familiar sounds are mostly gone.
This recording of the office was made with a Clarke Geophone, a seismic microphone used by geologists to pick up underground vibration. It’s primary sensitivity is around 80 Hz, although it’s range is from 0.1 Hz up to about 2 kHz. All you hear in this recording are very low frequency sounds and impacts (footsteps, keyboard strikes, vibration from printers, some fan vibration) that you usually ignore since your ears are not very well tuned to frequencies under 100 Hz.
Finally, this sample was made by pitch shifting the frequencies of infrasonicoffice.wav up as if you had grown to elephantine proportions. Footsteps and computer fan noises (usually almost indetectable at 60 Hz) become loud and tonal, and all the normal pitch of music and computer typing has disappeared aside from the bass. (WARNING: The fan noise is really annoying).
The point is: a space can sound radically different depending on the frequency ranges you hear. Different elements of the acoustic environment pop up depending on the type of recording instrument you use (ultrasonic microphone, regular microphones or geophones) or the size and sensitivity of your ears.–
Featured image by Flickr User Jaime Wong.
Seth S. Horowitz, Ph.D. is a neuroscientist whose work in comparative and human hearing, balance and sleep research has been funded by the National Institutes of Health, National Science Foundation, and NASA. He has taught classes in animal behavior, neuroethology, brain development, the biology of hearing, and the musical mind. As chief neuroscientist at NeuroPop, Inc., he applies basic research to real world auditory applications and works extensively on educational outreach with The Engine Institute, a non-profit devoted to exploring the intersection between science and the arts. His book The Universal Sense: How Hearing Shapes the Mind was released by Bloomsbury in September 2012.
REWIND! If you liked this post, check out …
Learning to Listen Beyond Our Ears– Owen Marshall
This is Your Body on the Velvet Underground– Jacob Smith
World Listening Day took place last week, and as I understand it, it is all about not taking sound for granted – an admirable goal indeed! But it is worth taking a moment to consider what sorts of things we might be taking for granted about sound as a concept when we decide that listening should have its own holiday.
One gets the idea that soundscapes are like giant pandas on Endangered Species Day – precious and beautiful and in need of protection. Or perhaps they are more like office workers on Administrative Professionals’ Day – crucial and commonplace, but underappreciated. Does an annual day of listening imply an interruption of the regularly scheduled three hundred and sixty four days of “looking”? I don’t want to undermine the valuable work of the folks at the World Listening Project, but I’d argue it’s equally important to consider the hazards of taking sound and listening for granted as premises of sensory experience in the first place. As WLD has passed, let us reflect upon ways we can listen beyond our ears.
At least since R. Murray Schafer coined the term, people have been living in a world of soundscapes. Emily Thompson provides a good definition of the central concept of the soundscape as “an aural landscape… simultaneously a physical environment and a way of perceiving that environment; it is both a world and a culture constructed to make sense of that world.”(117) As an historian, Thompson was interested in using the concept of soundscape as a way of describing a particular epoch: the modern “machine age” of the turn of the 20th century.
Anthropologist Tim Ingold has argued that, though the concept that listening is primarily something that we do within, towards, or to “soundscapes” usefully counterbalanced the conceptual hegemony of sight, it problematically reified sound, focusing on “fixities of surface conformation rather than the flows of the medium” and simplifying our perceptual faculties as “playback devices” that are neatly divided between our eyes, ears, nose, skin, tongue, etc.
Stephan Helmreich took Ingold’s critique a step further, suggesting that soundscape-listening presumes a a particular kind of listener: “emplaced in space, [and] possessed of interior subjectivities that process outside objectivities.” Or, in less concise but hopefully clearer words: When you look at the huge range of ways we experience the world, perhaps we’re limiting ourselves if we confine the way we account for listening experiences with assumptions (however self-evident they might seem to some of us) that we are ‘things in space’ with ‘thinking insides’ that interact with ‘un-thinking outsides.’ Jonathan Sterne and Mitchell Akiyama, in their chapter for the Oxford Handbook of Sound Studies, put it the most bluntly, arguing that
Recent decades of sensory history, anthropology, and cultural studies have rendered banal the argument that the senses are constructed. However, as yet, sound scholars have only begun to reckon with the implications for the dissolution of our object of study as a given prior to our work of analysis.(546)
Here they are referring to the problem of the technological plasticity of the senses suggested by “audification” technologies that make visible things audible and vice-versa. SO!’s Jennifer Stoever-Ackerman has also weighed in on the social contingency of the “listening ear,” invoking Judith Butler to describe it as “a socially-constructed filter that produces but also regulates specific cultural ideas about sound.” In various ways, here, we get the sense that not only is listening a good way to gain new perspectives, but that there are many perspectives one can have concerning the question of what listening itself entails.
But interrogating the act of listening and the sounds towards which it is directed is not just about good scholarship and thinking about sound in a properly relational and antiessentialist way. It’s even less about tsk-tsking those who find “sound topics” intrinsically interesting (and thus spend inordinate amounts of time thinking about things like, say, Auto-Tune.) Rather, it’s about taking advantage of listening’s potential as a prying bar for opening up some of those black boxes to which we’ve grown accustomed to consigning our senses. Rather than just celebrating listening practices and acoustic ecologies year after year, we should take the opportunity to consider listening beyond our current conceptions of “listening” and its Western paradigms.
For example, when anthropologist Kathryn Lynn Guerts first tried to understand the sensory language of the West African Anlo-Ewe people, she found a rough but ready-enough translation for “hear” in the verb se or sese. The more she spoke with people about it, however, the more she felt the limitations of her own assumptions about hearing being, simply, the way we sense sounds through our ears. As one of her informants put it, “Sese is hearing – not hearing by the ear but a feeling type of hearing”(185). As it turns out, according to many Anlo-ewe speakers, our ability to hear the sounds of the world around us is by no means an obviously discrete element of some five-part sensorium, but rather a sub-category of a feeling-in-the-body, or seselelame. Geurts traces the ways in which the prefix se combines with other sensory modes, opening up the act of hearing as it goes along: sesetonume, for example, is a category that brings together sensations of “eating, drinking, breathing, regulation of saliva, sexual exchanges, and also speech.” Whereas English speakers are more inclined to contrast speech with listening as an act of expression rather than perception, for the Anlo-Ewe they can be joined together into a single sensory experience.
The ways of experiencing the world intimated by Geurts’ Anlo-Ewe interlocutors play havoc with conventionally “transitive,” western understandings of what it means to “sense” something (that is, to be a subject sensing an object) let alone what it means to listen. When you listen to something you like, Geurts might suggest to us that liking is part of the listening. Similarly, when you listen to yourself speak, who’s to say the feeling of your tongue against the inside of your mouth isn’t part of that listening? When a scream raises the hairs on the back of your neck, are you listening with your follicles? Are you listening to a song when it is stuck in your head? The force within us that makes us automatically answer “no” to questions of this sort is not a force of our bodies (they felt these things together after all), but a force of social convention. What if we tried to protest our centuries-old sensory sequestration? Give me synaesthesia or give me death!
Indeed, synaesthesia, or the bleeding-together of sensory modes in our everyday phenomenological experience, shows that we should loosen the ear’s hold on the listening act (both in a conceptual and a literal sense – see some of the great work at the intersections of disability studies and sound studies). In The Phenomenology of Perception, Maurice Merleau-Ponty put forth a bold thesis about the basic promiscuity of sensory experience:
Synaesthetic perception is the rule, and we are unaware of it only because scientific knowledge shifts the centre of gravity of experience, so that we have unlearned how to see, hear, and generally speaking, feel, in order to deduce, from our bodily organization and the world as the physicist conceives it, what we are to see, hear and feel. (266)
Merleau-Ponty, it should be said, is not anti-science so much as he’s interested in understanding the separation of the senses as an historical accomplishment. This allows us to think about and carry out the listening act in even more radical ways.
Of course all of this synaesthetic exuberance requires a note to slow down and check our privilege. As Stoever-Ackerman pointed out:
For women and people of color who are just beginning to decolonize the act of listening that casts their alternatives as wrong/aberrant/incorrect—and working on understanding their listening, owning their sensory orientations and communicating them to others, suddenly casting away sound/listening seems a little like moving the ball, no?
To this I would reply: yes, absolutely. It is good to remember that gleefully dismantling categories is by no means always the best way to achieve wider conceptual and social openness in sound studies. There is no reason to think that a synaesthetic agenda couldn’t, in principle, turn fascistic. The point, I think, is to question the tools we use just as rigorously as the work we do with them.
Owen Marshall is a PhD candidate in Science and Technology Studies at Cornell University. His dissertation research focuses on the articulation of embodied perceptual skills, technological systems, and economies of affect in the recording studio. He is particularly interested in the history and politics of pitch-time correction, cybernetics, and ideas and practices about sensory-technological attunement in general.
REWIND!…If you liked this post, you may also dig:
Snap, Crackle, Pop: The Sonic Pleasures of Food–Steph Ceraso
Welcome to our new series Sculpting the Film Soundtrack, which brings you new perspectives on sound and filmmaking. As Guest Editor, we’re honored and delighted to have Katherine Spring, Associate Professor of Film Studies at Wilfrid Laurier University. Spring is the author of an exciting and important new book Saying it With Songs: Popular Music and the Coming of Sound to Hollywood Cinema. Read it! You’ll find an impeccably researched work that’s the definition of how the history of film sound and media convergence ought to be written.
But before rushing back to the early days, stick around here on SO! for the first of our three installments in Sculpting the Film Soundtrack.
It’s been 35 years since film editor and sound designer Walter Murch used the sounds of whirring helicopter blades in place of an orchestral string section in Apocalypse Now, in essence blurring the boundary between two core components of the movie soundtrack: music and sound effects. This blog series explores other ways in which filmmakers have treated the soundtrack as a holistic entity, one in which the traditional divisions between music, effects, and speech have been disrupted in the name of sculpting innovative sonic textures.
In three entries, Benjamin Wright, Danijela Kulezic-Wilson, and Randolph Jordan will examine the integrated soundtrack from a variety of perspectives, including technology, labor, aesthetic practice, theoretical frameworks, and suggest that the dissolution of the boundaries between soundtrack categories can prompt us to apprehend film sound in new ways. If, as Murch himself once said, “Listening to interestingly arranged sounds makes you hear differently,” then the time is ripe for considering how and what we might hear across the softening edges of the film soundtrack.
- Guest Editor Katherine Spring
Composing a sound world for Man of Steel (2013), Zack Snyder’s recent Superman reboot, had Hans Zimmer thinking about telephone wires stretching across the plains of Clark Kent’s boyhood home in Smallville. “What would that sound like,” he said in an interview last year. “That wind making those telephone wires buzz – how could I write a piece of music out of that?” The answer, as it turned out, was not blowing in the wind, but sliding up and down the scale of a pedal steel guitar, the twangy lap instruments of country music. In recording sessions, Zimmer instructed a group of pedal steel players to experiment with sustains, reverb, and pitches that, when mixed into the final track, accompany Superman leaping over tall buildings at a single bound.
His work on Man of Steel, just one of his most recent films in a long and celebrated career, exemplifies his unique take on composing for cinema. “I would have been just as happy being a recording engineer as a composer,” remarked Zimmer last year in an interview to commemorate the release of a percussion library he created in collaboration with Spitfire Audio, a British sample library developer. “Sometimes it’s very difficult to stop me from mangling sounds, engineering, and doing any of those things, and actually getting me to sit down and write the notes.” Dubbed the “HZ01 London Ensembles,” the library consists of a collection of percussion recordings featuring many of the same musicians who have performed for Zimmer’s film scores, playing everything from tamtams to taikos, buckets to bombos, timpani to anvils. According to Spitfire’s founders, the library recreates Zimmer’s approach to percussion recording by offering a “distillation of a decade’s worth of musical experimentation and innovation.”
In many ways, the collection is a reminder not just of the influence of Zimmer’s work on contemporary film, television, and video game composers but also of his distinctive approach to film scoring, one that emphasizes sonic experimentation and innovation. Having spent the early part of his career as a synth programmer and keyboardist for new wave bands such as The Buggles and Ultravox, then as a protégé of English film composer Stanley Myers, Zimmer has cultivated a hybrid electronic-orchestral aesthetic that uses a range of analog and digital oscillators, filters, and amplifiers to twist and augment solo instrument samples into a synthesized whole.
Zimmer played backup keyboards on “Video Killed the Radio Star.”
In a very short time, Zimmer has become a dominant voice in contemporary film music with a sound that blends melody with dissonance and electronic minimalism with rock and roll percussion. His early Hollywood successes, Driving Miss Daisy (1989) and Days of Thunder (1990), combined catchy themes and electronic passages with propulsive rhythms, while his score for Black Rain (1989), which featured taiko drums, electronic percussion, and driving ostinatos, laid the groundwork for an altogether new kind of action film score, one that Zimmer refined over the next two decades on projects such as The Rock (1996), Gladiator (2000), and The Pirates of the Caribbean series.
What is especially intriguing about Zimmer’s sound is the way in which he combines the traditional role of the composer, who fashions scores around distinct melodies (or “leitmotifs”), with that of the recording engineer, who focuses on sculpting sounds. Zimmer may not be the first person in the film business to experiment with synthesized tones and electronic arrangements – you’d have to credit Bebe and Louis Barron (Forbidden Planet, 1956), Vangelis (Chariots of Fire, 1981), Jerry Goldsmith (Logan’s Run, 1976), and Giorgio Moroder (Midnight Express, 1981) for pushing that envelope – but he has turned modern film composing into an engineering art, something that few other film composers can claim.
One thing that separates Zimmer’s working method from that of other composers is that he does not confine himself to pen and paper, or even keyboard and computer monitor. Instead, he invites musicians to his studio or a sound stage for an impromptu jam session to find and hone the musical syntax of a project. Afterwards, he returns to his studio and uses the raw samples from the sessions to compose the rest of the score, in much the same way that a recording engineer creates the architecture of a sound mix.
“There is something about that collaborative process that happens in music all the time,” Zimmer told an interviewer in 2010. “That thing that can only happen with eye contact and when people are in the same room and they start making music and they are fiercely dependent on each other. They cannot sound good without the other person’s part.”
Zimmer facilitates the social and aesthetic contours of these off-the-cuff performances and later sculpts the samples into the larger fabric of a score. In most cases, these partnerships have provided the equivalent of a pop hook to much of Zimmer’s output: Lebo M’s opening vocal in The Lion King (1994), Johnny Marr’s reverb-heavy guitar licks in Inception, Lisa Gerrard’s ethereal vocals in Gladiator and Black Hawk Down (2002), and the recent contributions of the so-called “Magnificent Six” musicians to The Amazing Spider Man 2 (2014).
The melodic hooks are simple but infectious – even Zimmer admits he writes “stupidly simple music” that can often be played with one finger on the piano. But what matters most are the colors that frame those notes and the performances that imbue those simple melodies with a personality. Zimmer’s work on Christopher Nolan’s Dark Knight trilogy revolves around a deceptively simple rising two-note motif that often signifies the presence of the caped crusader, but the pounding taiko hits and bleeding brass figures that surround it do as much to conjure up images of Gotham City as cinematographer Wally Pfister’s neo-noir photography. The heroic aspects of the Batman character are muted in Zimmer’s score except for the presence of the expansive brass figures and taiko hits, which reach an operatic crescendo in the finale, where the image of Batman escaping into the blinding light of the city is accompanied by a grand statement of the two-note figure backed by a driving string ostinato. Throughout the series, a string ostinato and taikos set the pace for action sequences and hint at the presence of Batman who lies somewhere in the shadows of Gotham.
Zimmer’s expressive treatment of musical colors also characterizes his engineering practices, which are more commonly used in the recording industry. Music scholar Paul Théberge has noted that the recording engineer’s interest in an aesthetic of recorded musical “sound” led to an increased demand for control over the recording process, especially in the early days of multitrack rock recording where overdubbing created a separate, hierarchical space for solo instruments. Likewise for Zimmer, it’s not just about capturing individual sounds from an orchestra but also layering them into a synthesized product. Zimmer is also interested in experimenting with acoustic performances, pushing musicians to play their instruments in unconventional ways or playing his notes “the wrong way,” as he demonstrates here in the making of the Joker’s theme from The Dark Knight:
The significance of the cooperative aspects of these musical performances and their treatment as musical “colors” to be modulated, tweaked, and polished rests on a paradoxical treatment of sound. While he often finds his sound world among the wrong notes, mistakes, and impromptu performances of world musicians, Zimmer is also often criticized for removing traces of an original performance by obscuring it with synth drones and distortion. In some cases, like in The Peacemaker (1997), the orchestration is mushy and sounds overly processed. But in other cases, the trace of a solo performance can constitute a thematic motif in the same way that a melody serves to identify place, space, or character in classical film music. Compare, for instance, Danny Elfman’s opening title theme for Tim Burton’s Batman (1989) and Zimmer’s opening title music for The Dark Knight. While Elfman creates a suite of themes around a central Batman motif, Zimmer builds a sparse sound world that introduces a sustained note on the electric cello that will eventually be identified with the Joker. It’s the timbre of the cello, not its melody, that carries its identifying features.
To texture the sounds in Man of Steel, Zimmer also commissioned Chas Smith, a Los Angeles-based composer, performer, and exotic instrument designer to construct instruments from “junk” objects Smith found around the city that could be played with a bow or by hand while also functioning as metal art works. The highly abstract designs carry names that give some hint to their origins – “Bertoia 718” named after modern sculptor and furniture designer Harry Bertoia; “Copper Box” named for the copper rods that comprise its design; and “Tin Sheet” that, when prodded, sounds like futuristic thunderclaps.
Smith’s performances of his exotic instruments are woven into the fabric of the score, providing it with a sort of musical sound design. Consider General Zod’s suite of themes and motifs, titled “Arcade” on the 2-disc version of the soundtrack. The motif is built around a call-and-answer ostinato for strings and brass that is interrupted by Smith’s sculptural dissonance. It’s the sound of an otherworldly menace, organic but processed, sculpted into a conventional motif-driven sound world.
Zimmer remains a fixture in contemporary film music partly because, as music critic Jon Burlingame has pointed out, he has a relentless desire to search for fresh approaches to a film’s musical landscape. This pursuit begins with his extracting of sounds and colors from live performances and electronically engineering them during the scoring process. Such heightened attention to sound texture and color motivated the creation of the Spitfire percussion library, but can only hint at the experimentation and improvisational nature that goes into Zimmer’s work. In each of his film scores, the music tells a story that is tailored to the demands of the narrative, but the sounds reveal Zimmer’s urge to manipulate sound samples until they are, in his own words, “polished like a diamond.”
Ben Wright holds a Provost Postdoctoral Fellowship from the University of Southern California in the School of Cinematic Arts. In 2011, he received his Ph.D. in Cultural Studies from the Institute for Comparative Studies in Literature, Art and Culture at Carleton University. His research focuses on the study of production cultures, especially exploring the industrial, social, and technological effects of labor structures within the American film industry. His work on production culture, film sound and music, and screen comedy has appeared in numerous journals and anthologies. He is currently completing a manuscript on the history of contemporary sound production, titled Hearing Hollywood: Art, Industry, and Labor in Hollywood Film Sound.
All images creative commons.
REWIND! . . .If you liked this post, you may also dig: