If you were to choose to watch live video composer and performer Ana Carvalho’s work silent, your brain would be easily guided into a synesthetic experience, assigning sounds to each rhythmic change in color, pace, frame. Her images oscillate…they dance, they breathe. As you experience this, there might be a sense that you have lost your ability to hear the outside world, as these images are clearly attached to, woven with, a part of sound.
There is a history of composers such as Iannis Xenaxis and Cornelius Cardew using graphic scores and notation in place of traditional methods and symbols, as a way to reach a deeper expression through allowing greater interpretation, chance, and improvisation with their musicians. They concentrate more on conveying information on how a work is played, rather then what notes to play when. Carvalho uses the graphic score much in the same way, but also as a method of communication between live audio and live video performances, instructing a dialog between two disciplines that are often side-by-side or leaning on each other, but rarely woven together in the manner I have experienced both as audience, and as an audio composer, with her work.
The following interview has been edited for style.
Maile Colbert: Hi Ana, how are you today? And what are you working on currently?
Ana Carvalho: I am good. I’m working on a performance to present at the solstice, with Neil Leonard, and a text about the possibility of expansion of the mind through performing and fruition of being in an audiovisual performance.
At the moment the performance is still involved into misty possibilities of what we know of each other’s work, and what we have been developing individually and talking about. There will be saxophone, electronics, and visuals made of strange landscapes.
MC: At this stage in the process, when working with a sound maker such as Leonard, how do you think about the images’ relationship with the sound?
AC: Images come to be as they appear on the screen in two ways: first there is the introspection about what have I learned from the previous performances, what I want to explore further and what I don’t want to repeat. Secondly, there is the encounter with the other person and his or her work and how do I translate their sound into moving image. At some point my ideas change through the exchange and becomes something else, a visual performance that could only be presented with that sound, with that person, at that place and time.
Regarding the sound in particular, sometimes I propose a structure, or a score, to be followed by sound and image. Other times it is improvised. As I enjoy very much the process, I tend to like to make structures for the performances, which develop along drawings and texts.
As a sound maker, I find they have a flow and almost narrative that feels both intentional and intuitive, no matter how abstract. When you make these, how much of a clear idea of how the audio would sound in relation to the images is in your mind? Do your images always or often follow the same score? Do the results surprise you?
AC: My state of arriving at the point of starting to make a composition is very much the same I described about working with a sound artist towards the presentation of a performance, that is, what do I want to develop further and what I want to leave behind? Then, what is particular to this new situation/performance/collaboration? The composition is a sort of a vehicle that connects process and performance, and that connects sound and image.
The composition is for the two mediums, sound and image, and they are considered in terms of composition as a unity made of two parts. They have to work in a conversational way. Imagine two close friends and how they would be talking to each other. I have in my imagination how it would be ideally two people in that position. That is how sound and image relate on the composition. I think in the most generic terms, more of intensity and flow rather than sonic results. For this reason any musician, with any possible (or invented) instrument, with whichever image or sound database, is able to play a score. It’s required though that the performers take time to reflect, that the composition is understood and incorporated in the way each one plays their instrument. The results are always a surprise.
MC: What inspired you to start working in this way with the scores, and when?
AC: My interest in making compositional scores, and from them documents related to my performance, has been inspired by conceptual and process based art and by my research on documentation of the ephemeral. The focus on the process highlights the need for other representations that are not the finished art object per se. These other ways of representation use available media to describe the making and the reflection while making. Mary Kelly’s Post-Partum Document (1973-79) is a very interesting example of what I am describing. She is expressing her feelings, the growing process of a child and an external perspective through visual objects displayed both as an exhibition and in book formats. Within audiovisual practice, I have been researching for the past five years on creative ways to make documents of the process. My attention was directed to composition in music. The influence of the composer Cornelius Cardew has been great, especially his work Treatise and his idea of directed improvisation. John Cage was also very important for his structures (in talks, texts and music), the use of the I Ching, and for bringing chance into composition.
Simultaneously, while studying and reflecting on these and other subjects, I realized that intuitively I make drawings, texts, and take photographs as a way to detach from the everyday and immerge into a creative process which eventually will lead to the concept and content of a performance.
Systematic Illusion – The Subtle Technique in an Earthquake Detector Construction has been so far the most complex project to include a score, as well as a series of photographs and the performance. It was presented in its complete form just once in the curatorial project Decalcomania. Organizing these elements as composition, creating a score, and from all this to make little books has been a way of putting into practice my research interests.
A result from the construction of the score has been that the process doesn’t stop with one performance, as I then use the same scores to perform with different artists. For example with the score from this project I created the Earthquake Detector performance series within which we presented the performance together in São Paulo in 2013 at the event Arranjos Experimentais.
MC: As you speak about your work, I keep thinking about Robert Bresson’s Notes on Sound and how most of his notes refer to variations of not letting sound or image take over each other, but to weave them together within the composition. In his Notes on the Cinematographer, he also wrote number “10. not to use two violins when one is enough”. What might this mean to you in relation to your collaborations?
AC: One very inspiring event in the attempts I make to construct a formal grammar and way for me to address collaborations has been to see the film Passage Through: A Ritual by Stan Brakhage. The film was screened at Serralves Museum, here in Porto, Portugal, in June 2011. The event addressed the collaboration and improvisation of music in relationship with cinema from the work of the composers Malcolm Goldstein and Philip Corner and their music in the film work of Daïchi Saïto and Stan Brakhage.
The most amazing thing in Passage Through: A Ritual was to watch such a beautiful film made of an abundance of black screen, that is, an absence of visual form, of light and movement. Each appearance of image was a precious moment. What I learned is that the visual emptiness, and sonic as well, contains information when stimulated through glimpses of image, making the experience of seeing and listening very deep. (In his Notes), Bresson sums up this appropriateness of means and complex connections in a simple and clear sentence.
On the scores I make most of the information can be used for both sound and image. On the Refractive Composition, the scale of greys is for image. That was its purpose when the score was performed the first time. But if someone decides to play from the score without knowing anything about it beforehand, and lacking this intention (which was relevant when it was made, but afterwards there was the decision to not leave it as a declared instruction), that person can also interpret the same information as sound.
MC: Alchemy has been described as: “…the chemistry of the subtlest kind which allows one to observe extraordinary chemical operations at a more rapid pace; ones that require a long time for nature to produce” (Paul-Jacques Malouin, Alchimie). Looking from a history of cinema, there is a tradition and pattern of picture coming before sound, a hierarchy that is both in process and production. You often feel this as an audience. Your work and collaboration have a quality of sound and image having been born together. Having worked with you using your scores, I was likening it to being given a recipe where you have before you ingredients and suggestions, but there is room for your own improvisations and reading. Perhaps that is where that feeling of both disciplines coming together in a manner that feels like they are one part of a whole, rather then separate but leaning on each other, comes from.
Is there an alchemical element to this work, or are you seeking one out? And in that regard, are your scores like a recipe?
AC: What I am seeking with my work can relate to alchemy as experiments and attempts in the quest for depth in all things at the point where differences and frontiers become undefined and irrelevant (in communication between beings, in areas of knowledge, between matter and energy). This quest for depth is based on stubborn curiosity towards evolution as a person, and as part of the world. Perhaps there isn’t an alchemical element to the work, but rather a connection with alchemy, in the ways scores relate to the experiments as recipes to be shared with others in construction and change. This takes me to another aspect of composition. It is difficult for me to understand live image as just accompaniment to a music performance, and vice versa. This is perhaps central to my composition, and the reason why I am doing it for sound and image, to be able to perform that intertwined.
If we look at compositions as recipes, it aim will be to set the performers in tune with each other in the construction of a performance, to set sound and image in dialogue, and to permit a multisensory experience. I have been trying to get other artists interested in performing my scores. To perform from another artist’s score may be very common in music but is unheard of in live visuals. I have as an objective to make a change in that, but for now I perform the scores with sound artists. With the Earthquake Detector series I asked sound artists to read from the score and perform with me. So far, I have presented this as performance with Jeremy Slater, Ben Owen, and with you. Because each artist has a very different approach to the score and reads it in its own way, the processes have been very different. For example, Ben Owen made visual reinterpretations of the structure, and you experimented with and without voice (reading of the text in the score), the results are therefore equally different.
MC: Aside from your scores, you could speak about your relationship to the sound you work with, and sound makers you work with, in the live moment of performance?
AC: Looking for a sound artist to work together on a specific piece or to interpret with me a composition comes from a need to transcend my individual perception of the world and to perceive it with others. It is, again, the curiosity to know the world. The only time I made a complete sound piece on my own was for the performance Vista II – Montanha presented last May (as part of Semana Andrómeda, in Maus Hábitos, Porto). Aside from this really interesting experience, each collaboration is different, every process is different, because each musician is a different person with different skills and sees the relationship between sound and image in different ways.
I am very thankful for everything I have learned with each collaboration and all the intensity with each performance but, as always, it’s the curiosity and the need to explore new frontiers that makes me move from previous project to next project. It is also the possibilities that intuitively present themselves as challenges and the “what if…” in variations.
Ana Carvalho is a live video composer and performer, and writes on subjects related to live audiovisual performance. She is a doctor of Communication and Digital Platforms from FLUP (Faculdade de Letras da Universidade do Porto). Her thesis is “Materiality and the Ephemeral: Identity and Performative Audiovisual Arts, its Documentation and Memory Construction.” Currently, she holds a position as invited lecturer at the ISMAI (Instituto Universitário da Maia). For more on her work, visit: http://cargocollective.com/visual-agency/About.
Maile Colbert is a multi-media artist with a concentration on sound and video who relocated from Los Angeles, US to Lisbon, Portugal. She is a regular writer for Sounding Out!
All images courtesy of the author.
REWIND! . . .If you liked this post, you may also dig:
Sound as Art as Anti-environment — Steven Hammer
Live Electronic Performance: Theory and Practice — Primus Luta
There is no utopia without nature. Life is already a utopia–Mileece
When I heard sound artist and environmental researcher Mileece refer to utopia as she presented on her bio-sound work this past year for MOMA’s PSA1 series “Speculations: The Future Is ____” I was startled and intrigued. When I asked Mileece to delve further into her conception, Mileece explained how when faced with an environment lacking flora–such as on a recent trip to India where she spent a lot of time in a cityscape heavy with apartment blocks–she noticed that finally coming upon a garden outside a temple or other flush area felt like utopia. “I’m referring to an ecological utopian society, not a fictional one.” Mileece told me, “But either way, what we imagine as a perfect society always comes with fruit. Nature makes man right in the head. Without it, things get really rough. With it too of course, but you can see what happens to people deprived of green.” Her participatory art installations explore and communicate her sense of the lushness and sensory surprises of the natural world.
Mileece is a internationally acclaimed, multi- disciplinary sonic artist and renewable energy ambassador. Her work “promoting ecology through technology and the arts’ has brought her international critical acclaim as a composer and installation artist. Formations, her debut album, inspired by cycles and formations in nature (“beautiful, real, musical science,” BBC), was the result of her initial works in computer generated compositions, using Super Collider, an object-oriented programming language.–Decibel festival bio
Mileece and I recently continued our conversation via Skype–she in the city of Jaisalmer in Rajasthan performing camera and sound work on mouthharps, and me in my studio in Lisbon, Portugal–what follows is a transcript of our talk. Mileece had just finished showing in Bhutan, where she created an installation in a dome at their first international festival.
Maile Colbert: Was the installation [in Bhutan] related to the work you did recently in MOMA [at POPRALLY in February 2013]?
Mileece: similar in being an installation with interactive plants and sensors.
MC: And when you are home and in the studio, what does your day look and sound like?
M: That depends on much. The last project I did before leaving for Bhutan was a dome at a school, which had me with a shovel in garden clothes up early onsite, then home late, so I wasn’t in the studio at all. Then I worked on the plant interface for Bhutan and generally to get a public interface finished-hardware and software as pre-made wireless ‘off the shelf’ devices and learning kits that I can distribute to people and artists and do more complex projects with. So at random hours, when my colleague who is helping me with the engineering aspects had a moment, we would sit and quickly go over the builds. I did recently decide I want to do a less intensely computer based project, so completely rearranged my studio, borrowed a loop station, bought a gold guitar and started to ‘jam’. It’s something I’ve never done before. I’ve had days where it’s fourteen hours working constantly in the studio, tweaking buttons and writing code. But it all depends…
MC: So, does each project tend to take you into something new…new tools, new methodology…or do you think you work like that because that’s how you like it, to be an exploration as well as a process?
M: I’m always refining, but the software I wrote is 10 years old now and I’ve been working on the plant project for about 15 years. “Soniferous Eden” is an installation series where interior spaces are transformed into star-studded micro-ecologies, where lush groves of plants generate rich and dynamic soundscapes in response to the touch and presence of the participants, who can saunter barefoot in moist soil amongst them. I’m always working on it, whether the code, concept, or its elements.
M (cont. . .): Every time I do an installation it’s site specific, so never the same, and generally it’s evolved into a variety of different types with focus on various objectives. For example, the dome at the school is a bio-library and sound sanctuary, where I created a pond, dry creek, planted area, and interactive sitting ‘pods’ inside a dome so kids can read and be in a seemingly natural environment, sitting on the ground in a way that is ergonomic and triggers soundscapes when they are still. There is an array of benefits to being around plants and within a ‘high fidelity’ acoustic environment, as R. Murray Schafer would call it (from whose works some of the concepts were modeled)…from helping the parts of the brain dealing with abstract thinking, to developing memory and social skills. It’s argued that attention deficit disorder is a behavioral issue that can be traced to the decrease in natural habitat available to children.
On other projects, such as for Bhutan, more emphasis was on the interactivity with the plants themselves, so I worked on the code of the plant synths, written in SuperCollider, an object-oriented programming language.
I’m not really reinventing at this point, just tweaking and improving. Although, having said that, for these next projects there are significant advancements in the works…it’s like invention. Sometimes I make new sensors and design new sounds, but since my work has spanned quite a variety of stuff from renewables to software to gardens, each one evolves slowly.
MC: Can you tell us a bit about your background and where you are from? And what from this do you think led you to “Tree We’vr”, and working with biofeedback data of plants?
M: I’m from England and grew up in multiple cities (London, New York, Los Angeles) and the countryside equally, so I was exposed to rural and urban environments. I saw The Secret Life of Plants when I was around nineteen, and a couple of years before that Mobius 8 had shown me his work with MIDI and sensors.
M (cont. . .): I had imagined holographic plants (my mum did holography in the 80’s)…which then seemed completely uninteresting since plants THEMSELVES could iterate music.
MC: Have you always had an interest in micro-worlds? What about worlds barely perceptible to us interests you?
M: Yes, micro-worlds…love that. In Suffolk, where I grew up for some time, we had this greenhouse and I remember making this tiny micro-garden in it. I LOVED it and was just mortified when my father told me it needed to be torn down for being unsafe, which he did by getting riotously pissed with his best friend and driving the Range Rover through it.
I have great respect and love for the world and living things. I truly ache for the well being of plants and animals and most people so overall I am dedicated to helping support a healthy ecology, in the holistic sense of the word. And sometimes these ‘hidden things’ are what makes the link to show up the ‘livingness’ and connection we are lacking…the ‘magic’ we need to see and touch to remember that we are a spinning spool of intangible energy organized and perpetuated only by our own existence.
MC: Do you feel your sonification with plants as an instrument, or translation? Can you describe the connection you have with a plant when working with it…is it emotional, scientific, intellectual curiosity…a mix? Is it a dialogue?
M: Nail on the head. My work as an artist is to find the balance between the two. I call it aesthetic sonification, as what you are looking to do is relay data in a way that people understand it, which isn’t necessarily how it iterates, as there are psychoacoustics and other human factors as to how we interpret sound that need to be considered when you are translating information into the sonic realm. So you find a way to relay the information, then make it beautiful for both the human and the plant to be able to enjoy, which is key to art being successful. It’s a balance, and that is my job. That is where I see the necessity for artistry and mastery, and where I try to get it right. The rest is understanding the technicalities.
M (cont. . .): An instrument holds potential as a set of elements and offers a composer/musician that spectrum of potential to weave from. The limitations are the possible manifestations of that potential as choreographed by the degree of expertise of the musician/composer. Sonification doesn’t care about weaving potentials, it wants to be direct as possible. The degree of articulation of the information is a strictly technical matter. So I am somewhere in there, where the sonification is the limitation of the instrument, and the instrument is the plant and interface.
MC: Do you find people understand your work? How much of understanding what you do is important for you to have from your audience?
M: b A whole spectrum of folk come and make use of the installations. Though perhaps not many thoroughly understand my work, most understand the consequence. When I explain what I’m doing I don’t usually get vacant stares, most people follow. I don’t really have an audience, I have participants, so people do a thing, and a thing happens…then they wonder how, and they can find out. Their curiosity leads them on that journey of discovery, and it doesn’t really matter, the issue is plants are alive more than we thought. So long as someone walks away with that, that’s right and good. And if the music and ambience moves them, that’s best.
An instrument holds potential as a set of elements and offers a composer/musician that spectrum of potential to weave from. The limitations are the possible manifestations of that potential as choreographed by the degree of expertise of the musician/composer. Sonification doesn’t care about weaving potentials, it wants to be direct as possible. The degree of articulation of the information is a strictly technical matter. So I am somewhere in there, where the sonification is the limitation of the instrument, and the instrument is the plant and interface.
MC: You mentioned once plants “lacking representation”…I find this intriguing, can you tell us more about this concept?
M: There really isn’t one part of our economy that doesn’t rely on the exploitation of plants, either themselves or their habitat. We have rights for animals, rights for people, and we know we abuse them often, as there are representatives who tell us so. But we don’t often think about the plants, and the plants are also living. They support life, all life almost, so we have to start thinking about that. They are now using ‘excess’ plant energy to power devices. I find this idea of ‘excess’ interesting, like over 90% of our DNA is junk, and 94% of the Universe is ‘dark’. I wouldn’t like to be so assertive.
MC: What tends to happen with the sound from the plants when they are touched? Does it depend on the kind of touch? Does it depend on the kind of plant, or where it is touched? Do plants scream? Or is this anthropomorphizing?
M: Plants emit indicators, best known to be chemical, when they experience threats or distress. The smell of freshly cut grass for example, this is a chemical emitted by the plants to express distress. So ‘screaming’ is an anthropomorphic viewpoint on that possibly unemotional ‘response,’which is what plant biologists would commonly call it. This is because we don’t understand plant biology well. They have systems to take in a calculate information, make decisions, and produce self-regulated results, but we have a hard time figuring that out since it isn’t in the form of what we say is required of sentient beings… a nervous system and a brain. But no, it doesn’t matter where you touch a plant, that doesn’t make different sounds, at least that I can tell. I don’t have scientific instruments, I have arty ones, so they aren’t accurate enough to make precise measurements or declarations. I’m in the experience, not research department. The synths I’ve written are modulated by the current from the plant, so the sound changes in direct function of the modulation of the current, which changes with touch or presence and general livingness.
[. . .]
MC: You go way beyond trend or gimmick, you have been doing this a while. Where do you think your work is going? Do you have more in this vein to explore…is it leading somewhere you can share with us?
M: I’m currently working with Eden Labs and some other partners at UCSD on a project engaging custom made technology to hybridize with living systems, forging lucid and direct connections between the inner city and wild ecologies in real time.
All images courtesy of the artist
Maile Colbert is a multi-media artist with a concentration on sound and video who relocated from Los Angeles, US to Lisbon, Portugal. She is a regular writer for Sounding Out!