papers

Bodily Listening

Toronto Electroacoustic Symposium 2010

weblink

 In 2006 I was traveling in Switzerland. One day I built a tent at a lakeside and during the night it started to rain, when I was lying in a sleeping bag in the dark. Tiny raindrops were hitting the roof of the tent softly. I could also hear the sound of rain dropping on leaves of trees around the tent. I also felt like I was able to listen to the sound of raindrops falling onto the surface of the lake. Although I didn’t even touch or see the raindrops, the feel of the tiny drops was intimately tangible. The membrane of the roof of the tent was synchronized in my imagination with my feel of skin and became a sort of second skin. It was warm and comfortable in the sleeping bag. I was physically divided from the environment, however my awareness of the bodily sensation was expanded to the outside of the sleeping bag and into the environment around me. The liquidity of the raindrops and the tension of the membrane were vividly tangible. The only trigger for this sensation was sound. It was a highly intimate bodily experience of the sound. From this inspiring experience I developed the piece Sound Capsule.

When lying in the capsule, the visitor can listen to the clear sound field from the loudspeakers beside both ears. Vibrotactile stimuli can be perceived at different locations of the body through six vibrotactile transducers. […]

 

– – – – – – – – – – – – – – – – – – – – – – – –

 

Sonic art for intersensory listening experience

electroacoustic music studies conference 2014

full text PDF

 

Abstract

In recent years, the relationship between sound and the human body became a more important topic for musicians and artists. In total, there has been much artistic research dealing with inter- sensory perception between sound and image, but relatively little dealing with audio-haptic relationships in art and music. This paper attempts to provide a theoretical framework of audio-haptic experiences by examining work utilizing space, the somatosensory system, and electroacoustic music.

In the history of sound art the establishment of sound installation was an important epoch, which deals with the auditory space perception involving audience’s active physical participation. Audience experiences the auditory constructed space in specific location having chance to react actively by walking in/around it. The audience’s corporeal activity becomes an essential part of the whole experience of sound installation, however, the awareness of bodily perception appears rather as result of the required physical involvement for the spatial aural experience. The main issue remains to listen to the external space.

The clear focus on the bodily perception stimulated by sound was developed by works with intension to involve our somatosensory system. The differentiation between sound installation and the types of works, which involves audio-haptic perception, can be pointed regarding the definition of the space. While sound installation deals with the external space, the latter concentrates on the inner space of the body. The “inner” space of the body can be defined as the sensorial space, which you can perceive through haptic. It involves medium (skin tissues, flesh and bones) and signal transmission in the nervous system. Vibrotactile stimuli cause mechanical deformations of the skin tissues and it is perceived by mechanoreceptors, which are located in different layers of skin tissues. Furthermore vibrotactile stimuli can be mediated through bone conduction directly to inner ear without exciting tympanic membrane and one can “hear” the vibro-tactile sonic signal.

Technically vibro-tactile stimuli can be generated by subwoofer and so called vibro- acoustic transducer. The tactile sonic wave generated by these two types of devices differs in its means of transmission: Subwoofer uses air borne sound transmission in low frequencies and transducer mediates sonic vibration directly to the body surface.

Electroacoustic composition plays a central role for the development of this type of artistic approach. Beside the fact that electroacoustic musicians (or collaboration with EA musician) have been developing it, methods of composing and playing EA music can be perfectly integrated to the creative process. Sonic wave covers in nature not only audible range but also haptically perceptible frequency range. Sound generation method by electro acoustic music can contribute active and flexible control of the haptic signal, in particular vibrotactile stimuli in frequency and intensity.

Work examples “Sonic Bed” by Kaffee Mathews (2005), “STiMULiNE” by Lynn Pook/Julien Clauss (2003), and “Sound Capsule” by this paper’s author (2008) have different types of technical application in order to mediate the sonic wave, however, they all use electroacoustic music as their source material and core intention is to mediate the sound to the body.

The foundation of the sensory model, which appears characteristically at the works, is the relationship between auditory and haptic modalities. This interaction between auditory perception and haptic suggests a new ground of musical space – the integration between imaginary (musical) space and physical (corporeal) space. Musical imagination, which is established through the long history of aural culture, coexists here with the corporeal awareness. Further application of this type of works, for instance for live performance of electroacoustic music, integration of the emotional response of the audience by means of psychophysiology and biofeedback, or compositional collaboration with electroacoustic musicians can extend the diversity of the audio- haptic sonic experience.


all rights reserved / satoshi morita 2008-2017