Instituto Stocos collaborate with Università degli Studi di Genova (UNIGE), Casa Paganini – InfoMus lab in this ICT European Project providing a real time auditory display of several high level body movement expressive features extracted by the Infomus team using the eyesWeb programming environment. The main goal of these interactive sonifications, is to be able to supersede the visual perception of the dance movements with the auditory feedback.
INSTITUTO STOCOS has developed several sonifications of movement qualities for this project that have been presented in events like SONAR festiva among others.
DANCE dimensions, strongly integrated and interacting, are the following:
1. Inclusion and rehabilitation. Interactive sonification and musicalization of choreutic movement (processing of sound spaces and ways of using affective music content in relation to the quality of gestures) investigates forms of sensory substitution: to see through listening. Testing new perceptual experiences of body movement in the dark implies the possibility of rapprochement and sharing (of spaces and emotions) between visually impaired and sighted people.
2. Scientific and technological research. Neuroscience studies on brain plasticity in sensory substitution at University of Maastricht will be combined with studies at Casa Paganini-InfoMus on technologies capable of seeing emotional qualities and social indicators of movement, interpreting them as techniques for searching data in digital archives (e.g. sound, music, visual archives), and with research on interactive sonification at KTH.
3. Artistic research and production. The choreography itself creates the music: dance can be conceived as musical composition (or re-composition, interpretation), changing its traditional dimension into an eminently or exclusively listening experience: Gesture, as an aesthetic object, is experienced as a sounding object.
CONSORTIUM:
Università degli Studi di Genova (UNIGE), University of Maastricht (UM), Kungliga Tekniska Hoegskolan (KTH).