Moving Sound Pictures is about all these questions posed above. It is about the mixture of visual arts and music. In this project, users have the opportunity to interactively explore paintings by known and contemporary visual artists through playful actions and new technologies.
Use your body to shift, enlarge or downsize objects of the paintings in a virtual-reality (VR) environment and make music with these objects!
Get information about the painting and the artist such as historical aspects of the artwork, painting techniques, etc. Pictures become audible and a new musical instrument emerges! Everyone can create their artworks individually and discover the artwork from another perspective!

Blog – Moving Sound Pictures

Part I The Abstract Painters

In the first phase of this project paintings by Kandinsky, Lissitzky, Mondrian and Malevich were implemented in a virtual gallery where the user had the chance to “jump” in the paintings and interact with them. Additionally the user had the opportunity to have an implemented audio guide (like in a museum) where information about the artist and the artistic work were provided.

The Abstract Painters are available as a free app in Viveport

Download here: https://www.viveport.com/6ac96be9-c45b-40bc-b5ff-24b4d0b7dd2d

Part II Dali's Persistence of Memory

Salvador Dali’s “The Persistence of Memory” has been adapted to a VR environment consisting of Flex Objects with which the user can interact. The user, who wears a VR headset and holds controllers in his hands (HTC Vive or HTC Vive Pro) can move around in this environment and can teleport himself to a different position in this virtual landscape. Unlike to most VR experiences where the user is limited into walking around in the scenery, in this installation the user has the chance to interact with different objects of the painting. Some of them are used as musical instruments, others, such as the melting clocks, are used as objects for controlling music and sounds. A creature in the middle of the painting observes and follows the user who is moving around.

Projektleitung: Dr. Konstantina Orlandatou

konstantina.orlandatou@hfmt-hamburg.de