Skip to main content

Interacting with Sound

Joint work with Max Meier where we investigated how novice users, who often have no prior musical knowledge, can create harmonic melodies during a brief encounter with music applications in public spaces without a prior training phase. We presented this work at NIME, CHI, Pervasive and at advertising fair komma.

  • Musical interaction
  • Interaction design
  • Kinect sensors
  • User research

We investigated how people can use an interactive public display and touchless gestures to control music and create harmonic melodies, such as familiar advertising jingles. The underlying software solution was a technique of algorithmic composition based on soft constraints developed by Max Meier. My contribution to the project was conception, interaction design and user research.

Image caption