Developement of an interactive learning system






This controller is an electronic music production learning system based on multimodal interaction with a computer. It is designed to provide fast access to music production by introducing the most widely used audio- and MIDI-effects in electronic music, inspiring one to start producing of their own. Electronic learning systems are spread widely over the market nowadays. In the music industry, key lighting keyboards and fret lighting guitars offer beginners a coordinated training for the first steps of their musical education. This MIDI controller provides the same learning effect for people interested in electronic music production.



Instead of a light learning system, this controler uses verbal commands to communicate with the user. It was designed to be multimodal.
“An interactive multimodal learning environment is one in which what happens depends on the actions of the learner. In short, the defining future of interactivity is responsiveness to the learner’s action during learning.“ (Mayer, Richard and Moreno, Roxana: Interactive Multimodal Learning Environments, Special Issue on Interactive Learning Environments: Contemporary Issues and Trends, Springer Science + Business Media, 2007, p. 2) Furthermore the program contains three musical genres the operator can choose from, Dubstep, Techno, and Minimal. To provide maximum flexibility it is possible to repeat or change the genre at any point in time.



The MIDI-Controller is connected to the Program Max MSP through an ARDUINO UNO Board. The Max Match sends MIDI values out to Ableton Live were audio is triggered and effects can be controlled.



For further interactivity LEDs, switches, and rotary controls may be added to the controller. To provide a higher learning effect other features can enhance the multimodality of the system. In addition, a visual user interface can be added to the verbal commands. The user will then receive visual and auditory feedback from the controller, which could enhance the training effectiveness.


made with Fritzing:
FH Potsdam, Friends-of-Fritzing foundation and IXDS, URL www.fritzing.org



Live visuals: Projection mapping

Projection mapping is the process of creating live visuals on 3D surfaces. Especially for music events and exhibitions those installations are a real eye catcher.

Impressions of projection mapping: Live visuals mapped onto cubes.