Panemoticon observes your behavior, makes a few inferences about your emotional state, and plays music to match your mood.
Your mouse/trackpad use — for example, the speed, breadth, and frequency of your gestures — says a lot about your energy level, confidence, and perceived control over your environment. By tracking and analyzing this data we can begin to create an image of your mood. Panemoticon then generates music by adjusting properties such as tonality (major/minor), harmonic complexity, rhythmic complexity, tempo, timbre (the "texture" of the sound) and proximity (that is, distant or in-your-face).
We can also use this mood data in aggregate form to calculate a collective mood for all Panemoticon-using visitors to a given site.
In personal mode the add-on plays music based on your current mood. Your mouse movements will be tracked and analyzed, and the calculated mood data (valence, arousal, dominance values) will be used to generate music. This mode is offline; there is no network communication. Mood data will be stored on your local machine, though without any personal identifying information.
In collective mode the add-on plays sounds based on aggregate response to the currently displayed website. Your mouse movements will be tracked and analyzed, and the calculated mood data (valence, arousal, dominance values) will be sent to the server to calculate the mood of the site. No identifying information is stored.
In sleep mode, the add-on is practically disabled. There is no sound, no network communication, and no mouse tracking.
Panemoticon is a 2012 commission of New Radio and Performing Arts, Inc. for its Turbulence web site. It was made possible with funding from the National Endowment for the Arts. Created by Ali Miharbi and John Priestley.