This installation explores how public spaces, interior spaces
can “embody” emotional states of the persons in the space. The built
environment is generally considered neutral and without sentience. Whereas
integration of sensing systems, the environmental space can exhibit presence,
where it can appears to respond to emotions expressed by the population.
Cameras strategically situated in a gallery and public space
detect faces in the field. Emotion recognition software developed for this work
transmits to a cloud-based detection emotion API where captured images are
analyzed for a weighted response of the seven basic emotion states. Emotion
states are averaged over a short time interval to create a composite of the
emotions detected. The pattern states of lights are modified based on this
composite emotion states over time
The traffic signals, display a series of patterns that range
from all red, to all yellow to all green, with varying in-between states. The
patterns will also display intermediate behaviors with randomized arrangements.
The installation has options for audio response. The audio
componenet is a version of a “Musikalisches Würfelspiel” – a dice game that
selects phrases of music and constructs a composition that is emergent and
generative. In our iteration, musical phrases will also be classified based on
“emotional tone” and driven based on a limited random variabilityand the
emotions detected in participants faces.