Be good. Do good.

Tag Archives: create

Meet the Dreamer, my new interactive art project, which I have just started to prototype.

This illuminated sculpture aims to make us more aware of the characters who live inside our heads, and how our emotions influence the way we perceive the world around us.

The Dreamer’s head lights up with rear-projected videos of some of the characters who influence us, along with memories and feelings that fill in our minds, day and night.

To show what the Dreamer is thinking, our first prototypes will display images of people and nature, sparking different moods, each represented by a different color, as shown below.

The Dreamer’s emotions can be shown with different colored lights, such as: red for anger, orange for fear, yellow for happiness, green for surprise, blue for sadness, purple for love, for example.

You can change the Dreamer’s worldview by pressing buttons to make him/her more happy or sad, angry or kind, fearful or curious (like social media emoticons). In response, the Dreamer’s head lights up with different colors and facial expressions, as these emotions are activated in his/her mind.

This kinetic sculpture can give us a glimpse at what goes on inside our heads, as images of our lives pass by, fleeting like clouds in the sky, colored by our moods. The Dreamer’s quiet face keeps transforming, responding to new images and emotions with images and sounds of its own.

As times goes by, we see the interplay of the forces that drive us: anger can turn into love, sadness into joy, fear into curiosity. And we can learn how changing our emotions can transform how we view the world.

Development

We are just getting started on this project, so we don’t have precise specs yet. We will add them here soon, after we’re done experimenting with our first prototypes. The small AAXA P2B projector we’re using seems to work best about 24″ away from a standard 6″ wide mask. And the mask’s illumination varies based on your viewing angle, so we may want to make it rotate a bit from left to right, using a motorized turntable, as shown below.

The current plan is to first sculpt a clay mask for the head (the prototype shown below was made from a life mask of my own head), flattened it a bit at the mouth, eyes and forehead, then vacuum-form that mask with translucent white plastic, so that we can rear-project a variety of faces onto that slightly opaque form.

Products

This interactive art piece will be presented in different ways:

• as part of the Time Machine we’re building at Pataphysical Studios (see photo below)

Research

In previous experiments conducted in summer 2016 by Fabrice Florin and Jean Bolte, we attempted to bring characters to life by projecting videos of human faces onto ‘life casts’. For these first tests, we projected some of Fabrice’s interviews with Jean’s daughter Natalina and our friend Mark Petrakis onto the David Bowie and Sean Connery life casts, as well as on a plain mannequin head and mask.

We think we can apply this projection mapping technique to the Dreamer project by combining full face projections with images of what the characters are thinking. For the Time Machine, we can project re-enactions of historical figures, against masks or heads set in a dark box behind of the Time Machine’s porthole. Opening the porthole would reveal an animated face from the past or future, which would speak to you for a moment, across time and space.

Here are some of our observations from those first tests:

• this technique works well to bring characters to life

• it creates the illusion that you are seeing a real person

• aligning the faces from the videos with the life casts can be tricky

• we may need to hold the actor’s heads to keep them aligned while we shoot

• getting the eyes, nose and mouth to match may require adjusting the video as well

• some interesting expressions come out when the faces are not perfectly aligned

• people can be made to look older or younger, depending which cast you use

• when the face looks straight at the camera, you really feel that it is talking to you

• some facial expressions work really well, like shifting eyes left and right

• some interesting effects can be created by speeding up the footage, as in Max Headroom

In our next experiments, we will play with different ways to align the projected image and the life cast, and make it all work in a small space.

Next Steps

We will start by experimenting with medium-size heads (8-inch high), to develop the characters and their interactions. These prototypes would be shown in a toy theatre (about 2 feet square).

Future versions could let us open the Dreamer’s head to see the characters that lurk inside and drive her emotions. These characters could be moved or replaced at will, to change the influence they have on the Dreamer. For those versions, we can adapt the customizable robot kits we developed in our Maker Art classes.

In the next phase, we could create larger versions of the Dreamer for street theater performances, in public settings such as marches or fairs. For those larger version, we could re-use the same trailer we built for the Art Float, which could support a large puppet as high as 8-feet tall.

We can create fun interactive experiences with the Dreamer as a focal point. In “Share Your Dream”, we would invite you to become the Dreamer for a moment, and project your own face inside its head. You would then tell us about your dream and we could record you on video.

The Dreamer invites us to better understand how our emotions make us perceive the world in different ways. It can show us how to replace our destructive emotions with a more positive outlook.