Pick Up Here, Place Over There

Curated interactive space designed for public installation

Timeline

Aug 23 - Dec 23

Recognition

The project was highlighted in Professor Daniel Rosenberg Munoz’s recent publications to ISMAR: “The Five Spatial Elements: A Framework for Spatial Interactions in MR”

Received the 2024 Samuel Rosenberg Award from the School of Art

Material

Projector, OptiTrack inferred cameras, retroreflective markers, Unity, Procreate

 

Formally named Into the Garden, this illustrated space is being projected from the ceiling and the illustrations will shift and change according to the player’s interaction and movement. The mission is to carefully pick up the flowers on the ground and place them on the table.

As shown in the storyboard, the plate that the player holds has three retroreflective markers attached. The OptiTrack cameras set up in the room will be able to track the position of the markers as the player moves around the room. Through Motive software real-time motion data is sent through internal PC routing into Unity. Using this data I have coded different interactions the player can do with the projections and the location of the plate.

The last two interactions above got combined into one in the final project. Here are the demonstrations:

1. Pick up

When the player kneels down to pick up the flower projection with the plate, the flower transformation animation will be triggered. When the player walks away, the picked up flower projection will travel with the player and it will disappear from the ground.

2. Set down

When the player places the plate on the table, the flower will fall off the plate onto the table and player can walk away to continue their exploration.

Full Interaction Demonstration

 
Previous
Previous

Context-aware systems

Next
Next

Stack