Pick Up Here, Place Over There
Curated interactive space designed for public installation
Timeline
Aug 23 - Dec 23
Recognition
The project was highlighted in Professor Daniel Rosenberg Munoz’s recent publications to ISMAR: “The Five Spatial Elements: A Framework for Spatial Interactions in MR”
Received the 2024 Samuel Rosenberg Award from the School of Art
Material
Projector, OptiTrack inferred cameras, retroreflective markers, Unity, Procreate
Formally named Into the Garden, this illustrated space is being projected from the ceiling and the illustrations will shift and change according to the player’s interaction and movement. The mission is to carefully pick up the flowers on the ground and place them on the table.
As shown in the storyboard, the plate that the player holds has three retroreflective markers attached. The OptiTrack cameras set up in the room will be able to track the position of the markers as the player moves around the room. Through Motive software real-time motion data is sent through internal PC routing into Unity. Using this data I have coded different interactions the player can do with the projections and the location of the plate.
The last two interactions above got combined into one in the final project. Here are the demonstrations:
1. Pick up
When the player kneels down to pick up the flower projection with the plate, the flower transformation animation will be triggered. When the player walks away, the picked up flower projection will travel with the player and it will disappear from the ground.
2. Set down
When the player places the plate on the table, the flower will fall off the plate onto the table and player can walk away to continue their exploration.