Soul

Soul was created by a team of 5 for the 2023 Meta Presence Platform Hackathon. Participants were tasked with creating a Mixed Reality app for the Quest Pro HMD that utilized the latest Meta SDKs.

The Idea

Use MR to bring the physical objects in our homes to life.

What It Does

Soul provides greater expression for physical, real-world objects by giving them interactive personas with faces, voices, and simulated emotions. Curious what it feels like to be a chair? Just ask.

How It Works

On each of your finger tips is a unique persona waiting to give voice to potential objects in your world. Using your opposite hand, pinch a persona off a fingertip and place it on an object. To interact, look at the object's new face and use gestures or words to communicate with it like you would a person.

How It's Built

• Eye tracking uses the Movement SDK
• Hand tracking and gesture recognition uses the Interaction SDK
• TTS and Dictation uses Voice SDK
• Ability to see surroundings uses Passthrough SDK
• Object persistence uses Spatial Anchors
• AI generated language uses GPT4