Orion
A hand-tracked AR assistant prototype. A small pod sits on your open hand, and you talk to it: say a keyword and it responds by showing or hiding parts of its interface.
- Role
- Solo developer
- Tool
- Lens Studio (Snap AR)
- Input
- 3D hand tracking, voice
- Year
- 2023
2 problems, 2 answers.
Keep the pod resting on the hand as the hand moves.
ApproachA script reads the hand's world position from Lens Studio's 3D hand-tracking machine learning module, adds an offset, and writes the result as the pod's world position every frame.
The script is attached to the pod's component, so the pod has no idea the hand exists; it just follows a target.
Let the user talk to Orion with voice commands.
ApproachVoice recognition uses SystemVoiceCommand. Each keyword has its own script, and inside it a set of smaller scripts, such as hiding and unhiding components, runs when the keyword is heard.
Splitting one script per keyword keeps each command readable and makes adding a new phrase a copy-and-rename job.