Problem Description

While Virtual Reality (VR) transports users to entirely new worlds, Mixed Reality (MR) aims to weave digital content into our physical surroundings. A significant challenge in current MR interaction is the lack of haptic feedback. While hand tracking allows for “natural” gestures, grasping “air” lacks the tactile response of weight, texture, and resistance. Tangible interaction adds direct manipulation of virtual content via physical everyday objects.

Project Definition

Students will design and prototype an Augmented Reality (AR) experience on Meta Quest that uses tangible interaction: physical objects or gestures in the real world that directly control or influence virtual content. The goal is to explore how mixing real, touchable objects with digital overlays can make AR more intuitive, engaging, and understandable, leading to stronger sense of presence and embodiment. The student will develop a prototype where passive physical objects (props, cubes, tools, or toys) serve as input devices for a digital application.

Learning Outcome

Students will:

• Understand the principles of tangible user interfaces (TUIs) in AR
• Implement a small project idea that explores interacting within the Augmented Reality Environment using TUIs
• Explore Meta Quest capabilities: passthrough, hand tracking, controllers, spatial anchors
• Conduct a small user evaluation to assess usability and user experience.

Participation Requirements

Basic knowledge of Unity preferably for the creation of Virtual or Augmented Reality Applications.

External Partner

If there is an external partner, give the contact person(s) and a brief description here; otherwise leave blank