Project Name: Magic-Tap: A Kinematics-Driven Virtual Hand Selection Technique in AR/VR
Authors: Ruyang Yu, Yixuan Liu, Zijian Wu, and Tao Luo
DOI: 10.1109/TVCG.2025.3549044
Programming Language: C#
Game Engine: Unity3D 2020.3.37f1c1
IDE: Unity Hub
Necessary SDK or Plugins: MRTK 2.8
Operating System: Windows 10 and Above
HMD: Quest 2, Quest Pro or Quest 3
-
Download Unity Hub and install Unity 2020.3.37f1c1.
-
Clone the project from GitHub and open it in Unity Hub using the correct Unity version.
-
The required MRTK components are already configured, so the project can be run directly.
-
If you need to modify the code:
- Install Visual Studio or another C# development IDE.
- If using Visual Studio, install the "Game Development with Unity" workload via the Visual Studio Installer.
- Connect your PC and VR headset using a data cable.
- Launch Quest Link on your PC and enter the Quest Link interface in your VR headset.
- Open the scene (
Assets/Scenes/show) in Unity and click the Play button to run it.
Once inside the 3D scene, you will see two vertically aligned balls in front of you.
- Use your right index finger to interact with the blue ball at the bottom.
- When successfully triggered:
- The color-change ball above will change color.
- The system will provide audio feedback.
Note: This program is interactive and relies on real-time tracking of virtual hand movements to detect user intent. A pre-scripted playback is not possible. We provide the following demo to showcase the interaction process.
If you want to modify the configuration parameters for Magic-Tap, follow these steps:
- Locate the AcceStimulate Script attached to the following GameObject in the demo scene:
/show/showball/magic - Adjust the script parameters:
- Alpha → Acceleration threshold parameter.
- Beta → Speed threshold parameter.
This software is available for free non-commercial and academic use only.
Commercial use requires explicit permission from the authors.