BreathAR

BreathAR: Leveraging Breathing as a Hands-free Interface for Augmented Reality.

It is about a new AR interaction modality that interfaces with breathing as the directly controlled signal.

Since the experience of typical AR interfaces based on interaction modalities like hand gestures and voice is not perfect. Users often face problems like a slow response, and easy misoperation, and find it difficult to interact with distant objects. To solve these issues, We utilize the rich interaction space in breathing and built a detection model and a user interface. with our system, users can achieve all AR interactions quickly, accurately, efficiently, and intuitively through breathing.

We have built this system on Hololens2 that allows us to perform all basic UI operations such as select, click, zoom, scroll and rotate.