Immersive HCI Techniques

HCI, IoT

With the development of sensor and mobile computing technologies, IoT devices have become an integral part of our daily lives. From smart homes and wearable devices to industrial automation and healthcare monitoring, these devices are transforming the way we interact with the world around us. Our research scope spans a broad spectrum of aspects, including sensor design, algorithm development, and empirical user studies. We explore innovative sensor technologies that can be embedded directly into IoT devices, enabling rich and responsive interactions. Our algorithm work focuses on optimizing the signal-processing and machine-learning pipelines to process the sensory data. Additionally, we conduct comprehensive technical evaluations and user studies to understand the needs and preferences of users, guiding the design of our interaction techniques to be both practical and user-friendly.

Related publications:

  • [PerCom’24] Linfei Ge, Wentao Xie, Jin Zhang, Qian Zhang, “BLEAR: Practical Wireless Earphone Tracking under BLE protocol”. 2024 IEEE International Conference on Pervasive Computing and Communications, Biarritz, France, 2024

  • [IoTJ’24] Linfei Ge, Qian Zhang, Jin Zhang, and Huangxun Chen, “EHTrack: Earphone-Based Head Tracking via Only Acoustic Signals”, IEEE Internet of Things Journal, 11 (3), 2024.

  • [IMWUT/UbiComp’23] Wentao Xie, Huangxun Chen, Jing Wei, Jin Zhang, Qian Zhang, “RimSense: Enabling Touch-based Interaction on Eyeglass Rim Using Piezoelectric Sensors”, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 7 (4), 2023

  • [IMWUT/UbiComp’21] Wentao Xie, Qian Zhang, Jin Zhang, “Acoustic-based Upper Facial Action Recognition for Smart Eyewear”, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5 (2), 2021

  • [IMWUT/UbiComp’20] Linfei Ge, Jin Zhang, and Qian Zhang, “Acoustic Strength-based Motion Tracking”, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4(4), 2020.

Acoustic Strength-based Motion Tracking

Acoustic-based Upper Facial Action Recognition for Smart Eyewear

RimSense: Enabling Touch-based Interaction on Eyeglass Rim Using Piezoelectric Sensors

HCI IoT