Proceedings of the
9th International Conference of Asian Society for Precision Engineering and Nanotechnology (ASPEN2022)
15 – 18 November 2022, Singapore

AI-enhanced Multifunctional Haptic Rings for Cross-space Perception and Sensation in Metaverse

Zhongda Sun1,2,3, Minglu Zhu1,2, Tianyiyi He1,2, Xuechuan Shan3,4, Boon Keng Lok3,4 and Chengkuo Lee1,2,3,a

1Department of Electrical & Computer Engineering, National University of Singapore, 4 Engineering Drive 3, 117576, Singapore

2Center for Intelligent Sensors and MEMS, National University of Singapore, 4 Engineering Drive 3, 117576, Singapore

3Singapore Institute of Manufacturing Technology and National University of Singapore (SIMTech-NUS) Joint Lab on Large-area Flexible Hybrid Electronics, National University of Singapore, 4 Engineering Drive 3, Singapore 117576, Singapore

4Printed Intelligent Device Group, Singapore Institute of Manufacturing Technology, Agency for Science, Technology and Research (A*STAR), Singapore 637662, Singapore


Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of the triboelectric and pyroelectric sensor for tactile and temperature perception, and the vibrator and nichrome heater for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.

Keywords: Metaverse, Human-machine interfaces (HMIs), Gesture recognition, Haptic feedback, Self-powered sensor

PDF Download