Proceedings of the
9th International Conference of Asian Society for Precision Engineering and Nanotechnology (ASPEN2022)
15 – 18 November 2022, Singapore
doi:10.3850/978-981-18-6021-8_OR-08-0102
AI-enhanced Multifunctional Haptic Rings for Cross-space Perception and Sensation in Metaverse
1Department of Electrical & Computer Engineering, National University of Singapore, 4 Engineering Drive 3, 117576, Singapore
2Center for Intelligent Sensors and MEMS, National University of Singapore, 4 Engineering Drive 3, 117576, Singapore
3Singapore Institute of Manufacturing Technology and National University of Singapore (SIMTech-NUS) Joint Lab on Large-area Flexible Hybrid Electronics, National University of Singapore, 4 Engineering Drive 3, Singapore 117576, Singapore
4Printed Intelligent Device Group, Singapore Institute of Manufacturing Technology, Agency for Science, Technology and Research (A*STAR), Singapore 637662, Singapore
ABSTRACT
Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of the triboelectric and pyroelectric sensor for tactile and temperature perception, and the vibrator and nichrome heater for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.
Keywords: Metaverse, Human-machine interfaces (HMIs), Gesture recognition, Haptic feedback, Self-powered sensor
1Department of Electrical & Computer Engineering, National University of Singapore, 4 Engineering Drive 3, 117576, Singapore
2Center for Intelligent Sensors and MEMS, National University of Singapore, 4 Engineering Drive 3, 117576, Singapore
3Singapore Institute of Manufacturing Technology and National University of Singapore (SIMTech-NUS) Joint Lab on Large-area Flexible Hybrid Electronics, National University of Singapore, 4 Engineering Drive 3, Singapore 117576, Singapore
4Printed Intelligent Device Group, Singapore Institute of Manufacturing Technology, Agency for Science, Technology and Research (A*STAR), Singapore 637662, Singapore
ABSTRACT
Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of the triboelectric and pyroelectric sensor for tactile and temperature perception, and the vibrator and nichrome heater for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.
Keywords: Metaverse, Human-machine interfaces (HMIs), Gesture recognition, Haptic feedback, Self-powered sensor
