Computer Science > News > From Haptic to Thermal Technologies: Inside Dr. Jin Ryong Kim’s Multimodal Interaction Lab and How it is Revolutionizing How We Interact in VR

From Haptic to Thermal Technologies: Inside Dr. Jin Ryong Kim’s Multimodal Interaction Lab and How it is Revolutionizing How We Interact in VR

Dr. Jin Ryong Kim and his innovative team at the Multimodal Interaction Lab (MI Lab) have recently garnered acclaim for their groundbreaking advancements in haptic and thermal technologies. Their exceptional contributions have been recognized with several prestigious awards, highlighting their transformative work in these dynamic fields.

At the IEEE Haptics Symposium 2024, Dr. Kim and his students were awarded the Best Demonstration honorable mention for their presentation on “Thermal Masking.” This phenomenon, also displayed at the 2024 ACM Conference on Computer Human Interaction (CHI) in Hawaii, showcases a novel thermal illusion where thermal referral completely masks the original thermal sensation, leaving only the tactile site to register thermal feedback.

The MI Lab team conducted three experiments using precise thermal and vibrotactile actuators on human arms. These experiments revealed crucial insights into how thermal masking operates. Picture the feeling of a gentle yet assertive vibration overpowering a subtle warmth, effectively shifting the sensation of heat from one location to another. This revelation challenges existing perceptions of thermal referral by demonstrating a strong tactile signal can completely dominate thermal sensations. Such findings not only deepen our understanding of thermal perception, but also open up exciting possibilities for developing advanced, immersive thermal user interfaces.

“By delving into how tactile sensations can override thermal perceptions, we aim to create more immersive and responsive user interfaces,” Dr. Kim explained. “Our work holds promise for revolutionizing applications in virtual reality, medical simulations, and beyond, creating experiences that feel almost tangible.”

In addition to their achievement at the IEEE Haptics Symposium, the MI Lab team was honored with the Best Demo Award at the 2023 ACM Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH) Asia Emerging Technologies in December 2023. At this event, they unveiled their latest innovation: the FIRE display (click here to watch a video of the display). This mid-air display seamlessly combines thermal and ultrasound haptic technologies to deliver compelling virtual reality (VR) experiences. The FIRE display allows users to feel the searing heat of a virtual flame, the soothing warmth of steam or the gentle flicker of candlelight in real time, creating an immersive and tactile VR environment.

“We are deeply honored to receive recognition from ACM SIGGRAPH Asia for our work on the FIRE display,” Dr. Kim said with enthusiasm. “We aim to continually push the boundaries of VR technology, making virtual experiences more realistic and engaging. This award reflects the dedication and creativity of our entire team.”

Dr. Kim and his team’s ongoing exploration into multimodal interaction not only underscores their recent achievements but also illuminates their potential to spark transformative changes in VR, haptics, and beyond. The MI Lab’s commitment to research and innovation ensures the future of these fields is brimming with exciting possibilities and breakthroughs.