Antti Sand
Ismo Rakkolainen
Poika Isokoski
ABSTRACT
Virtual and physical worlds are merging. Currently users of head-mounted displays cannot have unobtrusive tactile feedback while touching virtual objects. We present a mid-air tactile feedback system for head-mounted displays. Our prototype uses the focus of a modulated ultrasonic phased array for unobtrusive mid-air tactile feedback generation. The array and the hand position sensor are mounted on the front surface of a head-mounted virtual reality display. The presented system can enhance 3D user interfaces and virtual reality in a new way.
To evaluate the tactile feedback together with visuals on an Oculus Rift VR headset, we had 13 participants do a simple virtual keypad tapping task with and without tactile feedback. The results indicate that while the measured speed and accuracy differed only a little, the subjects were nearly unanimous in that they preferred to use the tactile feedback. The "raw" NASA TLX questionnaires conducted after use revealed that the participants felt slightly less mental, physical and temporal demand with the tactile feedback. The participants' self-assessment of their performance was also higher with the tactile feedback.
- Billinghurst, M., Bowskill, J., Dyer, N. and Morphett, J. 1998. Spatial Information Displays on a Wearable Computer. IEEE Computer Graphics and Applications 18, 6, 24--31. Google Scholar
Digital Library
- Bowman, D., Kruijff, E., LaViola, J. and Poupyrev, I. 2004. 3D User Interfaces: Theory and Practice. Addison-Wesley, Boston, MA, USA. Google ScholarDigital Library
- Carter, T., Seah, S., Long, B., Drinkwater, B. and Subramanian, S. 2013. UltraHaptics: Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. In Proceedings of the UIST 2013 Conference, ACM, 505--514. Google ScholarDigital Library
- Foulsham, T., Walker, E. and Kingtone, A. 2011. The where, what and when of gaze allocation in the lab and in the natural environment. Vision Research, 51, 1920--1931.Google ScholarCross Ref
- Freeman, E., Brewster, S. and Lantz, V. 2014. Tactile Feedback for Above-Device Gesture Interfaces: Adding Touch to Touchless Interactions. In Proceedings of the ICMI 2014 Conference, ACM, 419--426. Google ScholarDigital Library
- Gupta, S., Morris, D., Patel, S. and Tan, D. 2013. AirWave: non-contact haptic feedback using air vortex rings. In Proceedings of the UbiComp 2013 Conference, ACM, 419--428. Google ScholarDigital Library
- Hart, S. G. 2006. NASA-Task Load Index (NASA-TLX); 20 Years Later. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting. HFES, 904--908.Google ScholarCross Ref
- Hasegawa, K. and Shinoda, H. 2013. Aerial display of vibrotactile sensation with high spatial-temporal resolution using large-aperture airborne ultrasound phased array. In Proceedings of the World Haptics Conference 2013, IEEE, 31--36.Google Scholar
- Hoshi, T., Abe, D. and Shinoda, H. 2009. Adding Tactile Reaction to Hologram. In Proceedings of the RO-MAN 2009 Conference, IEEE, 7--11.Google Scholar
- Inoue, S., Kobayashi-Kirschvink, K., Monnai, Y., Hasegawa, K., Makino, Y. and Shinoda, H. 2014. HORN: the hapt-optic reconstruction. In Proceedings of the SIGGRAPH 2014 Conference, Emerging Technologies, ACM, Article 11. Google ScholarDigital Library
- Iwamoto, T., Tatezono, M. and Shinoda, H. 2008. Non-contact method for producing tactile sensation using airborne ultrasound. In Proceedings of the EuroHaptics 2008 Conference, Springer-Verlag, 504--513. Google ScholarDigital Library
- Ku, J., Mraz, R., Baker, N., Zakzanis, K., and Lee, J. H. 2003. A Data Glove with Tactile Feedback for fMRI of Virtual Reality Experiments. CyberPsychology & Behavior. October 2003, 6(5), 497--508.Google Scholar
- Lenhardt, M. 2008. Airborne ultrasonic standards for hearing protection. In Proceedings of the 9th International Congress on Noise as a Public Health Problem, ICBEN.Google Scholar
- Long, B., Seah, S., Carter, T. and Subramanian, S. 2014. Rendering Volumetric Haptic Shapes in Mid-Air using Ultrasound. ACM Transactions on Graphics 33, 6, Article 181. Google ScholarDigital Library
- Monnai, Y., Hasegawa, K., Fujiwara, M., Yoshino, K., Inoue, S. and Shinoda, H. 2014. HaptoMime: mid-air haptic interaction with a floating virtual screen. In Proceedings of the UIST 2014 Conference, ACM, 663--667. Google ScholarDigital Library
- Palovuori, K., Rakkolainen, I. and Sand, A. 2014. Bidirectional Touch Interaction for Immaterial Displays. In Proceedings of the MindTrek 2014 Conference, ACM, 76--78. Google ScholarDigital Library
- Pont, S., Kappers, A. and Koenderink, J. 1997. Haptic curvature discrimination at several regions of the hand. Perception & Psychophysics 59, 8, 1225--1240.Google ScholarCross Ref
- Ryu, J., Jung, J., Park, G. and Choi, S. 2010. Psycho-physical Model for Vibrotactile Rendering in Mobile Devices. Presence 19, 4, 364--387. Google ScholarDigital Library
- Sand, A., Rakkolainen, I., Isokoski, P., Raisamo, R., and Palovuori, K. 2015. Lightweight Immaterial Particle Displays with Mid-Air Tactile Feedback. In Proceedings of the IEEE International Workshop on Haptic Audio-Visual Environments and Games 2015, IEEE.Google Scholar
- Sodhi, R., Poupyrev, I., Glisson, M. and Israr, A. 2013. AIREAL: Interactive Tactile Experiences in Free Air. In Proceedings of the ACM SIGGRAPH 2013 Conference, ACM, Article 134. Google ScholarDigital Library
- Smagowska, B. and Pawlaczyk-Łuszczyńska, M. 2015. Effects of Ultrasonic Noise on the Human Body --- A Bibliographic Review. International Journal of Occupational Safety and Ergonomics, 19:2, 195--202.Google ScholarCross Ref
- Sutherland, I. 1965. The Ultimate Display. In Proceedings of the. IFIP Congress 1965, Vol. 2, 506--508.Google Scholar
- Sutherland, I. 1968. A Head-mounted Three-dimensional Display. In Proceedings of the AFIPS Fall Joint Computer Conference 1968, Thompson Books, Vol. 3, 757--764. Google ScholarDigital Library
- Takahashi M. and Shinoda, H. 2010. Large aperture Airborne Ultrasound Tactile Display using distributed array units. In Proceedings of the SICE 2010 Conference, IEEE, 359--362.Google Scholar
- Wilson, G., Carter, T., Subramanian, S. and Brewster, S. 2014. Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion. In Proceedings of the CHI 2014 Conference, ACM, 1133--1142. Google ScholarDigital Library
- Yoshino, K., Hasegawa, K. and Shinoda, H. 2012. Measuring Visio-Tactile threshold for Visio-Tactile Projector. In Proceedings of the SICE 2012 Conference, IEEE, 1996--2000.Google Scholar
Index Terms
- Head-mounted display with mid-air tactile feedback
Recommendations
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctCurrent generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...
Infrared bundle adjusting and clustering method for head-mounted display and Leap Motion calibration
Leap Motion has become widely used due to its ability to recognize intuitive hand gestures or accurate finger positions. Attaching a Leap Motion to a virtual reality head-mounted display (VR HMD) is highly interoperable with virtual objects in virtual ...
Differences in virtual and physical head orientation predict sickness during active head-mounted display-based virtual reality
AbstractDuring head-mounted display (HMD)-based virtual reality (VR), head movements and motion-to-photon-based display lag generate differences in our virtual and physical head pose (referred to as DVP). We propose that large-amplitude, time-varying ...
Comments