© Intel Corporation, Santa Clara, California, USA, https://www.intel.com
This article is part of the Topical Collection on Mobile & Wireless Health
Applications utilising 3D Camera technologies for the measurement of health outcomes in the health and wellness sector continues to expand. The Intel® RealSense™ is one of the leading 3D depth sensing cameras currently available on the market and aligns itself for use in many applications, including robotics, automation, and medical systems. One of the most prominent areas is the production of interactive solutions for rehabilitation which includes gait analysis and facial tracking. Advancements in depth camera technology has resulted in a noticeable increase in the integration of these technologies into portable platforms, suggesting significant future potential for pervasive in-clinic and field based health assessment solutions. This paper reviews the Intel RealSense technology’s technical capabilities and discusses its application to clinical research and includes examples where the Intel RealSense camera range has been used for the measurement of health outcomes. This review supports the use of the technology to develop robust, objective movement and mobility-based endpoints to enable accurate tracking of the effects of treatment interventions in clinical trials.
Good OS (2017) Kinect is officially dead. Really. Officially. It's dead. In: Polygon. https://www.polygon.com/2017/10/25/16543192/kinect-discontinued-microsoft-announcement. Accessed 20 Nov 2017
Breedon P, Byrom B, Siena L, Muehlhausen W. (2016) Enhancing the Measurement of Clinical Outcomes Using Microsoft Kinect. Interactive Technologies and Games (iTAG), 2016 International Conference on 2016 Oct 26 (pp. 61-69). https://doi.org/10.1109/iTAG.2016.17.
Intel. (2017) Intel® Euclid™ Development Kit. https://www.intel.co.uk/content/www/uk/en/support/articles/000024177/emerging-technologies/intel-euclid-development-kit.html . Accessed 24 January 2018
Intel. (2016) Intel® RealSense™ SDK 2016 R2 Documentation Face Landmark Data. https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_face_face_landmark_data.html. Accessed 4 July 2017
Intel. (2017) Intel® RealSense™ Camera SR300 Product Data Sheet. https://software.intel.com/sites/default/files/managed/0c/ec/realsense-sr300-product-datasheet-rev-1-0.pdf Accessed 4 July 2017
Intel. (2016) Introducing the Intel® RealSense™ R200 Camera (world facing). https://software.intel.com/en-us/articles/realsense-r200-camera Accessed 4 July 2017
Intel. (2016) Intel® RealSense™ Camera R200 Product Data Sheet. https://software.intel.com/sites/default/files/managed/d7/a9/realsense-camera-r200-product-datasheet.pdf Accessed 4 July 2017
Intel. (2016) What's New in the 2016 R2 Intel RealSense SDK?. https://software.intel.com/en-us/blogs/2016/05/21/new-r2. Accessed 10 November 2017
Intel. (2017) A Comparison of Intel® RealSense™ Front-Facing Camera SR300 and F200. https://software.intel.com/en-us/articles/a-comparison-of-intel-realsensetm-front-facing-camera-sr300-and-f200. Accessed 10 November 2017
Intel. (2017) Intel® RealSense SDK for Windows* (Discontinued). https://software.intel.com/en-us/realsense-sdk-windows-eol. Accessed 10 November 2017
Shires L, Battersby S, Lewis J, Brown D, Sherkat N, Standen P (2013) Enhancing the tracking capabilities of the Microsoft Kinect for stroke rehabilitation. In Serious Games and Applications for Health (SeGAH), 2013, 2nd International Conference on 2013 May 2 (pp. 1-8). https://doi.org/10.1109/SeGAH.2013.6665316.
Intel. (2016) Intel® RealSense™ 3D Camera ZR300. https://click.intel.com/intelr-realsensetm-development-kit-featuring-the-zr300.html. Accessed 4 July 2017
Intel. (2016) Intel® RealSense™ 3D Camera ZR300 Data Sheet. http://click.intel.com/media/ZR300-Product-Datasheet-Public-002.pdf. Accessed 4 July 2017
Intel. (2016) A Comparison of Intel® RealSense™ Front-Facing Camera SR300 and F200. https://software.intel.com/en-us/articles/a-comparison-of-intel-realsensetm-front-facing-camera-sr300-and-f200. Accessed 10 November 2017
Intel. (2017) Intel® RealSense™ Depth Camera D400-Series. https://software.intel.com/en-us/realsense/d400. Accessed 10 November 2017
Sin, H., and Lee, G., Additional virtual reality training using Xbox Kinect in stroke survivors with hemiplegia. American journal of physical medicine & rehabilitation. 92(10):871–880, 2013. https://doi.org/10.1097/PHM.0b013e3182a38e40. CrossRef
Galna, B., Jackson, D., Schofield, G., McNaney, R., Webster, M., Barry, G., Mhiripiri, D., Balaam, M., Olivier, P., and Rochester, L., Retraining function in people with Parkinson’s disease using the Microsoft kinect: game design and pilot testing. Journal of neuroengineering and rehabilitation. 11(1):60, 2014. https://doi.org/10.1186/1743-0003-11-60. CrossRefPubMedPubMedCentral
Ortiz-Gutiérrez, R., Cano-de-la-Cuerda, R., Galán-del-Río, F., Alguacil-Diego, I.M., Palacios-Ceña, D., and Miangolarra-Page, J.C., A telerehabilitation program improves postural control in multiple sclerosis patients: a Spanish preliminary study. International journal of environmental research and public health. 10(11):5697–5710, 2013. https://doi.org/10.3390/ijerph10115697. CrossRefPubMedPubMedCentral
Luna-Oliva, L., Ortiz-Gutiérrez, R.M., Cano-de la Cuerda, R., Piédrola, R.M., Alguacil-Diego, I.M., Sánchez-Camarero, C., and Martínez Culebras, M.D., Kinect Xbox 360 as a therapeutic modality for children with cerebral palsy in a school environment: a preliminary study. NeuroRehabilitation. 33(4):513–521, 2013. https://doi.org/10.3233/NRE-131001. PubMed
Byrom, B., Breedon, P., and Muehlhausen, W., A Review Evaluating the Validity of Motion-Based Gaming Platforms to Measure Clinical Outcomes in Clinical Research. Value in Health. 19(7):A357–A358, 2016. CrossRef
Chhor, J., Gong, Y., and Rau, P.L., Breakout: Design and Evaluation of a Serious Game for Health Employing Intel RealSense, InInternational Conference on Cross-Cultural Design 2017 Jul 9 (pp. 531-545). Springer, Cham, 2017.
Ferche, O., Moldoveanu, A., and Moldoveanu, F., Evaluating Lightweight Optical Hand Tracking for Virtual Reality Rehabilitation. Romanian Journal of Human-Computer Interaction. 9(2):85, 2016.
Baldominos, A., Saez, Y., and del Pozo, C.G., An approach to physical rehabilitation using state-of-the-art virtual reality and motion tracking technologies. Procedia Computer Science. 64:10–16, 2015. https://doi.org/10.1016/j.procs.2015.08.457. CrossRef
House R, Lasso A, Harish V, Baum Z, Fichtinger G.Evaluation of the Intel RealSense SR300 camera for image-guided interventions and application in vertebral level localization. InSPIE Medical Imaging. International Society for Optics and Photonics. (pp. 101352Z-101352Z), 2017. https://doi.org/10.1117/12.2255899.
Silva V, Soares F, Esteves JS, Figueiredo J, Santos C, Pereira AP. (2017) Happiness and Sadness Recognition System—Preliminary Results with an Intel RealSense 3D Sensor. InCONTROLO 2016, Springer International Publishing. (pp. 385-395).
Bandini, A., Namasivayam, A., and Yunusova, Y., Video-based tracking of jaw movements during speech: Preliminary results and future directions. Proc. Interspeech 2017. 2017:689–693, 2017. https://doi.org/10.21437/Interspeech.2017-1371. CrossRef
Intel. (2017) 3D People Full-Body Scanning System With Intel® RealSense™ 3D Cameras and Intel® Edison: How We Did It. https://software.intel.com/en-us/articles/cappasity-3d-people-full-body-scan-with-intel-realsense-and-intel-edison. Accessed 4 July 2017
Downing, G., Biomarkers Definitions Working Group. Biomarkers and Surrogate Endpoints. Clinical Pharmacology & Therapeutics. 69:89–95, 2001. CrossRef
Byrom, B., Watson, C., Doll, H., Coons, S.J., Eremenco, S., Ballinger, R., Mc Carthy, M., Crescioni, M., O’Donohoe, P., Howry, C., and ePRO Consortium, Selection of and Evidentiary Considerations for Wearable Devices and Their Measurements for Use in Regulatory Decision Making: Recommendations from the ePRO Consortium. Value in Health, 2017. https://doi.org/10.1016/j.jval.2017.09.012.
Alabbasi, H.A., Moldoveanu, P., and Moldoveanu, A., Real time facial emotion recognition using kinect V2 sensor. IOSR J. Comput. Eng. Ver. II. 17(3):2278–2661, 2015. https://doi.org/10.9790/0661-17326168.
Bajcar, A. Borkowska and K. Jach. (2017). The usability of system and users emotions during work with interface designed for disabled – the pilot study, in IADIS International Conference Interfaces and Human Computer Interaction 2017, Lisbon, pp. 46-53.
Ťupa, O., Procházka, A., Vyšata, O., Schätz, M., Mareš, J., Vališ, M., and Mařík, V., Motion tracking and gait feature estimation for recognising Parkinson’s disease using MS Kinect. Biomedical engineering online. 14(1):97, 2015. https://doi.org/10.1186/s12938-015-0092-7. CrossRefPubMedPubMedCentral
Huang J, Zhou W, Li H, Li W. (2015) Sign language recognition using real-sense. InSignal and Information Processing (ChinaSIP), IEEE China Summit and International Conference (pp. 166-170). IEEE. 10.1109/ChinaSIP.2015.7230384
- Utilising the Intel RealSense Camera for Measuring Health Outcomes in Clinical Research
Francesco Luke Siena
- Springer US