Skip to main content
Erschienen in: Journal of Medical Systems 7/2020

01.07.2020 | Mobile & Wireless Health

Usability of an Intelligent Virtual Assistant for Promoting Behavior Change and Self-Care in Older People with Type 2 Diabetes

verfasst von: João Balsa, Isa Félix, Ana Paula Cláudio, Maria Beatriz Carmo, Isabel Costa e Silva, Ana Guerreiro, Maria Guedes, Adriana Henriques, Mara Pereira Guerreiro

Erschienen in: Journal of Medical Systems | Ausgabe 7/2020

Einloggen, um Zugang zu erhalten

Abstract

In the context of the VASelfCare project, we developed an application prototype of an intelligent anthropomorphic virtual assistant. Designed as a relational agent, the virtual assistant has the role of supporting older people with Type 2 Diabetes Mellitus (T2D) in medication adherence and lifestyle changes. Our paper has two goals: describing the essentials of this prototype, and reporting on usability evaluation. We describe the general architecture of the prototype, including the graphical component, and focus on its main feature: the incorporation, in the way the dialogue flows, of Behavior Change Techniques, identified through a theoretical framework, the Behaviour Change Wheel. Usability was experimentally evaluated in field tests in a purposive sample of 20 participants (11 older adults with T2D and 9 experts). The Portuguese version of the System Usability Scale was employed, supplemented with qualitative data from open questions, diaries, digital notes and telephone follow-ups. The aggregated mean SUS score was 73,75 (SD 13,31), which corresponds to a borderline rating of excellent. Textual data were content analyzed and will be prioritized to further improve usability.
Fußnoten
4
Administração Regional de Saúde de Lisboa e Vale do Tejo (Regional Health Administration of Lisbon and Tagus Valley)
 
Literatur
1.
Zurück zum Zitat op den Akker R., Klaassen R., Lavrysen T., Geleijnse G., van Halteren A., Schwietert H., Van der Hout M.: A Personal Context-Aware Multi-Device Coaching Service That Supports a Healthy Lifestyle.. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction, BCS-HCI ’11, pp 443-448, BCS Learning & Development Ltd., Swindon, GBR, 2011 op den Akker R., Klaassen R., Lavrysen T., Geleijnse G., van Halteren A., Schwietert H., Van der Hout M.: A Personal Context-Aware Multi-Device Coaching Service That Supports a Healthy Lifestyle.. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction, BCS-HCI ’11, pp 443-448, BCS Learning & Development Ltd., Swindon, GBR, 2011
4.
Zurück zum Zitat Arnhold M., Quade M., Kirch W.: Mobile Applications for Diabetics : A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older Corresponding Author : Journal of Medical Internet Research 16 (4): 1–18, 2014. https://doi.org/10.2196/jmir.2968 Arnhold M., Quade M., Kirch W.: Mobile Applications for Diabetics : A Systematic Review and Expert-Based Usability Evaluation Considering the Special Requirements of Diabetes Patients Age 50 Years or Older Corresponding Author : Journal of Medical Internet Research 16 (4): 1–18, 2014. https://​doi.​org/​10.​2196/​jmir.​2968
5.
Zurück zum Zitat Balsa J., Neves P., Félix I.B., Guerreiro M.P., Alves P., Carmo M.B., Marques D., Dias A., Henriques A., Cláudio A.P.: Intelligent Virtual Assistant for Promoting Behaviour Change in Older People with T2D. In: (P.M. Oliveira, P. Novais, L.P. Reis, Eds.) Progress in Artificial Intelligence - 19th EPIA Conference on Artificial Intelligence, EPIA 2019, Vila Real, Portugal, September 3-6, 2019, Proceedings, Part I, Lecture Notes in Computer Science, vol. 11804, pp. 372–383. Springer, 2019, https://doi.org/10.1007/978-3-030-30241-2_32 Balsa J., Neves P., Félix I.B., Guerreiro M.P., Alves P., Carmo M.B., Marques D., Dias A., Henriques A., Cláudio A.P.: Intelligent Virtual Assistant for Promoting Behaviour Change in Older People with T2D. In: (P.M. Oliveira, P. Novais, L.P. Reis, Eds.) Progress in Artificial Intelligence - 19th EPIA Conference on Artificial Intelligence, EPIA 2019, Vila Real, Portugal, September 3-6, 2019, Proceedings, Part I, Lecture Notes in Computer Science, vol. 11804, pp. 372–383. Springer, 2019, https://​doi.​org/​10.​1007/​978-3-030-30241-2_​32
6.
Zurück zum Zitat Beinema T., op den Akker H., Hermens H.: Creating an artificial coaching engine for multi-domain conversational coaches in eHealth applications. In: (E. André, T.W. Bickmore, S. Vrochidis, L. Wanner, Eds.) Proceedings of the AAMAS Workshop on Intelligent Conversation Agents in Home and Geriatric Care Applications co-located with the Federated AI Meeting (FAIM 2018), ICAHGCA@AAMAS 2018, Stockholm, Sweden, July 15, 2018, CEUR Workshop Proceedings, vol. 2338, pp. 35–39. CEUR-WS.org, 2018. http://ceur-ws.org/Vol-2338/paper5.pdf Beinema T., op den Akker H., Hermens H.: Creating an artificial coaching engine for multi-domain conversational coaches in eHealth applications. In: (E. André, T.W. Bickmore, S. Vrochidis, L. Wanner, Eds.) Proceedings of the AAMAS Workshop on Intelligent Conversation Agents in Home and Geriatric Care Applications co-located with the Federated AI Meeting (FAIM 2018), ICAHGCA@AAMAS 2018, Stockholm, Sweden, July 15, 2018, CEUR Workshop Proceedings, vol. 2338, pp. 35–39. CEUR-WS.org, 2018. http://​ceur-ws.​org/​Vol-2338/​paper5.​pdf
10.
Zurück zum Zitat Bickmore T. W., Silliman R. A., Nelson K., Cheng D. M., Winter M., Henault L., Paasche-Orlow M. K.: A randomized controlled trial of an automated exercise coach for older adults. Journal of the American Geriatrics Society 61 (10): 1676–1683, 2013. https://doi.org/10.1111/jgs.12449 PubMed Bickmore T. W., Silliman R. A., Nelson K., Cheng D. M., Winter M., Henault L., Paasche-Orlow M. K.: A randomized controlled trial of an automated exercise coach for older adults. Journal of the American Geriatrics Society 61 (10): 1676–1683, 2013. https://​doi.​org/​10.​1111/​jgs.​12449 PubMed
12.
Zurück zum Zitat Brooke J.: SUS: A retrospective. Journal of Usability Studies 8 (2): 29–40, 2013 Brooke J.: SUS: A retrospective. Journal of Usability Studies 8 (2): 29–40, 2013
15.
Zurück zum Zitat Burgan D. (2017) Dialogue Systems & Dialogue Management. Tech. rep., National Security & ISR Division Defence Science and Technology Group Burgan D. (2017) Dialogue Systems & Dialogue Management. Tech. rep., National Security & ISR Division Defence Science and Technology Group
16.
Zurück zum Zitat collab=Centers for Disease Control and Prevention (2017) C.D.C.: National diabetes statistics report: estimates of diabetes and its burden in the united states. Atlanta GA: centers for disease control and prevention; 2017 collab=Centers for Disease Control and Prevention (2017) C.D.C.: National diabetes statistics report: estimates of diabetes and its burden in the united states. Atlanta GA: centers for disease control and prevention; 2017
17.
Zurück zum Zitat Clȧudio A. P., Carmo M. B., Pinto V., Cavaco A., Guerreiro M. P.: Virtual humans for training and assessment of self-medication consultation skills in pharmacy students.. In: 10Th international conference on computer science and education, pp. 175–180. ICCSE, 2015 Clȧudio A. P., Carmo M. B., Pinto V., Cavaco A., Guerreiro M. P.: Virtual humans for training and assessment of self-medication consultation skills in pharmacy students.. In: 10Th international conference on computer science and education, pp. 175–180. ICCSE, 2015
18.
Zurück zum Zitat Cui M., Wu X., Mao J., Wang X., Nie M.: T2DM self-management via smartphone applications: a systematic review and meta-analysis. PLoS ONE 11 (11): 1–15, 2016 Cui M., Wu X., Mao J., Wang X., Nie M.: T2DM self-management via smartphone applications: a systematic review and meta-analysis. PLoS ONE 11 (11): 1–15, 2016
19.
Zurück zum Zitat Das K., Beinema T., Akker H.O.D., Hermens. H.: Generation of multi-party dialogues among embodied conversational agents to promote active living and healthy diet for subjects suffering from type 2 diabetes.. In: Proceedings of the 5th International Conference on Information and Communication Technologies for Ageing Well and e-Health - Volume 1: ICT4AWE, 2019, pp 297–304, INSTICC, SciTePress, https://doi.org/10.5220/0007750602970304 Das K., Beinema T., Akker H.O.D., Hermens. H.: Generation of multi-party dialogues among embodied conversational agents to promote active living and healthy diet for subjects suffering from type 2 diabetes.. In: Proceedings of the 5th International Conference on Information and Communication Technologies for Ageing Well and e-Health - Volume 1: ICT4AWE, 2019, pp 297–304, INSTICC, SciTePress, https://​doi.​org/​10.​5220/​0007750602970304​
20.
Zurück zum Zitat Donsa K., Spat S., Beck P., Pieber T. R., Holzinger A.: towards personalization of diabetes therapy using computerized decision support and machine learning: some open problems and challenges.. In: Smart health, pp. 237–260. Springer international publishing, 2015, https://doi.org/10.1007/978-3-319-16226-3_10 Donsa K., Spat S., Beck P., Pieber T. R., Holzinger A.: towards personalization of diabetes therapy using computerized decision support and machine learning: some open problems and challenges.. In: Smart health, pp. 237–260. Springer international publishing, 2015, https://​doi.​org/​10.​1007/​978-3-319-16226-3_​10
23.
Zurück zum Zitat Hou C., Carter B., Hewitt J., Francisa T., Mayor S.: Do Mobile Phone Applications Improve Glycemic Control (HbA1c) in the Self-management of Diabetes? A Systematic Review, Meta-analysis, and GRADE of 14 Randomized Trials. Diabetes Care 39 (11): 2089–2095, 2016PubMed Hou C., Carter B., Hewitt J., Francisa T., Mayor S.: Do Mobile Phone Applications Improve Glycemic Control (HbA1c) in the Self-management of Diabetes? A Systematic Review, Meta-analysis, and GRADE of 14 Randomized Trials. Diabetes Care 39 (11): 2089–2095, 2016PubMed
24.
Zurück zum Zitat (2017). International Diabetes Federation : IDF Diabetes Atlas, 8th edn. International Diabetes Federation, Brussels, Belgium (2017). International Diabetes Federation : IDF Diabetes Atlas, 8th edn. International Diabetes Federation, Brussels, Belgium
25.
Zurück zum Zitat Kebede M. M., Liedtke T. P., Mȯllers T., Pischke C. R. (2017) Characterizing Active Ingredients of eHealth Interventions Targeting Perso ns With Poorly Controlled Type 2 Diabetes Mellitus Using the Behavior Change Techniques Taxonomy: Scoping Review, vol 19. https://www.jmir.org/2017/10/e348/ Kebede M. M., Liedtke T. P., Mȯllers T., Pischke C. R. (2017) Characterizing Active Ingredients of eHealth Interventions Targeting Perso ns With Poorly Controlled Type 2 Diabetes Mellitus Using the Behavior Change Techniques Taxonomy: Scoping Review, vol 19. https://​www.​jmir.​org/​2017/​10/​e348/​
26.
Zurück zum Zitat Kekȧlȧinen A., Kaikkonen A., Kankainen A., Cankar M., Kallio T.: Usability testing of mobile applications: a comparison between laboratory and field testing. Journal of Usability Studies 1 (1): 4–17, 2005 Kekȧlȧinen A., Kaikkonen A., Kankainen A., Cankar M., Kallio T.: Usability testing of mobile applications: a comparison between laboratory and field testing. Journal of Usability Studies 1 (1): 4–17, 2005
29.
Zurück zum Zitat Lison P.: A hybrid approach to dialogue management based on probabilistic rules. Computer Speech &, Language 34 (1): 232–255, 2015 Lison P.: A hybrid approach to dialogue management based on probabilistic rules. Computer Speech &, Language 34 (1): 232–255, 2015
32.
Zurück zum Zitat Martins A.I., Rosa A.F., Queirós A., Silva A., Rocha N.P.: European portuguese validation of the system usability scale (sus). Procedia Computer Science 67: 293–300, 2015. https://doi.org/10.1016/j.procs.2015.09.273. Proceedings of the 6th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion Martins A.I., Rosa A.F., Queirós A., Silva A., Rocha N.P.: European portuguese validation of the system usability scale (sus). Procedia Computer Science 67: 293–300, 2015. https://​doi.​org/​10.​1016/​j.​procs.​2015.​09.​273. Proceedings of the 6th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion
34.
Zurück zum Zitat Michie S., Atkins L., West R. (2014) The behaviour change wheel : a guide to designing interventions Silverback Publishing Michie S., Atkins L., West R. (2014) The behaviour change wheel : a guide to designing interventions Silverback Publishing
35.
Zurück zum Zitat Michie S., Richardson M., Johnston M., Abraham C., Francis J., Hardeman W., Eccles M. P., Cane J., Wood C.E.: The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine 46 (1): 81–95, 2013. https://doi.org/10.1007/s12160-013-9486-6 PubMed Michie S., Richardson M., Johnston M., Abraham C., Francis J., Hardeman W., Eccles M. P., Cane J., Wood C.E.: The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine 46 (1): 81–95, 2013. https://​doi.​org/​10.​1007/​s12160-013-9486-6 PubMed
36.
Zurück zum Zitat Michie S., Wood C.E., Johnston M., Abraham C., Francis J.J., Hardeman W.: Behaviour change techniques: The development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative da. Health Technology Assessment 19 (99): 1–187, 2015. https://doi.org/10.3310/hta19990 PubMed Michie S., Wood C.E., Johnston M., Abraham C., Francis J.J., Hardeman W.: Behaviour change techniques: The development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative da. Health Technology Assessment 19 (99): 1–187, 2015. https://​doi.​org/​10.​3310/​hta19990 PubMed
37.
Zurück zum Zitat Monkaresi H., Calvo R. A., Pardo A., Chow K., Mullan B., Lam M., M.Twigg S., Cook D.I.: Intelligent diabetes lifestyle coach.. In: Proceedings of the Fifth International Workshop on Smart Healthcare and Wellness Applications (SmartHealth’13), pp. 1–4, 2013 Monkaresi H., Calvo R. A., Pardo A., Chow K., Mullan B., Lam M., M.Twigg S., Cook D.I.: Intelligent diabetes lifestyle coach.. In: Proceedings of the Fifth International Workshop on Smart Healthcare and Wellness Applications (SmartHealth’13), pp. 1–4, 2013
41.
Zurück zum Zitat Pal K., Eastwood S. V., Michie S., Farmer A. J., Barnard M. L., Peacock R., Wood B., Inniss J. D., Murray E. Computer-based diabetes self-management interventions for adults with type 2 diabetes mellitus. Cochrane Database of Systematic Reviews 2013, Issue 3. Art. No.: CD008776. DOI: 10.1002/14651858.CD008776.pub2. Pal K., Eastwood S. V., Michie S., Farmer A. J., Barnard M. L., Peacock R., Wood B., Inniss J. D., Murray E. Computer-based diabetes self-management interventions for adults with type 2 diabetes mellitus. Cochrane Database of Systematic Reviews 2013, Issue 3. Art. No.: CD008776. DOI: 10.1002/14651858.CD008776.pub2.
42.
Zurück zum Zitat (2018). PRO-STEP Project Consortium: PRO-STEP project: Promoting Self-management for chronic diseases in Europe - Final Report (2018). PRO-STEP Project Consortium: PRO-STEP project: Promoting Self-management for chronic diseases in Europe - Final Report
43.
Zurück zum Zitat Sauro J. (2011) A practical guide to the system usability scale: background, benchmarks & best practices CreateSpace Independent Publishing Platform Sauro J. (2011) A practical guide to the system usability scale: background, benchmarks & best practices CreateSpace Independent Publishing Platform
44.
Zurück zum Zitat Sauro J., Lewis J. R. (2012) Quantifying the user experience : practical statistics for user research Elsevier/Morgan Kaufmann Sauro J., Lewis J. R. (2012) Quantifying the user experience : practical statistics for user research Elsevier/Morgan Kaufmann
45.
Zurück zum Zitat Schaarup C., Hartvigsen G., Larsen L.B., Tan Z., Årsand E., Hejlesen O.K.: Assessing the potential use of eye-tracking triangulation for evaluating the usability of an online diabetes exercise system. In: (I.N. Sarkar, A. Georgiou, P.M. de Azevedo Marques, Eds.) MEDINFO 2015: eHealth-enabled Health - Proceedings of the 15th World Congress on Health and Biomedical Informatics, São Paulo, Brazil, 19-23 August 2015, Studies in Health Technology and Informatics, vol. 216, pp. 84–88. IOS Press, 2015, https://doi.org/10.3233/978-1-61499-564-7-84 Schaarup C., Hartvigsen G., Larsen L.B., Tan Z., Årsand E., Hejlesen O.K.: Assessing the potential use of eye-tracking triangulation for evaluating the usability of an online diabetes exercise system. In: (I.N. Sarkar, A. Georgiou, P.M. de Azevedo Marques, Eds.) MEDINFO 2015: eHealth-enabled Health - Proceedings of the 15th World Congress on Health and Biomedical Informatics, São Paulo, Brazil, 19-23 August 2015, Studies in Health Technology and Informatics, vol. 216, pp. 84–88. IOS Press, 2015, https://​doi.​org/​10.​3233/​978-1-61499-564-7-84
46.
Zurück zum Zitat Smith C., Crook N., Dobnik S., Charlton D., Boye J., Pulman S., de la Camara R. S., Turunen M., Benyon D., Bradley J., Gambȧck B., Hansen P., Mival O., Webb N., Cavazza M.: Interaction strategies for an affective conversational agent. Presence:, Teleoperators and Virtual Environments 20 (5): 395–411, 2011 Smith C., Crook N., Dobnik S., Charlton D., Boye J., Pulman S., de la Camara R. S., Turunen M., Benyon D., Bradley J., Gambȧck B., Hansen P., Mival O., Webb N., Cavazza M.: Interaction strategies for an affective conversational agent. Presence:, Teleoperators and Virtual Environments 20 (5): 395–411, 2011
Metadaten
Titel
Usability of an Intelligent Virtual Assistant for Promoting Behavior Change and Self-Care in Older People with Type 2 Diabetes
verfasst von
João Balsa
Isa Félix
Ana Paula Cláudio
Maria Beatriz Carmo
Isabel Costa e Silva
Ana Guerreiro
Maria Guedes
Adriana Henriques
Mara Pereira Guerreiro
Publikationsdatum
01.07.2020
Verlag
Springer US
Erschienen in
Journal of Medical Systems / Ausgabe 7/2020
Print ISSN: 0148-5598
Elektronische ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-020-01583-w

Weitere Artikel der Ausgabe 7/2020

Journal of Medical Systems 7/2020 Zur Ausgabe