Interactive hybrid approach to combine machine and human intelligence for personalized rehabilitation assessment

Lee, Min Hun; Siewiorek, Daniel P.; Smailagic, Asim; Bernardino, Alexandre; Bermúdez i Badia, Sergi

http://hdl.handle.net/10400.13/4439

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
Interactive hybrid approach to combine machine and human intelligence for personalized rehabilitation assessment.pdf		998.7 KB	Adobe PDF	Download

Send Feedback

Authors

Lee, Min Hun

Siewiorek, Daniel P.

Smailagic, Asim

Bernardino, Alexandre

Bermúdez i Badia, Sergi

Abstract(s)

Automated assessment of rehabilitation exercises using machine learning has a potential to improve current rehabilitation practices. However, it is challenging to completely replicate therapist’s deci sion making on the assessment of patients with various physical conditions. This paper describes an interactive machine learning approach that iteratively integrates a data-driven model with ex pert’s knowledge to assess the quality of rehabilitation exercises. Among a large set of kinematic features of the exercise motions, our approach identifies the most salient features for assessment using reinforcement learning and generates a user-specific analysis to elicit feature relevance from a therapist for personalized rehabilita tion assessment. While accommodating therapist’s feedback on fea ture relevance, our approach can tune a generic assessment model into a personalized model. Specifically, our approach improves performance to predict assessment from 0.8279 to 0.9116 average F1-scores of three upper-limb rehabilitation exercises (𝑝 < 0.01). Our work demonstrates that machine learning models with feature selection can generate kinematic feature-based analysis as expla nations on predictions of a model to elicit expert’s knowledge of assessment, and how machine learning models can augment with expert’s knowledge for personalized rehabilitation assessment.

Keywords

Human-AI interaction Explainable AI Interactive machine learning Personalization Decision support systems Stroke rehabilitation assessment . Faculdade de Ciências Exatas e da Engenharia

URI

http://hdl.handle.net/10400.13/4439

Citation

Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2020, April). Interactive hybrid approach to combine machine and human intelligence for personalized rehabilitation assessment. In Proceedings of the ACM Conference on Health, Inference, and Learning (pp. 160-169).