IEEE SMC 2020 Conference

The IEEE International Conference on Systems, Man, and Cybernetics took place October 11-14, 2020. This year, Dr. Bazzocchi took part as the Session Chair for Human-Machine Cooperation: Trust and Adaptation, which included papers from North Carolina A&T State University, Georgia Institute of Technology, Télécom SudParis, CEA LIST, Osaka Institute of Technology, and the University of Toronto.

As part of the session, Lowell Rose, presented recent work from the Autonomous Systems and Biomechatronics Laboratory at the University of Toronto, on which Dr. Bazzocchi collaborated prior to his arrival at Clarkson University. The paper information and abstract is presented below:

L. Rose, M.C.F. Bazzocchi, G. Nejat, “End-to-End Deep Reinforcement Learning for Exoskeleton Control” IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2020.

Abstract: Patient-specific control and training on lower body exoskeletons can help improve a user’s gait during post-stroke rehabilitation by increasing their amount of participation and motor learning. Traditionally, adaptive control techniques have been used to provide personalization and synchronization with exoskeleton users, but they require predefined dynamics models of the user and exoskeleton. However, these models can be difficult to accurately define due to the complexity of the human-robot interaction. Most recently deep reinforcement learning techniques have shown potential to effectively learn control schemes without the need for system dynamics models. In this paper, we present for the first time an end-to-end model-free deep reinforcement learning method for an exoskeleton that can learn to follow a desired gait pattern, while considering a user’s existing gait pattern and being robust to their perturbations and interactions. We demonstrate the effectiveness of our proposed method for user personalization of gait training in simulated experiments.

Keywords: Assistive Technology, Human-Machine Cooperation and Systems