R: Teleop - Title

Teleoperation and Shared Control

Line separator

R: Teleop - Intro

The need to manipulate objects and tools in unstructured or hostile environments has led to the development of several Leader-Follower teleoperation interfaces: from the most basic, unilateral position-based, to bilateral force-reflecting systems. Notwithstanding the widespread use of such frameworks, they are known to lack substantial requirements to render an appropriate interaction performance (e.g. soft interactions in unilateral and stability in the latter). Therefore, the main objective of this theme is to address such limitations by the development of novel and intuitive interfaces for the execution of dynamic remote manipulation tasks. Our first objective is to extend the recent developments at HRI2 laboratory on the teleimpedance control of compliant robotic arms to a large number of degrees of freedom, e.g. humanoid robots. 

Research activities in this field will additionally investigate the feasibility of merging our novel techniques in Body-Machine Interfaces (e.g. teleimpedance) and Brain-Machine Interfaces with force or wearable haptic feedback for improved stability and transparency. 

On the robot side, we aim at integrating the underlying human motor control principles into the target robots’ control architectures to potentially improve interaction performance and redundancy resolution, while decreasing the robot control burden. The main research activities carried out in this direction, can be described as follows.

R: Teleop - Tele-impedance Control

Tele-impedance Control

Tele-impedance control is a method for remotely controlling robotic platforms in interaction with uncertain environments. As an alternative to bilateral force-reflecting teleoperation control, in tele-impedance a compound reference command is sent to the follower robot including both the desired motion trajectory and impedance profile, which are then realized by the remote controller without explicit feedback to the operator. In Tele-impedance, the reference commands are extracted from a body-machine interface (BMI) applied to the leader operator's limb (arms, legs, etc.), using only non-intrusive position and electromyography (EMG) measurements, and excluding any feedback from the remote site except for looking at the task. Example applications are Tele-impedance control of robotic arm, an anthropomorphic, and synergy-driven robotic hand, among many. 

  1. A. Ajoudani, N. G. Tsagarakis, and A. Bicchi, "Teleoperation with Impedance Regulation Using a Body-Machine Interface", International Journal of Robotics Research (IJRR), 2012. Link

  2. A. Ajoudani, C. Fang, N. G. Tsagarakis, and A. Bicchi, "A Reduced-Complexity Description of Arm Endpoint Stiffness with Applications to Teleimpedance Control", IEEE International Conference on Intelligent Robots and Systems (IROS), 2015. Link

  3. S.Fani, S. Ciotti, M. Catalano, G. Grioli, A. Tognetti, G. Valenza, A. Ajoudani, and M. Bianchi, "Simplifying Telerobotics: Wearability and Teleimpedance Improves Human-Robot Interactions in Teleoperation", IEEE Robotics and Automation Magazine (RAM), 2018. Link

  4. M. Laghi, A. Ajoudani, M. Catalano and A. Bicchi, "Tele-impedance with force feedback under communication time delay", IEEE International Conference on Intelligent Robots and Systems (IROS), 2017. Link

  5. M. Laghi, A. Ajoudani, M.G. Catalano, A. Bicchi, "Unifying bilateral teleoperation and tele-impedance for enhanced user experience", The International Journal of Robotics Research (IJRR), 2020. Link

R: Teleop - Scalability of Teleoperation Interfaces

Scalability of Teleoperation Interfaces

The scalability of the initially proposed Tele-Impedance framework to the mobile manipulators and heterogeneous multi-robot systems is another research direction which aims at developing intuitive and ergonomic tele-impedance interfaces. In particular, the possibility to have multiple follower robots, controlled individually or in collaboration/cooperation mode, is a crucial requirement in medical and industrial contexts, which contributes to reducing equipment idle time and the associated costs. For instance, an intuitive and low-cost interface based on a 3D mouse device and visual feedback is developed in our lab (see [2] below), by which the operator can define the desired task-level trajectories and impedance profiles of the remote robotic agents. 

  1. Y. Wu, P. Balatti, M. Lorenzini, F. Zhao, W. Kim and A. Ajoudani, "A Teleoperation Interface for Loco-Manipulation Control of Mobile Collaborative Robotic Assistant," in IEEE Robotics and Automation Letters (RA-L), 2019. Paper - Video

  2. V. R. Garate, S. Gholami and A. Ajoudani, "A Scalable Framework for Multi-Robot Tele-Impedance Control," in IEEE Transactions on Robotics (T-RO), 2021. Paper - Video

R: Teleop - Shared Authority Control for Mobile Manipulators

Shared Authority Control for Mobile Manipulators

Full teleoperation of multi-degrees-of-freedom follower systems that are embedded with dexterous loco-manipulation potential, such as mobile manipulators or humanoids, not only demands high cognitive and physical efforts but also generates less optimal trajectories compared to autonomous controllers. However, having full autonomy in unpredictable and dynamically changing environments is still far from becoming a reality. In this research line, shared-authority control (shared-autonomy) frameworks are designed to overcome these issues by estimating the user’s desired loco-manipulation goals to generate autonomous trajectories while keeping a human-in-control approach (e.g., the user’s navigational intention is estimated by merging the information coming from eye-tracker and control-pad devices in [2]). Apart from the human intention estimation which is the core element of the shared-autonomy frameworks, level of autonomy, intuitiveness of the teleoperation user-interface, user’s ergonomics and performance, and scalability are the other main topics which are studied in this category. 

  1. M. Laghi et al., "Shared-Autonomy Control for Intuitive Bimanual Tele-Manipulation," 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids), 2018. Link

  2. S. Gholami, V. R. Garate, E. De Momi and A. Ajoudani, "A Probabilistic Shared-Control Framework for Mobile Robots," 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020. Link

  3. S. Gholami, V. R. Garate, E. De Momi and A. Ajoudani, "A Shared-Autonomy Approach to Goal Detection and Navigation Control of Mobile Collaborative Robots," 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2020. Link

  4. S. Gholami, M. Lorenzini, E.  De Momi and A.  Ajoudani, “Quantitative Physical Ergonomics Assessment of Teleoperation Interfaces”. 2021. arXiv preprint arXiv:2105.09809.