Towards a manufacturing optimization system through remote robot control system using hand movement

October 2023
Engineering and Numerical Tools
Communications avec actes dans un congrès international
Auteurs : Rim Slama (LINEACT), Ilhem Slama (UTT), Pierre Slangen (EuroMov Digital Health in Motion), Oussama Ben-ammar (EuroMov Digital Health in Motion)
Conférence : IEEE International Conference on Networking, Sensing and Control, 24 October 2023

In recent times, there has been a notable shift in manual assembly tasks being replaced by robots. These robots are controlled by operators using keyboards. To enhance this practice, we have introduced a remote human-robot collaboration system. This system allows operators to remotely control robots using hand gestures, utilizing an online hand gesture recognition system. To complement the remote robot control system, we have implemented a model-driven display system. For data acquisition, we have carefully chosen the Leap Motion technology. The designed approach for remote hand gesture recognition has been implemented and tested for accuracy and response time using the well-known SHREC 2021 Gesture Benchmark. The final analysis demonstrates the significant potential of the developed system in improving assembly processes and environments. It optimizes various key performance indicators, leading to enhanced efficiency and effectiveness.