Federated Reinforcement Learning for Collective Navigation of Robotic Swarms

Seongin Na, Tomáš Rouček, Jiří Ulrich, Jan Pikman, Tomáš Krajník, Barry Lennox, Farshad Arvin (Corresponding)

Research output: Contribution to journalArticlepeer-review

Abstract

The recent advancement of Deep Reinforcement Learning (DRL) contributed to robotics by allowing automatic controller design. The automatic controller design is a crucial approach for designing swarm robotic systems, which require more complex controllers than a single robot system to lead a desired collective behaviour. Although the DRL-based controller design method showed its effectiveness for swarm robotic systems, the reliance on the central training server is a critical problem in real-world environments where robot-server communication is unstable or limited. We propose a novel Federated Learning (FL) based DRL training strategy (FLDDPG) for use in swarm robotic applications. Through the comparison with baseline strategies under a limited communication bandwidth scenario, it is shown that the FLDDPG method resulted in higher robustness and generalisation ability into a different environment and real robots, while the baseline strategies suffer from the limitation of communication bandwidth. This result suggests that the proposed method can benefit swarm robotic systems operating in environments with limited communication bandwidth, e.g., in high-radiation, underwater, or subterranean environments.
Original languageEnglish
JournalIEEE Transactions on Cognitive and Developmental Systems
DOIs
Publication statusE-pub ahead of print - 25 Jan 2023

Keywords

  • Collective Navigation
  • Collision avoidance
  • Deep Reinforcement Learning
  • Design methodology
  • Federated Learning
  • Robot kinematics
  • Robots
  • Servers
  • Swarm Robotics
  • Swarm robotics
  • Training

Fingerprint

Dive into the research topics of 'Federated Reinforcement Learning for Collective Navigation of Robotic Swarms'. Together they form a unique fingerprint.

Cite this