Uploaded April 2019 | Updated November 2026, 1 hour ago
Effective communication is required for teams of robots to solve sophisticated collaborative tasks. In practice it is typical for both the encoding and semantics of communication to be manually defined by an expert; this is true regardless of whether the behaviors themselves are bespoke, optimization based, or learned. We present an agent architecture and training methodology using neural networks to learn task-oriented communication semantics based on the example of a communication-unaware expert policy. A perimeter defense game illustrates the system’s ability to handle dynamically changing numbers of agents and its graceful degradation in performance as communication constraints are tightened or the expert’s observability assumptions are broken.
More details can be found in the article by James Paulos, Steven W. Chen, Daigo Shishika, and Vijay Kumar from the GRASP lab at the University of Pennsylvania.
arxiv.org/abs/1901.08490
Effective communication is required for teams of robots to solve sophisticated collaborative tasks. In practice it is typical for both the encoding and semantics of communication to be manually defined by an expert; this is true regardless of whether the behaviors themselves are bespoke, optimization based, or learned. We present an agent architecture and training methodology using neural networks to learn task-oriented communication semantics based on the example of a communication-unaware expert policy. A perimeter defense game illustrates the system’s ability to handle dynamically changing numbers of agents and its graceful degradation in performance as communication constraints are tightened or the expert’s observability assumptions are broken.
More details can be found in the article by James Paulos, Steven W. Chen, Daigo Shishika, and Vijay Kumar from the GRASP lab at the University of Pennsylvania.
arxiv.org/abs/1901.08490










![Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Abstract:
In recent years, vision-aided inertial odometry for state estimation has matured significantly. However, we still encounter challenges in terms of improving the computational efficiency and robustness of the underlying algorithms for ap- plications in autonomous flight with micro aerial vehicles in which it is difficult to use high quality sensors and powerful processors because of constraints on size and weight. In this paper, we present a filter-based stereo visual inertial odometry that uses the Multi-State Constraint Kalman Filter (MSCKF) [1]. Previous work on stereo visual inertial odometry has resulted in solutions that are computationally expensive. We demon- strate that our Stereo Multi-State Constraint Kalman Filter (S-MSCKF) is comparable to state-of-art monocular solutions in terms of computational cost, while providing significantly greater robustness. We evaluate our S-MSCKF algorithm and compare it with state-of-art methods including OKVIS, ROVIO, and VINS-MONO on both the EuRoC dataset, and our own experimental datasets demonstrating fast autonomous flight with maximum speed of 17.5m/s in indoor and outdoor environ- ments.
Paper:
https://arxiv.org/abs/1712.00036
Code:
https://github.com/KumarRobotics/msckf_vio
Dataset:
https://github.com/KumarRobotics/msckf_vio/wiki Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight](https://i.ytimg.com/vi/jxfJFgzmNSw/mqdefault.jpg)