SLEI3D: Simultaneous Exploration and Inspection via Heterogeneous Fleets under Limited Communication

1Peking University, 2Duke Kunshan University
Nerfies: Deformable Neural Radiance Fields

SLEI3D introduces a coordination framework for large-scale unknown 3D environments, integrating online collaborative exploration, adaptive inspection, and timely communication (via the intermittent or proactive protocols) to enable efficient cooperation among heterogeneous robotic fleets.

Abstract

Robotic fleets such as unmanned aerial and ground vehicles have been widely used for routine inspections of static environments, where the areas of interest are known and planned in advance. However, in many applications, such areas of interest are unknown and should be identified online during exploration. Thus, this paper considers the problem of simultaneous exploration, inspection of unknown environments and then real-time communication to a moveable ground control station to report the findings. The heterogeneous robots are equipped with different sensors, e.g., long-range lidars for fast exploration and close-range cameras for detailed inspection. Furthermore, global communication is often unavailable in such environments, where the robots can only communicate with each other via ad-hoc wireless networks when they are in close proximity and free of obstruction. This work proposes a novel planning and coordination framework (SLEI3D) that integrates the online strategies for collaborative 3D exploration, adaptive inspection and timely communication (via the intermittent or proactive protocols). To account for uncertainties w.r.t. the number and location of features, a multi-layer and multi-rate replanning mechanism is developed for inter-and-intra robot subgroups, to actively meet and coordinate their local plans. The proposed framework is validated extensively via high-fidelity simulations of numerous large-scale missions with up to 48 robots and 126 thousand cubic meters.

Overview Framework

Overview Framework

The proposed method tackles above optimization problem via a multi-layer and multi-rate coordination framework that simultaneously co-optimizes the collaborative behaviors, including the coordination of gcs and subgroup within one explorer and several inspectors, and intra-group collaboration.

Simulation

Layer1: Layer of GCS-to-SubGroups

Layer2: Layer of SubGorups

Experiment

Scenario1: Modern Structures

Scenario2: Ancient Structrures

Comparison

Comparison1: Modern Structures

Comparison2: Ancient Structures

Extensive Experiment

Explorer Failure

Inspector Failure

High Priority Feature

Multiple GCS