LiDAR Inpainting of UAV Based 3D Point Cloud Using Supervised Learning

Muhammad Talha, Aya Hussein, Mohammed Hossny

Research output: A Conference proceeding or a Chapter in BookConference contributionpeer-review


Unmanned Aerial Vehicles (UAV) can quickly scan unknown environments to support a wide range of operations from intelligence gathering to search and rescue. LiDAR point clouds can give a detailed and accurate 3D representation of such unknown environments. However, LiDAR point clouds are often sparse and miss important information due to occlusions and limited sensor resolution. Several studies used inpainting techniques on LiDAR point clouds to complete the missing regions. However, these studies have three main limitations that hinder their use in UAV-based environment 3D reconstruction. First, existing studies focused only on synthetic data. Second, while the point clouds obtained from a UAV flying at moderate to high speeds can be severely distorted, none of the existing studies applied inpainting to UAV-based LiDAR point clouds. Third, all existing techniques considered inpainting isolated objects and did not generalise to inpainting complete environments. This paper aims to address these gaps by proposing an algorithm for inpainting point clouds of complete 3D environments obtained from a UAV. We use a supervised learning encoder-decoder model for point cloud inpainting and environment reconstruction. We tested the proposed approach for different LiDAR parameters and different environmental settings. The results demonstrate the ability of the system to inpaint the objects with a minimum average Chamfer Distance (CD) loss of 0.028 at a UAV speed of 5 ms- 1. We present the results of the 3D reconstruction for a few test environments.

Original languageEnglish
Title of host publicationAI 2023
Subtitle of host publicationAdvances in Artificial Intelligence - 36th Australasian Joint Conference on Artificial Intelligence, AI 2023, Proceedings
EditorsTongliang Liu, Geoff Webb, Lin Yue, Dadong Wang
Place of PublicationSingapore
Number of pages12
ISBN (Print)9789819983872
Publication statusPublished - 2024
Externally publishedYes
Event36th Australasian Joint Conference on Artificial Intelligence, AJCAI 2023 - Brisbane, Australia
Duration: 28 Nov 20231 Dec 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14471 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference36th Australasian Joint Conference on Artificial Intelligence, AJCAI 2023


Dive into the research topics of 'LiDAR Inpainting of UAV Based 3D Point Cloud Using Supervised Learning'. Together they form a unique fingerprint.

Cite this