首页 >  , Vol. , Issue () : -

摘要

全文摘要次数: 206 全文下载次数: 89
引用本文:

DOI:

10.11834/jrs.20254504

收稿日期:

2024-11-04

修改日期:

2025-03-11

PDF Free   EndNote   BibTeX
航空遥感图像旋转目标检测技术研究综述
党敏1, 刘刚1, 王泉1,2, 张元泽1,2, 王笛1,2, 潘蓉1,2
1.西安电子科技大学计算机科学与技术学院;2.陕西省智能人机交互与可穿戴技术重点实验室
摘要:

目标检测是计算机视觉领域中一项核心且具有挑战性的任务。近年来,目标检测在自然图像上取得了巨大成功,针对航空遥感图像目标检测的研究也取得了显著进展。与自然图像中水平目标不同,航空遥感图像中的目标往往以任意方向密集分布于复杂多变的背景之中。为精确高效定位方向目标并识别其类别,以水平检测为基础的旋转目标检测任务被提出。基于深度学习尤其是卷积神经网络(Convolutional Neural Network,CNNs)的旋转目标检测虽然受到越来越多的关注,但当前对其存在的挑战缺乏系统性研究。本文重点阐述了航空遥感图像目标检测的研究现状,系统性地剖析了旋转目标检测存在的挑战性难题,目标在于推动相关检测技术的发展。首先,梳理归纳了水平目标检测的通用框架,它们也是旋转目标检测框架的设计基础;其次,重点剖析了旋转目标检测任务面临的主要挑战,总结了应对每项挑战而产生的主要研究成果,及其优势和局限性;第三,简要介绍了常用的遥感图像目标检测数据集,并在DOTA、HRSC2016、DIOR-R、STAR等公开遥感图像基准数据集上对当前先进的旋转目标检测器进行了评估对比,在验证当前研究成果显著成效的同时,也初步揭示了它们在处理极端几何形状与复杂场景下存在的局限性;最后,在上述基础上,对航空遥感图像旋转目标检测任务的发展趋势与进一步的研究方向进行了展望。

A review of oriented object detection in aerial remote sensing images
Abstract:

Object detection mainly involves classification and regression, a basic task of computer vision and has been widely studied. Early research mainly focused on horizontal object detection in natural image scenes. In recent years, with the development of convolutional neural networks (CNNs), many general object detection methods have been proposed and achieved good results on natural images, which greatly promoted the development of object detection tasks in aerial remote sensing images. Compared with natural images, aerial remote-sensing images have complex backgrounds, and objects are densely distributed in arbitrary orientation. Therefore, traditional horizontal object detection is no longer suitable for object detection in aerial remote sensing images. According to the requirements of object detection tasks in aerial remote sensing images, the task of oriented object detection that relies on oriented bounding boxes (OBBs) to detect oriented objects accurately has gradually emerged. Most oriented object detection relies on the horizontal proposal/anchor of mainstream horizontal object detection frameworks to predict the OBBs. Although significant progress has been made in performance, some fundamental flaws still exist, including the introduction of object-irrelevant information in the region features, as well as more complex rotation information calculation. At the same time, traditional CNNs cannot explicitly model the orientation variation of objects, which seriously affects the detection performance. Most existing oriented object detectors are based on horizontal object detectors by introducing an additional channel in the regression branch to predict the angle parameters. Although angle regression-based methods have shown promising results, they still face some fundamental limitations. Compared with horizontal object detectors, angle-regression detectors bring new problems, mainly including 1) inconsistency between metrics and losses, 2) boundary discontinuity, and 3) square-like problems. At the same time, small objects in arbitrary orientation pose great challenges to existing detectors, especially small oriented objects with extreme geometric shapes and limited features, which can lead to serious feature mismatch. These challenges have garnered widespread attention and prompted in-depth consideration from researchers in the relevant fields. To further promote the development of oriented object detection, this paper mainly summarizes and analyzes the research status of oriented object detection in aerial remote sensing images. Currently, various pipelines exist for object detection, with the most common approach adding an angle output channel to the regression branch to predict the OBBs. As a result, many oriented object detectors are built upon the horizontal object detection framework. This paper begins by reviewing key representative horizontal object detectors. With the development of object detection, many well-designed oriented object detection methods have been proposed and show good performance. The main challenges faced in current oriented object detection research are summarized in this paper into five aspects: 1) feature alignment in object detection, 2) the inconsistency between metric and loss, 3) boundary discontinuity and square-like problems; and 4) low recognizability of small objects, 5) label annotation problem. This paper provides a comprehensive analysis of these challenges, introduces proposed methods to address them, and discusses representative solutions in detail. The limitations and shortcomings of existing methods are examined, with potential directions for future exploration considered. In the field of oriented object detection in aerial remote sensing images, several widely used and representative public benchmark datasets with OBB annotations are summarized and introduced in detail. The experimental results and visualizations of representative state-of-the-art detectors are compared and analyzed using the most employed datasets, DOTA, HRSC2016, DIOR-R, and STAR. Current one-stage detectors are both simple and effective, with anchor-free object detectors demonstrating comparable detection accuracy to traditional two-stage detectors. On this basis, this paper integrates the current research status of object detection in aerial remote-sensing images and anticipates future research trends. To enhance the detection accuracy of oriented object detection while optimizing model complexity, future research could focus on developing anchor-free oriented object detectors, extracting rotation-invariant features, and minimizing annotation costs through weak supervision. Through this review, we aim to provide a valuable reference for researchers interested in exploring oriented object detection in aerial remote sensing images.

本文暂时没有被引用!

欢迎关注学报微信

遥感学报交流群