FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery

doi:10.1016/j.isprsjprs.2021.12.004

	FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery
	Sun, Xian 1,2,3; Wang, Peijin 1,2,3; Yan, Zhiyuan 1,2,3; Xu, Feng 4; Wang, Ruiping 5; Diao, Wenhui 1,2,3; Chen, Jin 6; Li, Jihao 1,2,3; Feng, Yingchao 1,2,3; Xu, Tao 1,2,3; Weinmann, Martin 7; Hinz, Stefan 7; Wang, Cheng 8,9; Fu, Kun 1,2,3
	2022-02-01
发表期刊	ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING
ISSN	0924-2716
卷号	184 页码:116-130
摘要	With the rapid development of deep learning, many deep learning-based approaches have made great achievements in object detection tasks. It is generally known that deep learning is a data-driven approach. Data directly impact the performance of object detectors to some extent. Although existing datasets include common objects in remote sensing images, they still have some scale, category, and image limitations. Therefore, there is a strong requirement for establishing a large-scale object detection benchmark for high-resolution remote sensing images. In this paper, we propose a novel benchmark dataset with more than 1 million instances and more than 40,000 images for Fine-grAined object recognItion in high-Resolution remote sensing imagery which is named as FAIR1M. We collected remote sensing images with a resolution of 0.3 m to 0.8 m from different platforms, which are spread across many countries and regions. All objects in the FAIR1M dataset are annotated with respect to 5 categories and 37 subcategories by oriented bounding boxes. Compared with existing detection datasets that are dedicated to object detection, the FAIR1M dataset has 4 particular characteristics: (1) it is much larger than other existing object detection datasets both in terms of the number of instances and the number of images, (2) it provides richer fine-grained category information for objects in remote sensing images, (3) it contains geographic information such as latitude, longitude and resolution attributes, and (4) it provides better image quality due to the use of a careful data cleaning procedure. Based on the FAIR1M dataset, we propose three fine-grained object detection and recognition tasks. Moreover, we evaluate several state-of-the-art approaches to establish baselines for future research. Experimental results indicate that the FAIR1M dataset effectively represents real remote sensing applications and is quite challenging for existing methods. Considering the fine-grained characteristics, we improve the evaluation metric and introduce the idea of hierarchy detection into the algorithms. We believe that the FAIR1M dataset will contribute to the earth observation community via fine-grained object detection in large-scale real-world scenes. FAIR1M Website: http://gaofen-challenge.com/.
关键词	Remote sensing images Fine-grained object detection and recognition Deep learning Benchmark dataset Convolutional neural network (CNN)
DOI	10.1016/j.isprsjprs.2021.12.004
收录类别	SCI
语种	英语
资助项目	ISPRS Scientific Initiatives 2021 ; National Natural Science Foundation of China[61725105] ; Major Project of the China High-resolution Earth Observation System[GFZX0404120201/GFZX0404120205] ; [2021]
WOS研究方向	Physical Geography ; Geology ; Remote Sensing ; Imaging Science & Photographic Technology
WOS类目	Geography, Physical ; Geosciences, Multidisciplinary ; Remote Sensing ; Imaging Science & Photographic Technology
WOS记录号	WOS:000784317000002
出版者	ELSEVIER
引用统计	被引频次：208[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/18905
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Wang, Cheng; Fu, Kun
作者单位	1.Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Sch Elect, Elect & Commun Engn, Beijing 100049, Peoples R China 3.Aerosp Informat Res Inst, Chinese Acad Sci, Key Lab Network Informat Syst Technol NIST, Beijing 100190, Peoples R China 4.Fudan Univ, Key Lab Informat Sci Electromagnet Waves MoE, Shanghai, Peoples R China 5.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 6.Beijing Remote Sensing Informat Inst, Beijing 100011, Peoples R China 7.Inst Photogrammetry & Remote Sensing, Karlsruhe Inst Technol, Karlsruhe, Germany 8.Xiamen Univ, Sch Informat Sci & Engn, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen 361005, Peoples R China 9.Fujian Collaborat Innovat Ctr Big Data Applicat G, Fuzhou 350003, Peoples R China
推荐引用方式 GB/T 7714	Sun, Xian,Wang, Peijin,Yan, Zhiyuan,et al. FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery[J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,2022,184:116-130.
APA	Sun, Xian.,Wang, Peijin.,Yan, Zhiyuan.,Xu, Feng.,Wang, Ruiping.,...&Fu, Kun.(2022).FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery.ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING,184,116-130.
MLA	Sun, Xian,et al."FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery".ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING 184(2022):116-130.