SpaceNet 9 - Cross-Sensor Alignment of Optical and SAR Imagery

Research output: Contribution to journalArticlepeer-review

Abstract

Precise registration of high-resolution SAR and optical imagery is necessary for realizing the full potential and benefits of multimodal image analysis. However, two significant challenges presently exist. First, there is a lack of annotated datasets and benchmarks available for high-resolution SAR optical image registration. Second, an assessment of efficient and reliable image registration methods that can precisely align these modalities is lacking. Here, we present a holistic description of the SpaceNet 9 Challenge and its results. We present a description of the dataset and baseline algorithm along with the results of the challenge including a description of the winning algorithms. We release the SpaceNet 9 dataset along with open-sourcing the winning algorithms and baseline. The objective of SpaceNet 9 was to compute a dense displacement map that indicates the shift needed to align pixels in an optical image to the pixels in a SAR image. The challenge launched in April 2025 and was active for approximately two months. The top five solutions reduced image alignment error from approximately 34 meters to under 13 meters for public and private test data, with the best results obtaining a registration error of only 8.5 and 6.7 meters on the public testing and private testing dataset, respectively. Usage of pretrained image matching models, robust outlier rejection with RANSAC, and estimating local displacement were common among the top solutions. The results of this challenge provide insight into high-resolution SAR-optical image registration and offer opportunities for future benchmarking in this domain.

Keywords

  • benchmark datasets
  • cross-modal
  • Image registration
  • multi modal learning
  • optical
  • SAR

Fingerprint

Dive into the research topics of 'SpaceNet 9 - Cross-Sensor Alignment of Optical and SAR Imagery'. Together they form a unique fingerprint.

Cite this