Structuralizing disaster-scene data through auto-captioning

Alina Klerings, Shiming Tang, Zhi Qiang Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Disaster-scene images documenting the magnitude and effects of natural disasters nowadays can be easily collected through crowdsourcing aided by mobile technologies (e.g., smartphones or drones). One challenging issue that confronts the first-responders who desire the use of such data is the non-structured nature of these crowdsourced images. Among other techniques, one natural way is to structuralize disaster-scene images through captioning. Through captioning, their imagery contents are augmented by descriptive captions that further enable more effective search and query (S&Q). This work presents a preliminary test by exploiting an end-to-end deep learning framework with a linked CNN-LSTM architecture. Demonstration of the results and quantitative evaluation are presented that showcase the validity of the proposed concept.

Original languageEnglish
Title of host publicationProceedings of the 2nd ACM SIGSPATIAL International Workshop on Advances in Resilient and Intelligent Cities, ARIC 2019
EditorsBandana Kar, Olufemi A. Omitaomu, Xinyue Ye, Shima Mohebbi, Guangtao Fu
PublisherAssociation for Computing Machinery, Inc
Pages29-32
Number of pages4
ISBN (Electronic)9781450369541
DOIs
StatePublished - Nov 5 2019
Externally publishedYes
Event2nd ACM SIGSPATIAL International Workshop on Advances in Resilient and Intelligent Cities, ARIC 2019 - Chicago, United States
Duration: Nov 5 2019 → …

Publication series

NameProceedings of the 2nd ACM SIGSPATIAL International Workshop on Advances in Resilient and Intelligent Cities, ARIC 2019

Conference

Conference2nd ACM SIGSPATIAL International Workshop on Advances in Resilient and Intelligent Cities, ARIC 2019
Country/TerritoryUnited States
CityChicago
Period11/5/19 → …

Keywords

  • Autonomous caption
  • Deep learning
  • Disaster resilience
  • Disaster scenes

Fingerprint

Dive into the research topics of 'Structuralizing disaster-scene data through auto-captioning'. Together they form a unique fingerprint.

Cite this