Damage assessment from social media imagery data during disasters

Dat T. Nguyen, Ferda Ofli, Muhammad Imran, Prasenjit Mitra

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.

Original languageEnglish
Title of host publicationProceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017
PublisherAssociation for Computing Machinery, Inc
Pages569-576
Number of pages8
ISBN (Electronic)9781450349932
DOIs
Publication statusPublished - 31 Jul 2017
Event9th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017 - Sydney, Australia
Duration: 31 Jul 20173 Aug 2017

Other

Other9th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017
CountryAustralia
CitySydney
Period31/7/173/8/17

Fingerprint

Disasters
Neural networks
Learning systems
Tuning

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Cite this

Nguyen, D. T., Ofli, F., Imran, M., & Mitra, P. (2017). Damage assessment from social media imagery data during disasters. In Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017 (pp. 569-576). Association for Computing Machinery, Inc. https://doi.org/10.1145/3110025.3110109

Damage assessment from social media imagery data during disasters. / Nguyen, Dat T.; Ofli, Ferda; Imran, Muhammad; Mitra, Prasenjit.

Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. Association for Computing Machinery, Inc, 2017. p. 569-576.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nguyen, DT, Ofli, F, Imran, M & Mitra, P 2017, Damage assessment from social media imagery data during disasters. in Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. Association for Computing Machinery, Inc, pp. 569-576, 9th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017, Sydney, Australia, 31/7/17. https://doi.org/10.1145/3110025.3110109
Nguyen DT, Ofli F, Imran M, Mitra P. Damage assessment from social media imagery data during disasters. In Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. Association for Computing Machinery, Inc. 2017. p. 569-576 https://doi.org/10.1145/3110025.3110109
Nguyen, Dat T. ; Ofli, Ferda ; Imran, Muhammad ; Mitra, Prasenjit. / Damage assessment from social media imagery data during disasters. Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017. Association for Computing Machinery, Inc, 2017. pp. 569-576
@inproceedings{b1e3f44864de4cd28f3e0b1dd65e7298,
title = "Damage assessment from social media imagery data during disasters",
abstract = "Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.",
author = "Nguyen, {Dat T.} and Ferda Ofli and Muhammad Imran and Prasenjit Mitra",
year = "2017",
month = "7",
day = "31",
doi = "10.1145/3110025.3110109",
language = "English",
pages = "569--576",
booktitle = "Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Damage assessment from social media imagery data during disasters

AU - Nguyen, Dat T.

AU - Ofli, Ferda

AU - Imran, Muhammad

AU - Mitra, Prasenjit

PY - 2017/7/31

Y1 - 2017/7/31

N2 - Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.

AB - Rapid access to situation-sensitive data through social media networks creates new opportunities to address a number of real-world problems. Damage assessment during disasters is a core situational awareness task for many humanitarian organizations that traditionally takes weeks and months. In this work, we analyze images posted on social media platforms during natural disasters to determine the level of damage caused by the disasters. We employ state-of-the-art machine learning techniques to perform an extensive experimentation of damage assessment using images from four major natural disasters. We show that the domain-specific fine-tuning of deep Convolutional Neural Networks (CNN) outperforms other state-of-the-art techniques such as Bag-of-Visual-Words (BoVW). High classification accuracy under both event-specific and cross-event test settings demonstrate that the proposed approach can effectively adapt deep-CNN features to identify the severity of destruction from social media images taken after a disaster strikes.

UR - http://www.scopus.com/inward/record.url?scp=85040229335&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040229335&partnerID=8YFLogxK

U2 - 10.1145/3110025.3110109

DO - 10.1145/3110025.3110109

M3 - Conference contribution

SP - 569

EP - 576

BT - Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2017

PB - Association for Computing Machinery, Inc

ER -