Epidemic outbreak and spread detection system based on twitter data
Document Type
Conference Proceeding
Publication Date
4-16-2012
Abstract
Social Network systems, such as Twitter, can serve as important data sources to provide collective intelligence and awareness of health problems in real time. The challenges of utilizing social media data include that the volume of data is large but distributed and of a highly unstructured form. Appropriate data gathering, scrubbing and aggregating efforts for these data are required to transform them for meaningful use. In this paper, we discuss such a social media data ETL (Extract-Transform-Load) method, to provide a user-friendly, dynamic method for visualizing outbreaks and the spread of developing epidemics in space and time. We have developed the Epidemics Outbreak and Spread Detection System (EOSDS) as a prototype that makes use of the rich information retrievable in real time from Twitter. EOSDS provides three different visualization methods of spreading epidemics, static map, distribution map, and filter map, to investigate public health threats in the space and time dimensions. The results of these visualizations in our experiments correlate well with relevant CDC official reports, a gold standard used by health informatics scientists. In our experiments, the EOSDS also detected an unusual situation not shown in the CDC reports, but confirmed by online news media. © 2012 Springer-Verlag.
Identifier
84859565382 (Scopus)
ISBN
[9783642293603]
Publication Title
Lecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics
External Full Text Location
https://doi.org/10.1007/978-3-642-29361-0_19
e-ISSN
16113349
ISSN
03029743
First Page
152
Last Page
163
Volume
7231 LNCS
Recommended Citation
Ji, Xiang; Chun, Soon Ae; and Geller, James, "Epidemic outbreak and spread detection system based on twitter data" (2012). Faculty Publications. 18288.
https://digitalcommons.njit.edu/fac_pubs/18288
