Skip to content
Licensed Unlicensed Requires Authentication Published by Oldenbourg Wissenschaftsverlag January 11, 2017

Big Data in a Crisis? Creating Social Media Datasets for Crisis Management Research

Christian Reuter, Thomas Ludwig, Christoph Kotthaus, Marc-André Kaufhold, Elmar von Radziewski and Volkmar Pipek
From the journal i-com


A growing body of research in the area of information systems for crisis management is based on data from social media. After almost every larger disaster studies emerge with the focus on the specific use of social media. Much of this research is based on Twitter data, due to the ease of access of this (mainly public) data, compared to (more closed) data, such as Facebook or Google+. Based on the experience gained from a research project on social media in emergencies and our task to collect social media data sets for other partners, we present the design and evaluation of a graphical user interface that supports those stakeholders (such as emergency services or researchers) that are interested in creating social media datasets for further crisis management research. We do not specifically focus on the analysis of social media data. Rather we aim to support the gathering process and how actors without sophisticated technical skills can be supported to get what they want and especially need: relevant social media data. Within this article, we present a practice-oriented approach and implications for designing tools that support the collection of social media data as well as future work.


The research project ‘EmerGent’ was funded by a grant of the European Union (FP7 No. 608352). The research project ‘KOKOS’ was funded by the German Federal Ministry for Education and Research (No. 13N13559). We would like to thank all participants of our empirical study.


[1] VAN DER AALST, WIL M P: Data Scientist: The Engineer of the Future. In: MERTINS, K.; BÉNABEN, F.; POLER, R.; BOURRIÈRES, J.-P. (Hrsg.): Enterprise Interoperability VI: Interoperability for Agility, Resilience and Plasticity of Collaborations. Cham: Springer International Publishing, 2014 — ISBN 978-3-319-04948-9, S. 13–26.10.1007/978-3-319-04948-9_2Search in Google Scholar

[2] AGICHTEIN, EUGENE; CASTILLO, CARLOS; DONATO, DEBORA: Finding High-Quality Content in Social Media. In: Proceedings of the International Conference on Web Search and Data Mining, 2008, S. 183–193.10.1145/1341531.1341557Search in Google Scholar

[3] ALIM, S.; ABDUL-RAHMAN, R.; NEAGU, D.; RIDLEY, M.: Data retrieval from online social network profiles for social engineering applications. In: 2009 International Conference for Internet Technology and Secured Transactions, (ICITST): IEEE, 2009 — ISBN 978-1-4244-5648-2, S. 1–5.Search in Google Scholar

[4] ANDERSON, KENNETH M; AYDIN, AHMET ARIF; BARRENECHEA, MARIO; CARDENAS, ADAM; HAKEEM, MAZIN; JAMBI, SAHAR: Design Challenges / Solutions for Environments Supporting the Analysis of Social Media Data in Crisis Informatics Research. In: 2015 48th Hawaii International Conference on System Sciences, 2015 — ISBN 9781479973675, S. 163–172.10.1109/HICSS.2015.29Search in Google Scholar

[5] BATRINCA, BOGDAN; TRELEAVEN, PHILIP C.: Social media analytics: a survey of techniques, tools and platforms. In: AI & SOCIETY Bd. 30, Springer-Verlag (2014), Nr. 1, S. 89–116.10.1007/s00146-014-0549-4Search in Google Scholar

[6] BIRKBAK, ANDREAS: Crystallizations in the Blizzard: Contrasting Informal Emergency Collaboration In Facebook Groups. In: Proceedings of the Nordic Conference on Human-Computer Interaction (NordiCHI). Copenhagen, Denmark: ACM, 2012 — ISBN 9781450314824, S. 428–437.Search in Google Scholar

[7] BÖCK, MATTHIAS; KÖBLER, FELIX; ANDERL, EVA; LE, LINDA: Social Media-Analyse – Mehr als nur eine Wordcloud? In: HMD Praxis der Wirtschaftsinformatik (2016).10.1007/978-3-658-19802-2Search in Google Scholar

[8] BOLLEN, JOHAN L T M; MAO, HULNA: Predicting economic trends via network communication mood tracking | US 8380607 B2.Search in Google Scholar

[9] BOLLEN, JOHAN; MAO, HUINA; ZENG, XIAOJUN: Twitter mood predicts the stock market. In: Journal of Computational Science Bd. 2 (2011), Nr. 1, S. 1–8.10.1016/j.jocs.2010.12.007Search in Google Scholar

[10] du BOULAY, BENEDICT; O’SHEA, TIM; MONK, JOHN: The black box inside the glass box: presenting computing concepts to novices. In: International Journal of Man-Machine Studies Bd. 14 (1981), Nr. 3, S. 237–249.10.1006/ijhc.1981.0309Search in Google Scholar

[11] CASTILLO, CARLOS: Big Crisis Data – Social Media in Disasters and Time-Critical Situations: Cambridge University Press, 2016.10.1017/CBO9781316476840Search in Google Scholar

[12] CHAE, JUNGHOON; THOM, DENNIS; BOSCH, HARALD; JANG, YUN; MACIEJEWSKI, ROSS; EBERT, DAVID S.; ERTL, THOMAS: Spatiotemporal social media analytics for abnormal event detection and examination using seasonal-trend decomposition. In: IEEE Conference on Visual Analytics Science and Technology 2012, VAST 2012 – Proceedings (2012), S. 143–152 — ISBN 9781467347532.Search in Google Scholar

[13] HEINECKE, ANDREAS M.: Mensch-Computer-Interaktion: Basiswissen für Entwickler und Gestalter, Berlin, Heidelberg: Springer Berlin Heidelberg, 2012 — ISBN 978-3-642-13506-4.10.1007/978-3-642-13507-1Search in Google Scholar

[14] HERCZEG, MICHAEL: Prozessführungssysteme: Sicherheitskritische Mensch-Maschine-Systeme und interaktive Medien zur Überwachung und Steuerung von Prozessen in Echtzeit: De Gruyter, 2014.10.1524/9783486720051Search in Google Scholar

[15] HOWARD, C.; PLUMMER, D. C.; GENOVESE, Y.; MANN, J.; WILLIS, D.  A.; SMITH, D. M.: The nexus of forces: Social, mobile, cloud and information, 2012.Search in Google Scholar

[16] HUGHES, AMANDA LEE; DENIS, LISE A ST; PALEN, LEYSIA; ANDERSON, KENNETH M: Online Public Communications by Police & Fire Services during the 2012 Hurricane Sandy. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI). Toronto, Canada: ACM, 2014, S. 1505–1514.Search in Google Scholar

[17] HUGHES, AMANDA LEE; TAPIA, ANDREA H.: Social Media in Crisis: When Professional Responders Meet Digital Volunteers. In: Journal of Homeland Security and Emergency Management Bd. 12 (2015), Nr. 3, S. 679–706.10.1515/jhsem-2014-0080Search in Google Scholar

[18] KLAFFT, M: Diffusion of emergency warnings via multi-channel communication systems an empirical analysis. In: Autonomous Decentralized Systems (ISADS), 2013 IEEE Eleventh International Symposium on, 2013, S. 1–5.10.1109/ISADS.2013.6513437Search in Google Scholar

[19] KOCH, MICHAEL; RICHTER, ALEXANDER: Enterprise 2.0 – Planung, Einführung und erfolgreicher Einsatz von Social Software in Unternehmen: Oldenbourg-Verlag, 2009 — ISBN 9783486590548.10.1524/9783486593648Search in Google Scholar

[20] KÖNIG, CHRISTIAN; STAHL, MATTHIAS; WIEGAND, ERICH: Soziale Medien: Gegenstand und Instrument der Forschung: Springer, 2014.10.1007/978-3-658-05327-7Search in Google Scholar

[21] LUDWIG, THOMAS; REUTER, CHRISTIAN; SIEBIGTEROTH, TIM; PIPEK, VOLKMAR: CrowdMonitor: Mobile Crowd Sensing for Assessing Physical and Digital Activities of Citizens during Emergencies. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI). Seoul, Korea: ACM Press, 2015.Search in Google Scholar

[22] MCCREADIE, RICHARD; MACDONALD, CRAIG; OUNIS, IADH: EAIMS : Emergency Analysis Identification and Management System. In: ACM (Hrsg.): Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR ’16). New York, 2016 — ISBN 9781450340694, S. 1101–1104.10.1145/2911451.2911460Search in Google Scholar

[23] NARANG, RISHI K.: Inside the Black Box: The Simple Truth About Quantitative Trading. Hoboken: Wiley, 2009.10.1002/9781118267738Search in Google Scholar

[24] NERI, F.; ALIPRANDI, C.; CAPECI, F.; CUADROS, M.; BY, T.: Sentiment Analysis on Social Media. In: 2012 IEEE / ACM International Conference on Advances in Social Networks Analysis and Mining: IEEE, 2012 — ISBN 978-1-4673-2497-7, S. 919–926.Search in Google Scholar

[25] NIELSEN, JAKOB: Usability Engineering. San Francisco, USA: Morgan Kaufmann, 1993.10.1016/B978-0-08-052029-2.50007-3Search in Google Scholar

[26] OLTEANU, ALEXANDRA; VIEWEG, SARAH; CASTILLO, CARLOS: What to Expect When the Unexpected Happens: Social Media Communications Across Crises. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW ’15. New York, NY, USA: ACM, 2015 — ISBN 978-1-4503-2922-4, S. 994–1009.Search in Google Scholar

[27] PALEN, LEYSIA; ANDERSON, KENNETH M: Crisis informatics: New data for extraordinary times. In: Science Bd. 353, American Association for the Advancement of Science (2016), Nr. 6296, S. 224–225.10.1126/science.aag2579Search in Google Scholar PubMed

[28] PALEN, LEYSIA; LIU, SOPHIA B.: Citizen communications in crisis: anticipating a future of ICT-supported public participation. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI). San Jose, USA: ACM Press, 2007, S. 727–736.Search in Google Scholar

[29] PALEN, LEYSIA; VIEWEG, SARAH; LIU, SOPHIA B.; HUGHES, AMANDA LEE: Crisis in a Networked World: Features of Computer-Mediated Communication in the April 16, 2007, Virginia Tech Event. In: Social Science Computer Review Bd. 27 (2009), Nr. 4, S. 467–480.10.1177/0894439309332302Search in Google Scholar

[30] PATINO, ANTHONY; PITTA, DENNIS A.; QUINONES, RALPH: Social media’s emerging importance in market research. In: Journal of Consumer Marketing Bd. 29, Emerald Group Publishing Limited (2013), Nr. 3, S. 233–237.10.1108/07363761211221800Search in Google Scholar

[31] PFEFFER, JÜRGEN; ZORBACH, THOMAS; CARLEY, KATHLEEN M.: Understanding online firestorms: Negative word-of-mouth dynamics in social media networks. In: Journal of Marketing Communications Bd. 20 (2104), Nr. 14, S. 1–2.10.1080/13527266.2013.797778Search in Google Scholar

[32] POLSON, P.; LEWIS, C.; RIEMAN, J.; WHARTON, C.: Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. In: International Journal of Man–Machine Studies Bd. 36 (1992), S. 741–73.10.1016/0020-7373(92)90039-NSearch in Google Scholar

[33] REUTER, CHRISTIAN; LUDWIG, THOMAS; KAUFHOLD, MARC-ANDRÉ; PIPEK, VOLKMAR: XHELP: Design of a Cross-Platform Social-Media Application to Support Volunteer Moderators in Disasters. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI). Seoul, Korea: ACM Press, 2015.Search in Google Scholar

[34] REUTER, CHRISTIAN; LUDWIG, THOMAS; KAUFHOLD, MARC-ANDRÉ; SPIELHOFER, THOMAS: Emergency Services Attitudes towards Social Media: A Quantitative and Qualitative Survey across Europe. In: International Journal on Human-Computer Studies (IJHCS) Bd. 95 (2016), S. 96–111.10.1016/j.ijhcs.2016.03.005Search in Google Scholar

[35] REUTER, CHRISTIAN; LUDWIG, THOMAS; PIPEK, VOLKMAR: Ad Hoc Participation in Situation Assessment: Supporting Mobile Collaboration in Emergencies. In: ACM Transactions on Computer-Human Interaction (ToCHI) Bd. 21, ACM (2014), Nr. 5.10.1145/2651365Search in Google Scholar

[36] REUTER, CHRISTIAN; LUDWIG, THOMAS; RITZKATIS, MICHAEL; PIPEK, VOLKMAR: Social-QAS: Tailorable Quality Assessment Service for Social Media Content. In: Proceedings of the International Symposium on End-User Development (IS-EUD). Lecture Notes in Computer Science, 2015.10.1007/978-3-319-18425-8_11Search in Google Scholar

[37] REUTER, CHRISTIAN; SCHOLL, SIMON: Technical Limitations for Designing Applications for Social Media. In: M.~KOCH,~A.~BUTZ, ~&~J.~SCHLICHTER (Hrsg.): Mensch & Computer: Workshopband. München, Germany, Germany: Oldenbourg-Verlag, 2014, S. 131–140.10.1524/9783110344509.131Search in Google Scholar

[38] RÖMER, STEPHAN: Erhebungsmethoden und Tools. In: BUNDESVERBAND DIGITALE WIRTSCHAFT (BVDW) E. V. (Hrsg.): Social Medie Kompass 2015 / 20162. Düsseldorf, 2015, S. 14–16.Search in Google Scholar

[39] STEFFEN, DIRK: Verknüpfung von Daten aus Sozialen Medien mit klassischen Erhebungsmethoden. In: KÖNIG, C.; STAHL, M.; WIEGAND, E. (Hrsg.): Soziale Medien – Gegenstand und Instrument der Forschung. Wiesbaden: Springer Fachmedien Wiesbaden, 2014 — ISBN 978-3-658-05326-0, S. 97–110.10.1007/978-3-658-05327-7_5Search in Google Scholar

[40] STIEGLITZ, STEFAN; BRUNS, AXEL; KRÜGER, NINA: Enterprise-Related Crisis Communication on Twitter. In: Wirtschaftsinformatik Proceedings, 2015.Search in Google Scholar

[41] STIEGLITZ, STEFAN; DANG-XUAN, LINH; BRUNS, AXEL; NEUBERGER, CHRISTOPH: Social media analytics – An Interdisciplinary Approach and Its Implications for Information Systems. In: Business and Information Systems Engineering Bd. 6 (2014), Nr. 2, S. 89–96.10.1007/s12599-014-0315-7Search in Google Scholar

[42] TANG, JILIANG; CHANG, YI; LIU, HUAN: Mining social media with social theories: a survey. In: ACM SIGKDD Explorations Newsletter Bd. 15, ACM (2014), Nr. 2, S. 20–29.10.1145/2641190.2641195Search in Google Scholar

[43] ULLRICH, SUSANNE; URBANIAK, MATHIAS: Datenquellen für die Social-Media-Datenerhebung. In: BUNDESVERBAND DIGITALE WIRTSCHAFT (BVDW) E. V. (Hrsg.): Social Medie Kompass 2015 / 2016. Düsseldorf, 2015, S. 11–13.Search in Google Scholar

[44] WORLD WIDE WEB CONSORTIUM: ActivityStreams Vocabulary. — W3C Working Draft.Search in Google Scholar

[45] ZUBER, MOHAMMED: A Survey of Data Mining Techniques for Social Network Analysis. In: International Journal of Research in Computer Engineering and Electronics Bd. 3 (2014), Nr. 6, S. 1–8.Search in Google Scholar

Published Online: 2017-01-11
Published in Print: 2016-12-01

© 2016 Walter de Gruyter GmbH, Berlin/Boston

Scroll Up Arrow