Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter July 3, 2015

Principle-Based Design: A Methodology and Principles for Capitalizing Design Experiences for Information Quality Assurance

Nitesh Bharosa and Marijn Janssen

Abstract

We know that information quality affects the performance of relief agencies during emergency management processes. Yet, recent studies keep revealing that relief workers faced information quality challenges during emergencies. While this can be partly attributed to the fragmented nature of the incompatible information systems that were designed from a single-agency perspective in order to support routine processes, there is a desperate need for overarching architecture principles that allow for the support of non-routine, interagency information needs. Principles are defined as normative, reusable and directive statements that guide architects in designing the capabilities needed to achieve overarching goals. This study presents a methodology for extracting such principles for information systems that can be employed for emergency management processes. Based on literature review, case surveys, interviews with architects and qualitative analysis, 12 principles are proposed for information quality assurance. Architects working at relief agencies can adopt these principles to redesign information systems in order to assure information quality from an interagency perspective. Due to the absence of an interagency system governing body, the main challenge lies in promoting and monitoring the adoption of such principles across relief agencies.


Corresponding author: Nitesh Bharosa, Delft University of Technology – Faculty of Technology, Policy & Management, ICT Department, Delft, The Netherlands, e-mail:

Appendix: Interviewees and Interview Protocol

The following Table 4 provides an overview of the interviewed information system architects. Only their first names are mentioned to ensure anonymity.

Table 4

Overview of Respondents.

Id.NrRespondentOrganizationBackground/Expertise
1WimPoliceFormer police squad commander, current head of the interagency emergency management training department
2AntonRotterdam Port AuthorityEmergency control room systems, communication technologies
3PeterGeo-technology providerGeographic information technologies for emergency management
4DaanPort AuthorityPort-officer squad commander
5LeoMinistry of Internal Affairs and Kingdom Relations, Department of Safety and Crisis ManagementDevelopment and implementation of advanced emergency management technologies, Network Centric Operations expert
6RalphChemical servicesChemical materials, codes, standards and technologies.
7VincentFire departmentFire squad manager, information management
8TonAmbulance ServicesAmbulance tracking systems, victim monitoring systems
9Willem-JanFire departmentICT support, organizational information-sharing
10MartijnHazmat servicesHazardous materials registration, risk communication and data sharing
11SanderPoliceInformation architectures, application manager
12MarkAmbulanceInformation management
13LeoPoliceICT architect, registration systems
14MarcelFire departmentInformation management
15KeesInfrastructure servicesInformation system displays, communication systems architect
16Jan-WillemApplication providerEmergency response systems, service-oriented architectures

The interviews were conducted using a semi-structured interview protocol, which included the following category of topics and examples of questions. The respondents were requested to consider their response from the perspective of their own organization and from an interagency perspective.

  1. Information quality dimensions and problems during interagency emergency management.

    1. Are you familiar with information quality dimensions?

    2. Do you recognize some of these problems <short-list table 2>

    3. Can you give other examples of information-related problems

  2. Current information systems

    1. What kind of information systems do you operate or design?

    2. How do the current information systems perform in terms of information quality during routine operations? And during interagency emergency management?

  3. Principles and best practices

    1. Is assuring information quality one of your priorities?

    2. How do you address information quality problems? <based on the short-list provided in table 2>

    3. Are there any principles or guidelines you use for assuring information quality?

    4. Can you give any examples of solutions or best practices?

    5. Can you recommend any best practices?

References

Aarholt, E. and O. Berg (2004) Network Centric Information Structure – Crisis Information Management. Lysaker, Norway: Teleplan AS.Search in Google Scholar

Alberts, D. and R. Hayes (2007) Planning: Complex Endeavors. Washington, DC: DoD Command and Control Research Program.10.21236/ADA465653Search in Google Scholar

Allen, D., S. Karanasios and A. Norman (2014) “Information Sharing and Interoperability: The Case of Major Incident Management,” European Journal of Information Systems, 23(4):418–431.10.1057/ejis.2013.8Search in Google Scholar

Atoji, Y., T. Koiso and S. Nishida (2000) Information Filtering for Emergency Management. In IEEE International Workshop on Robot and Human Communication Osaka: IEEE.Search in Google Scholar

Ballou, D. P., S. Madnick and R. Y. Wang (2004) “Assuring Information Quality,” Journal of Management Information Systems, 20(3):9–11.Search in Google Scholar

Bharosa, N., J. Lee and M. Janssen (2010) “Challenges and Obstacles in Sharing and Coordinating Information During Multi-Agency Disaster Response: Propositions from Field Exercises,” Information Systems Frontiers, 12(1):49–65.10.1007/s10796-009-9174-zSearch in Google Scholar

Boersma, K., P. Wagenaar and J. Wolbers (2012) “Negotiating the ‘Trading Zone’. Creating a Shared Information Infrastructure in the Dutch Public Safety Sector,” Journal of Homeland Security and Emergency Management, 9(2):1547–7355.10.1515/1547-7355.1965Search in Google Scholar

Celik, S. and S. Corbacioglu (2010) “Role of Information in Collective Action in Dynamic Disaster Environments,” Disasters, 34(1):137–154.10.1111/j.1467-7717.2009.01118.xSearch in Google Scholar

Chen, R., R. Sharman, H. R. Rao and S. Upadhyaya (2007) “Design Principles for Emergency Response Management Systems,” Journal of Information Systems and e-Business Management, 5(3):81–98.Search in Google Scholar

Cherns, A. (1976) “Principles of Socio-Technical Design,” Human Relations, 29(8):783–792.10.1177/001872677602900806Search in Google Scholar

Christopher, C. and B. Robert (2006) Disaster: Hurricane Katrina and the Failure of Homeland Security: Macmillan Publishers.Search in Google Scholar

Clegg, C. W. (2000) “Sociotechnical Principles for System Design,” Applied Ergonomics, 31:463–477.10.1016/S0003-6870(00)00009-0Search in Google Scholar

Comfort, L. and N. Kapucu (2006) “Inter-Organizational Coordination in Extreme Events: The World Trade Center attacks, September 11, 2001,” Natural Hazards, 39(2):309–327.10.1007/s11069-006-0030-xSearch in Google Scholar

Crowther, K. G. (2014) “Understanding and Overcoming Information Sharing Failures,” Journal of Homeland Security and Emergency Management, 11(1):131–154.10.1515/jhsem-2013-0055Search in Google Scholar

Darke, P. and G. Shanks (1996) “Stakeholder Viewpoints in Requirements Definition: A Framework for Understanding Viewpoint Development Approaches,” Requirements engineering, 1:88–105.10.1007/BF01235904Search in Google Scholar

Dawes, S., A. Creswell and B. Cahan (2004) “Learning from Crisis: Lessons in Human and Information Infrastructure from the World Trade Center Response,” Social Science Computer Review, 22(1):52–66.10.1177/0894439303259887Search in Google Scholar

Delone, W. and E. McLean (1992) “Information Systems Succes: The Quest for the Dependent Variable,” Information Systems Research, 3(1):60–95.10.1287/isre.3.1.60Search in Google Scholar

Evans, J. and W. Lindsay (2005) The Management and Control of Quality. (6 ed.) Cincinnati, OH: Thomson Learning.Search in Google Scholar

Fisher, C. W. and B. R. Kingma (2001) “Criticality of Data Quality as Exemplified in Two Disasters,” Information and Management, 39(2):109–116.10.1016/S0378-7206(01)00083-0Search in Google Scholar

Gibb, T. (1997) “Towards the Engineering of Requirements,” Requirements Engineering, 2:165–169.10.1007/BF02802774Search in Google Scholar

Hemard, D. P. (1997) “Design Principles and Guidelines for Authoring Hypermedia Language Learning Applications,” Systems, 25(1):9–27.10.1016/S0346-251X(96)00057-7Search in Google Scholar

Housel, T. J., O. El Sawy and P. F. Donovan (1986) “Information Systems for Crisis Management: Lessons from Southern California Edison,” MIS Quarterly, 10(4):389–400.10.2307/249195Search in Google Scholar

IOOV (2009) Eindrapportage Poldercrash. edited by Inspectie Openbare Orde en Veiligheid.Search in Google Scholar

Jenvald, J., M. Morin and J. P. Kincaid (2001) “A Framework for Web-Based Dissemination of Models and Lessons Learned from Emergency-Response Exercises and Operations,” International Journal of Emergency Management, 1(1):82–94.10.1504/IJEM.2001.000512Search in Google Scholar

Keuchler, W. and V. Vaishnavi (2008) “The Emergence of Design Research in Information Systems in North America,” Journal of Design Research, 7(1):1–17.10.1504/JDR.2008.019897Search in Google Scholar

Klein, L. (1994) “Sociotechnical/Organizational Design.” In: (W. Karwowsk and G. Salvendy, eds.) Organization and Management of Advanced Manufacturing. New York: Wiley, pp. 179–222.Search in Google Scholar

Kontogiannis, T. (1996). “Stress and Operator Decision Making in Coping with Emergencies,” International Journal of Human-Computer Studies, 45(1):75–104.10.1006/ijhc.1996.0043Search in Google Scholar

Larsson, R. (1993) “Case Survey Methodology: Quantitative Analysis of Patterns Across Case Studies,” Academy of Management Review, 39(6):1515–1546.Search in Google Scholar

Lee, Y. W., D. M. Strong, B. K. Kahn and R. Y. Wang (2002) “AIMQ: A Methodology for Information Quality Assessment,” Information and Management, 40:133–146.10.1016/S0378-7206(02)00043-5Search in Google Scholar

Lerner, K. and K. Bertram (2014) “Common Issues in Emergency Public Information as Identified in CSEPP Exercises,” Journal of Homeland Security and Emergency Management, 11(1):155–168.10.1515/jhsem-2013-0059Search in Google Scholar

Locatelli, S. M., S. L. Lavela, T. P. Hogan, A. N. Kerr and F. M. Weaver (2012) “Communication and Information Sharing at VA Facilities during the 2009 novel h1n1 Influenza Pandemic,” American Journal of Infection Control, 40(7):622–626.10.1016/j.ajic.2012.01.035Search in Google Scholar

Maier, M. W. and E. Rechtin (2002) The Art of Systems Architecting. Boca Renton: CRC Press.Search in Google Scholar

Manoj, B. S. and A. Hubenko Baker (2007) “Communication Challenges in Emergency Response,” Communications of the ACM, 50(3):51–53.10.1145/1226736.1226765Search in Google Scholar

Miller, H. (1996) “The Multiple Dimensions of Information Quality,” Information Systems Management, 13(2):79–82.10.1080/10580539608906992Search in Google Scholar

Muhr, T. (1991) “ATLAS/ti–A Prototype for the Support of Text Interpretation,” Qualitative Sociology, 14(4):349–371.10.1007/BF00989645Search in Google Scholar

Richardson, G. L., B. M. Jackson and G. W. Dickson (1990) “A Principles-Based Enterprise Architecture: Lessons from Texaco and Star Enterprise,” MIS Quarterly, 14(4):385–403.10.2307/249787Search in Google Scholar

Samarajiva, R. (2005) “Mobilizing Information and Communications Technologies for Effective Disaster Warning: Lessons from the 2004 Tsunami,” New Media and Society, 7(6):731–747.10.1177/1461444805058159Search in Google Scholar

Simon, H. A. (1996) The Sciences of the Artificial. 3 ed. Cambridge, MA: MIT Press.Search in Google Scholar

Strong, D. M., Y. W. Lee and R. Y. Wang (1997) “Data Quality in Context,” Communications of the ACM, 40(5):103–110.10.1145/253769.253804Search in Google Scholar

The Open Group (2007) The Open Group Architecture Framework TOGAF – 2007 edition.Search in Google Scholar

TOGAF (2004) The Open Group Architecture Framework. Version 8.5, Enterprise Edition.Search in Google Scholar

Townsend et al. (2006) The Federal Response to Hurricane Katrina: Lessons Learned. http://www.whitehouse.gov/reports/katrina-lessons-learned.pdf.Search in Google Scholar

Turoff, M., M. Chumer, B. Van De Walle and X. Yao (2004) “The Design of a Dynamic Emergency Response Management Information System (DERMIS),” Journal of Information Technology Theory and Application (JITTA), 5(4):1–35.Search in Google Scholar

Turoff, M. and S. R. Hiltz (2008) “ Assessing the Health Information Needs of the Emergency Preparedness and Management Community,” Journal of Information Services and Use, 28:269–280.10.3233/ISU-2008-0588Search in Google Scholar

Van de Ven, J., R. Van Rijk, P. Essens and E. Frinking (2008) Network Centric Operations in Crisis Management. Paper read at 5th International ISCRAM Conference. Washington, DC: USA.Search in Google Scholar

van den Akker, J. (1999) “Principles and Methods of Development Research.” In: J. van den Akker, R. Maribe Branch, K. Gustafson, N. Nieveen and T. Plomp, eds.) Design Approaches and Tools in Education and Training. Dordrecht, the Netherlands: Kluwer Academic Publishers.10.1007/978-94-011-4255-7Search in Google Scholar

Van Vollehoven, P., Hulsenbek, J. A., van den Berg, A., Mertens, F. J. H. and J. P. Visser (2006) Brand Cellencomplex Schiphol-Oost. Den Haag: Onderzoeksraad Voor Veiligheid. http://www.onderzoeksraad.nl.Search in Google Scholar

Walls, J. G., G. R. Widmeyer and O. A. El Sawy (1992) “Building an Information System Design Theory for Vigilant EIS,” Information Systems Research, 3(1):36–59.10.1287/isre.3.1.36Search in Google Scholar

Wang, R. Y., Storey, V. C. and C. P. Firth (1995) “A Framework for Analysis of Data Quality Research.” IEEE Transactions Knowledge and Data Engineering, 7(4):623–640.10.1109/69.404034Search in Google Scholar

Wang, R. Y., and D. M. Strong (1996) “Beyond Accuracy: What Data Quality Means to Data Consumers.” Journal of Management Information Systems, 12(4):5–33.10.1080/07421222.1996.11518099Search in Google Scholar

Wenjing, L. (2011) “Government Information Sharing: Principles, Practice, and Problems – An International Perspective,” Government Information Quarterly, 28(3):363–373.10.1016/j.giq.2010.10.003Search in Google Scholar

Winter, R. (2008) “Design Science Research in Europe,” European Journal of Information Systems, 17:470–475.10.1057/ejis.2008.44Search in Google Scholar

Yin, R. K. and K. A. Heald (1975) “Using the Case Survey Method to Analyze Policy Studies,” Administrative Science Quarterly, 20(3):371–381.10.2307/2391997Search in Google Scholar

Published Online: 2015-7-3
Published in Print: 2015-9-1

©2015 by De Gruyter