Accessible Requires Authentication Published by De Gruyter August 22, 2013

Paradigm Shift in the Holistic Evaluation of the Reliability of NDE Systems

Paradigmenwechsel in der ganzheitlichen Untersuchung der Zuverlässigkeit von ZfP-Systemen
Christina Mueller, Marija Bertovic, Mato Pavlovic, Daniel Kanzler, Uwe Ewert, Jorma Pitkänen and Ulf Ronneteg
From the journal Materials Testing

Abstract

The aim of this publication is to provide an overview of new methodologies for evaluating the reliability of NDE systems in accordance with the specific requirements of industrial applications. After a review of the substantive issues of the previous decades, the go forward guidance is concluded. For high safety demands a quantitative POD (Probability of Detection) created from hit/miss experiments or signal response analysis and ROC (Receiver Operating Characteristics) are typically created. The modular reliability model distinguishes between the pure physical-technical influence, industrial application factors, and human factors. It helps to learn which factors can be determined by modeling and by open or blind trials. A new paradigm is offered to consider the POD or reliability of the system as a function of the configuration of input variables and is used for optimization rather than for a final judgement. New approaches are considered dealing with real defects in a realistic environment, affordable but precisely like the Bayesian approach or model assisted methods. Among the influencing parameters, human factors are of high importance. A systematic psychological approach helps to find out where the bottlenecks are and shows possibilities for improvement.

Abstract

Das Ziel des Artikels ist es eine Übersicht über neue methodische Ansätze und Verfahren zur Bewertung der Zuverlässigkeit von ZfP-Systemen in Übereinstimmung mit den spezifischen Anforderungen verschiedener industrieller Anwendungen zu geben. Nach einem Überblick über die in den vergangenen Jahrzehnten erreichten Fortschritte, wird der Fokus auf die gegenwärtigen Entwicklungen gerichtet. Für hohe Sicherheitsanforderungen wurde die quantitative Fehlerauffindwahrscheinlichkeit (probability of detection, POD) basierend auf “hit/miss”- oder “Signal-Response“-Analysen und die ROC-Analyse (Receiver Operating Characteristics) als typische Werkzeuge entwickelt. Im Rahmen des modularen Modells für die ZfP-Zuverlässigkeit unterscheidet man zwischen den rein physikalisch-technischen Einflussfaktoren, den industriellen Anwendungsfaktoren und den menschlichen Faktoren. Es hilft zum Beispiel zu erkennen, welche dieser Faktoren man in Modellierungsrechnungen bzw. mittels offenen oder Blindversuchen untersuchen kann. Ein neues Paradigma wird für die Betrachtung der POD als eine Funktion der gewählten Systemparameter und somit als Optimierungswerkzeug verwendet, anstelle sie für die endgültige Beurteilung zu nehmen. Zur Handhabung der Zuverlässigkeitsuntersuchung von realen Defekten in einer realistischen Umgebung werden ökonomisch vertretbare, aber dennoch präzise genug arbeitende Methoden, wie der Ansatz von Bayes oder modellbasierte Methoden vorgestellt. Die menschlichen Faktoren sind oft von ausschlaggebender Wichtigkeit für die Gesamtzuverlässigkeit. Hier hilft ein systematischer psychologischer Ansatz die Engpässe und Verbesserungsmöglichkeiten zu finden.

References

1 C.Nockemann, C.Fortunko: Summary of the workshop, Proceedings of the European American Workshop on Reliability and Validation Methods on NDE, Berlin, Germany, June 18–20, 1997 Search in Google Scholar

2 C.Müller, M.Bertovic, M.Gaal, H.Heidt, M.Pavlovic, M.Rosenthal, K.Takahashi, J.Pitkänen, U.Ronneteg: Progress in Evaluating the Reliability of NDE: Systems – Paradigm Shift, Proceedings of the 4th European-American Workshop on Reliability of NDE, Berlin, June 24–26, 2009, DGZfP Proceedings BB 116-CD (2009) Search in Google Scholar

3 ASNT Topical Conference Paper Summaries Book of the American European Workshop on Non-destructive Inspection Reliability, September 21–24, 1999, NIST, Boulder, CO, USA, ISBN: 1 57117 041 3 (1999) Search in Google Scholar

4 R.Singh, M.Anderson, C.Müller: Summary & Consensus, Breakout session 5, Proceedings of the 3rd European American Workshop on Reliability of NDE and Demining, DGZfP Proceedings BB-81-CD (2002) Search in Google Scholar

5 ASME Boiler & Pressure Vessel Code, Section XI, Appendix VIII Search in Google Scholar

6 C.Nockemann, H.Heidt, N.Thomsen: Reliability in NDT: ROC study of radiographic weld inspections, NDT&E International 245 (1991), pp. 23524510.1016/0963-8695(91)90372-A Search in Google Scholar

7 C. E.Metz: Basic Principles of ROC Analysis, Seminars in Nuclear Medicine 84 (1978) Search in Google Scholar

8 A. P.Berens: NDE Reliability Data Analysis, Metals Handbook Volume 17, 9th Edition: Non-destructive Evaluation and Quality Control, ASM International, OH (1989) Search in Google Scholar

9 M.Dennis, C.Latiolais, F.Ammirato, P.Heasler: Development of POD and Flaw Sizing Uncertainty Distributions from NDE Qualification Data to Support Probabilistic Structural Integrity Assessment for Dissimilar Metal Welds, Proceedings of the 8th International Conference on NDE in Relation to Structural Integrity for Nuclear and Pressurized Components, 29th September – 1st October 2010 – Berlin, Germany, DGZfP Proceedings BB 125-CD (2010) Search in Google Scholar

10 B.Neuendorf, T.Seldis, L.Gandossi: Trends in Europe's NDE for the Nuclear Industry, Proceedings of the 8th International Con­ference on NDE in Relation to Structural Integrity for Nuclear and Pressurized Components, 29th September – 1st October 2010 – Berlin, Germany, DGZfP Proceedings BB 125-CD (2010) Search in Google Scholar

11 J. C.Aldrin, E. A.Medina, E. A.Lindgren, C. F.Buynak, J. S.Knopp: Case Studies for Model-assisted Probabilistic Reliability Assessment for Structural Health Monitoring Systems, QNDE 2011, AIP Conf. Proc. Vol. 13351589, 10.1063/1.3592119 (2011) Search in Google Scholar

12 R. B.Thompson, L. J.Brasche, D.Forsyth, E.Lindgren, P.Swindell, W.Winfree: Recent Advances in Model-assisted Probability of Detection, Proceedings of the 4th European American Workshop on Reliability of NDE, Berlin, June 24–26, 2009, DGZfP Proceedings BB 116-CD (2009) Search in Google Scholar

13 D. H.Harris: Effect of Decision Making on Ultrasonic Examination Performance, EPRI Report TR-100412 (1992) Search in Google Scholar

14 L.Norros, J.Kettunen: Analysis of NDT-inspectors working practices, Report STUK-YTO-TR147 (1998) Search in Google Scholar

15 J.Enkvist: A Human Factors Perspective on Non-Destructive Testing (NDT): Detection and Identification of Cracks, Doctoral dissertation submitted at the Stockholm University, Department of Psychology (2003) Search in Google Scholar

16 B. A.McGrath: Programme for the Assessment of NDT in Industry, PANI 3, Health and Safety Executive Research Report RR617 (2008) Search in Google Scholar

17 D.Gülle, M.Gaal, M.Bertović, C.Müller, M.Scharmach, M.Pavlović: South-East Europe Interim Report Field Trial Croatia (Continuation of the ITEP-Project Systematic Test and Evaluation of Metal Detectors – STEMD), Berlin, March 2007. http://www.itep.ws/pdf/STEMD_Interim_Croatia_final.pdf (2007) Search in Google Scholar

18 M.Bertovic, M.Gaal, C.Müller, B.Fahlbruch: Investigating Human Factors in Manual Ultrasonic Testing: Testing the Human Factor Model, Insight5312 (2011), pp. 67367610.1784/insi.2011.53.12.673 Search in Google Scholar

19 M.Gaal, M.Bertovic, C.Müller, S.Zickler, B.Fahlbruch, V.Spokoiny, D.Schombach, T.Just, H.-J.Cramer: Untersuchungen zum Einfluss menschlicher Faktoren auf das Ergebnis von zerstörungsfreien Prüfungen, Möglichkeiten zur Minimierung dieses Einflusses und Bewertung der Prüfergebnisse – Vorhaben 3607R02514, Endbericht, Ressortforschungsberichte zur kerntechnischen Sicherheit und zum Strahlenschutz, URN:nbn:de:0221-2009111107, Salzgitter: BfS, 2009, available at: http://doris.bfs.de/jspui/bitstream/urn:nbn:de:0221-2009111107/1/BfS_2009_BfS-RESFOR-25-09.pdf (2009) Search in Google Scholar

20 B.Fahlbruch: Integrating Human Factors in Safety and Reliability Approaches, Proceedings of the 4th European American Workshop on Reliability of NDE, Berlin, June 24–26, 2009, DGZfP Proceedings BB 116-CD (2009) Search in Google Scholar

21 M.Pavlovic, K.Takahashi, U.Ronneteg, J.Pitkänen, C.Müller: Multi-Parameter Influence on the Response of the Flaw to the Phased Array Ultrasonic NDT System, The Volume POD, Proceedings of the 4th European American Workshop on Reliability of NDE, Berlin, June 24–26, 2009, DGZfP Proceedings BB 116-CD (2009) Search in Google Scholar

22 M.Pavlovic, K.Takahashi, C.Müller, R.Boehm, U.Ronneteg: Reliability in Non-Destructive Testing (NDT) of the Canister Components, NDT Reliability – Final Report, SKB Technical report R-08-129, ISSN 1402-3091, Swedish Nuclear Fuel and Waste Management Co. (2008) Search in Google Scholar

23 D.Kanzler, C.Müller, U.Ewert, J.Pitkänen: Bayesian Approach for the Evaluation of the Reliability of Non-Destructive Testing Methods: Combination of Data from Artificial Defects and Real Defects, Proceedings of the 18th World Conference on Non-destructive Testing, Durban, South Africa, April 16–20, 2012 Search in Google Scholar

24 M.Bertovic, B.Fahlbruch, C.Müller, J.Pitkänen, U.Ronneteg, M.Gaal, K.Kanzler, U.Ewert, D.Schombach: Human Factors Approach to the Acquisition and Evaluation of NDT Data, Proceedings of the 18th World Conference on Non-Destructive Testing, Durban, South Africa, April 16–20, 2012 Search in Google Scholar

25 F.Fücsök, C.Müller, M.Scharmach: Reliability of Routine Radiographic Film Evaluation – an Extended ROC Study of the Human Factor, Proceedings of the 8th ECNDT, Barcelona, 2002, CD-ROM (2002) Search in Google Scholar

26 K. D.Williams, S. J.Karau: Social Loafing and Social Compensation: The Effects of Co-Worker Performance, Journal of Personality and Social Psychology 614 (1991), pp. 57058110.1037/0022-3514.61.4.570 Search in Google Scholar

27 K. L.Mosier, L. J.Skitka: Human decision makers and automated decision aids: made for each other? In: R.Parasuraman, M.Mouloua (Eds.): Automation and Human Performance: Theory and Application, Erlbaum, Mahwah, NJ (1996), pp. 201–220 Search in Google Scholar

Published Online: 2013-08-22
Published in Print: 2013-04-02

© 2013, Carl Hanser Verlag, München