Use of the FDA nozzle model to illustrate validation techniques in computational fluid dynamics (CFD) simulations

Abstract

A “credible” computational fluid dynamics (CFD) model has the potential to provide a meaningful evaluation of safety in medical devices. One major challenge in establishing “model credibility” is to determine the required degree of similarity between the model and experimental results for the model to be considered sufficiently validated. This study proposes a “threshold-based” validation approach that provides a well-defined acceptance criteria, which is a function of how close the simulation and experimental results are to the safety threshold, for establishing the model validity. The validation criteria developed following the threshold approach is not only a function of Comparison Error, E (which is the difference between experiments and simulations) but also takes in to account the risk to patient safety because of E. The method is applicable for scenarios in which a safety threshold can be clearly defined (e.g., the viscous shear-stress threshold for hemolysis in blood contacting devices). The applicability of the new validation approach was tested on the FDA nozzle geometry. The context of use (COU) was to evaluate if the instantaneous viscous shear stress in the nozzle geometry at Reynolds numbers (Re) of 3500 and 6500 was below the commonly accepted threshold for hemolysis. The CFD results (“S”) of velocity and viscous shear stress were compared with inter-laboratory experimental measurements (“D”). The uncertainties in the CFD and experimental results due to input parameter uncertainties were quantified following the ASME V&V 20 standard. The CFD models for both Re = 3500 and 6500 could not be sufficiently validated by performing a direct comparison between CFD and experimental results using the Student’s t-test. However, following the threshold-based approach, a Student’s t-test comparing |S-D| and |Threshold-S| showed that relative to the threshold, the CFD and experimental datasets for Re = 3500 were statistically similar and the model could be considered sufficiently validated for the COU. However, for Re = 6500, at certain locations where the shear stress is close the hemolysis threshold, the CFD model could not be considered sufficiently validated for the COU. Our analysis showed that the model could be sufficiently validated either by reducing the uncertainties in experiments, simulations, and the threshold or by increasing the sample size for the experiments and simulations. The threshold approach can be applied to all types of computational models and provides an objective way of determining model credibility and for evaluating medical devices.

Credibility, Replicability, and Reproducibility in Simulation for Biomedicine and Clinical Applications in Neuroscience

“…Additionally, the Congress of Neurological Surgeons has formed a Simulation Committee to create simulations for resident education ( Konakondla et al, 2017 ). The US Food and Drug Administration (FDA) and the Association for the Study of Medical Education have also been working to publish standards and guidelines for regulatory submissions involving computational models and simulations for healthcare applications ( Hariharan et al, 2017 ).…”

Multiple Parameters and Target Optimization of Splitter Blades for Blood Pumps Using CFD and Neural Networks

“…The reason is that at present, our blood pump manufacturing and blood experimental technology are not enough, and the effects of materials, surfaces, and experimental operations on the results cannot be ruled out well. Besides, many scholars' studies have reflected that it is difficult to achieve a quantitative analysis of this degree of hemolytic difference in blood experiments [22,23]. In future research, we will improve technology and methods and strive to determine the optimization effect through blood experiments.…”

Advancing Regulatory Science With Computational Modeling for Medical Devices at the FDA's Office of Science and Engineering Laboratories

“…Computational models of anatomy or physiology include improved drug delivery in the cornea with ultrasound energy ( 24 ); physiological models of heart cells ( 25 ), renal circulation ( 26 ), hemodynamic responses to blood volume perturbations ( 27 ), left bundle branch block ( 28 ), gas dynamics in the retina ( 29 ), coupled electrical and mechanical activity in the heart ( 30 ); energy absorption in patients with deep-brain stimulators ( 31 – 34 ), breast tissue expanders ( 35 ), in pregnant women and fetus during MRI exams ( 36 ); subthalamic nucleus ( 37 ), the breast ( 38 ), cancellous bone ( 39 ), the head ( 40 ) and whole body models ( 41 , 42 ).…”