Background: With the increasing use of complex quantitative models in applications throughout the financial world, model risk has become a major concern. The credit crisis of 2008–2009 provoked added concern about the use of models in finance. Measuring and managing model risk has subsequently come under scrutiny from regulators, supervisors, banks and other financial institutions. Regulatory guidance indicates that meticulous monitoring of all phases of model development and implementation is required to mitigate this risk. Considerable resources must be mobilised for this purpose. The exercise must embrace model development, assembly, implementation, validation and effective governance.Setting: Model validation practices are generally patchy, disparate and sometimes contradictory, and although the Basel Accord and some regulatory authorities have attempted to establish guiding principles, no definite set of global standards exists.Aim: Assessing the available literature for the best validation practices.Methods: This comprehensive literature study provided a background to the complexities of effective model management and focussed on model validation as a component of model risk management.Results: We propose a coherent ‘best practice’ framework for model validation. Scorecard tools are also presented to evaluate if the proposed best practice model validation framework has been adequately assembled and implemented.Conclusion: The proposed best practice model validation framework is designed to assist firms in the construction of an effective, robust and fully compliant model validation programme and comprises three principal elements: model validation governance, policy and process.

The IFRS 9 accounting standard requires the prediction of credit deterioration in financial instruments, i.e., significant increases in credit risk (SICR). However, the definition of such a SICR-event is inherently ambiguous, given its reliance on comparing two subsequent estimates of default risk against some arbitrary threshold. We examine the shortcomings of this approach and propose an alternative framework for generating SICR-definitions, based on three parameters: delinquency, stickiness, and the outcome period. Having varied these parameters, we obtain 27 unique SICR-definitions and fit logistic regression models accordingly using rich South African mortgage data; itself containing various macroeconomic and obligor-specific input variables. This new SICR-modelling approach is demonstrated by analysing the resulting portfolio-level SICR-rates (of each SICR-definition) on their stability over time and their responsiveness to economic downturns. At the account-level, we compare both the accuracy and flexibility of the SICR-predictions across all SICR-definitions, and discover several interesting trends during this process. These trends form a rudimentary expert system for selecting the three parameters optimally, as demonstrated in our recommendations for defining SICR-events. In summary, our work can guide the formulation, testing, and modelling of any SICR-definition, thereby promoting the timeous recognition of credit losses; the main imperative of IFRS 9.

The need to model proportional data is common in a range of disciplines however, due to its bimodal nature, U- or J-shaped data present a particular challenge. In this study, two parsimonious mixture models are proposed to accurately characterise this proportional U- and J-shaped data. The proposed models are applied to loss given default data, an application area where specific importance is attached to the accuracy with which the mean is estimated, due to its linear relationship with a bank’s regulatory capital. In addition to using standard information criteria, the degree to which bias reduction in the estimation of the distributional mean can be achieved is used as a measure of model performance. The proposed models outperform the benchmark model with reference to the information criteria and yield a reduction in the distance between the empirical and distributional means. Given the special characteristics of the dataset, where a high proportion of observations are close to zero, a methodology for choosing a rounding threshold in an objective manner is developed as part of the data preparation stage. It is shown how the application of this rounding threshold can reduce bias in moment estimation regardless of the model choice.

Modelling the outcome after loan default is receiving increasing attention, and survival analysis is particularly suitable for this purpose due to the likely presence of censoring in the data. In this study, we suggest that the time to loan write-off may be influenced by latent competing risks, as well as by common, unobservable drivers, such as the state of the economy. We therefore expand on the promotion time cure model and include a parametric frailty parameter to account for common, unobservable factors and for possible observable covariates not included in the model. We opt for a parametric model due to its interpretability and analytical tractability, which are desirable properties in bank risk management. Both a gamma and inverse Gaussian frailty parameter are considered for the univariate case, and we also consider a shared frailty model. A Monte Carlo study demonstrates that the parameter estimation of the models is reliable, after which they are fitted to a real-world dataset in respect of large corporate loans in the US. The results show that a more flexible hazard function is possible by including a frailty parameter. Furthermore, the shared frailty model shows potential to capture dependence in write-off times within industry groups.

This discussant paper provides commentary on the “Development of an early career academic supervisor in Statistics - A discussion on a guiding rubric”. Later in this discussant paper, we refer to the original work as the “discussion paper”. Our perspective is that of academic actuaries involved in undergraduate and postgraduate professional training programmes. We commend the authors on a well researched and carefully argued paper, and fully support the renewed attention that has been drawn to the crisis in statistics in South Africa. Actuarial and financial risk management programmes rely heavily on strong teaching capabilities in mathematical statistics. The local crisis in statistics could therefore also be regarded as a crisis for actuarial science and other professional statistics-based programmes, such as the qualifications offered by the Centre for Business Mathematics and Informatics (BMI) at the North-West University (NWU).