Structured behavioral and conventional interviews: Differences and biases in interviewer ratings

Alonso, Pamela; Moscoso, Silvia

doi:10.1016/j.rpto.2017.07.003

Cited by 12 publications

(12 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This is in contrast to self‐report personality measures that are vulnerable to faking in high‐stakes testing 10 . Moreover, face to face interviews are also open to different forms of bias, though structuring these processes may reduce some of these influences, to some extent 11 …”

Section: Introductionmentioning

confidence: 95%

“…interviews are also open to different forms of bias, though structuring these processes may reduce some of these influences, to some extent. 11 It should be emphasised that SJTs are a particular assessment format and this review is concerned only with their use in selecting candidates on non-academic abilities. 12 Although SJTs have been applied in personnel selection for many decades, their popularity increased when they were framed as 'low-fidelity simulations.'…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Situational judgement test validity for selection: A systematic review and meta‐analysis

et al. 2020

View full text Add to dashboard Cite

Context Situational judgement tests (SJTs) are widely used to evaluate ‘non‐academic’ abilities in medical applicants. However, there is a lack of understanding of how their predictive validity may vary across contexts. We conducted a systematic review and meta‐analysis to synthesise existing evidence relating to the validity of such tools for predicting outcomes relevant to interpersonal workplace performance. Methods Searches were conducted in relevant databases to June 2019. Study quality and risk of bias were assessed using the Quality In Prognosis Studies (QUIPS) tool. Results were pooled using random effects meta‐analysis and meta‐regressions. Results Initially, 470 articles were identified, 218 title or abstracts were reviewed, and 44 full text articles were assessed with 30 studies meeting the final inclusion criteria and were judged, overall, to be at moderate risk of bias. Of these, 26 reported correlation coefficients relating to validity, with a pooled estimate of 0.32 (95% confidence interval 0.26 to 0.39, P < .0001). Considerable heterogeneity was observed (I2 = 96.5%) with the largest validity coefficients tending to be observed for postgraduate, rather than undergraduate, selection studies (β = 0.23, 0.11 to 0.36, P < .001). The correction of validity coefficients for attenuation was also independently associated with larger effects (β = 0.13, 0.03 to 0.23, P = .01). No significant associations with test medium (video vs text format), cross‐sectional study design, or period of assessment (one‐off vs longer‐term) were observed. Where reported, the scores generally demonstrated incremental predictive validity, over and above tests of knowledge and cognitive ability. Conclusions The use of SJTs in medical selection is supported by the evidence. The observed trend relating to training stage requires investigation. Further research should focus on developing robust criterion‐relevant outcome measures that, ideally, capture interpersonal aspects of typical workplace performance. This will facilitate additional work identifying the optimal place of SJTs within particular selection contexts and further enhancing their effectiveness.

show abstract

Section: Introductionmentioning

confidence: 95%

Section: Introductionmentioning

confidence: 99%

Situational judgement test validity for selection: A systematic review and meta‐analysis

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Also, it might be expected that the information from the interviews would be restricted to the limited interviewees' experiences and knowledge (Mccarthy, Van Iddekinge, and Campion 2010). Thus, it is important to note the importance of each interviewee in terms of education, experience and position (Hartwell, Johnson, and Posthuma 2019), and differences and biases regarding gender and prior information of the interviewees (Alonso and Moscoso 2017) to ensure the validity of data and information gathered. To achieve confidence in the reliability and validity of the compiled data and information, the required number of interviews and the number of interviewers should also be taken into consideration (Fifić and Gigerenzer 2014).…”

Section: Objectives Of the Port Planningmentioning

confidence: 99%

Framework for Dealing with Uncertainty in the Port Planning Process

Eskafi

Dastgheib

Taneja

et al. 2021

J. Waterway, Port, Coastal, Ocean Eng.

View full text Add to dashboard Cite

Ports have always been evolving to satisfy the new or changing demands of stakeholders. In this unstable world, ports as dynamic systems are developed under a high degree of uncertainty. Furthermore, black-swan events, for instance, the financial crisis in 2008, the avalanche in Flateyri (Iceland) in 2020, the COVID-19 pandemic in 2020-2021 make successful port planning a challenging task. Indeed, the ever-increasing complexity of a port system and its long technical lifetime make uncertainty considerations inevitable in the planning process. Therefore, this research presents a structured framework to deal with uncertainties, including opportunities and vulnerabilities, in the port planning process. To this end, a structured stakeholder analysis is performed to effectively and timely engage stakeholders in the planning process. Fuzzy logic 3-dimensional decision surface is used to identify the salient stakeholders. Subsequently, the success of the future port is defined in terms of the specific objectives of the stakeholders. To develop this definition, a problem structuring method and fuzzy multi-attribute group decision-making method are synthesized. Then, a port throughput forecast is conducted that accounts for epistemic uncertainty, including model and parameters uncertainties, and thus increases the reliability of forecast results. The method identifies the influencing macroeconomic variables on port throughput by mutual information and then applies the Bayesian statistical method to forecast the port throughput. Effective actions are planned to seize opportunities and manage vulnerabilities that manifest in the projected lifetime. Therefore, the port can adapt or better withstand the vagaries of the future. The nonlinearity of dealing with uncertainty by application of the framework provides a robust and better plan toward its success. The framework supports decision making under uncertainty and facilitates adaptive port planning. The framework is applied to the Ports of Isafjordur Network in Iceland. The results indicate that the uncertainties mainly present opportunities in the short-time horizon, while in the middle-time horizon the port network is confronted with multiple vulnerabilities.

show abstract

“…Interviews are the most effective way to obtain detailed individual opinions and perceptions about an issue. Nonetheless, we are aware that interview-based approaches suffer from biases such as the researcher leading the respondent, respondent anticipation to please the researcher, pushing for concise answers (Alonso and Moscoso, 2017), or discrepancies between what people report and what they actually feel or do (Yan et al, 2020). These weaknesses of the interviews were accounted for in the information sheet and consent forms for both farmers and conservationists by clearly stating that the research was for educational purposes and there would be no compensation for participating and that the potential participants were free to withdraw from the study at any time.…”

Section: Questionnaire Surveysmentioning

confidence: 99%

Explaining the Effect of Crop-Raiding on Food Security of Subsistence Farmers of KwaZulu Natal, South Africa

Raphela¹,

Pillay²

2021

Front. Sustain. Food Syst.

View full text Add to dashboard Cite

Across the globe, crop-raiding has been known to have a significant impact on subsistence farmers livelihoods in developing countries. However, the relationship between crop-raiding and food security of small-scale farmers is not well-studied. We investigated the effects of crop-raiding on homestead food security of a subsistence farming community on the edge of the Hluhluwe Game Reserve in northern KwaZulu-Natal Province, South Africa. We analyzed the relative calories lost to important food security crops (maize, common bean, spinach, and beetroot) damage by crop raiders. In addition, we conducted questionnaire surveys of resident farmers and conservationists of the Hluhluwe Game Reserve to explain the effect of crop-raiding on food security. We firstly assessed how crop loss influenced relative calorie loss as an indicator of food security by comparing relative calorie loss with two predictors of food security: homestead size and contribution of crops to the farmers' food basket. Larger homesteads were more prone to food insecurity as compared to smaller households as they experienced higher calorie loss, especially in terms of maize (Zea mays), the most important food security crop in South Africa. This was because maize contributed the highest (91–100%) to the homestead food basket of these farmers. Secondly, we assessed farmers and conservationists' perceptions and opinions on crop-raiding issues. Farmers reported maize as the crop most damaged by crop-raiding animals. Conservationists reported crop-raiding with other major problems in and around the Reserve; this showed that conservationists acknowledge the issue of crop-raiding as a problem for subsistence farming communities abutting protected areas. Both farmers and conservationists reported insects as the most damaging crop raider. Our study suggests that larger homesteads, particularly where maize contributes substantially to homestead food baskets, are more prone to food insecurity in the rural subsistence farming community that we studied. In concordance with many studies, insects were reported as the culprits by both farmers and conservationists. Small, ubiquitous animals, such as insects are reported to cause much crop damage where they occur. The findings of our study suggest that the food security of the studied farmers is threatened by crop-raiding.

show abstract

Structured behavioral and conventional interviews: Differences and biases in interviewer ratings

Cited by 12 publications

References 33 publications

Situational judgement test validity for selection: A systematic review and meta‐analysis

Situational judgement test validity for selection: A systematic review and meta‐analysis

Framework for Dealing with Uncertainty in the Port Planning Process

Explaining the Effect of Crop-Raiding on Food Security of Subsistence Farmers of KwaZulu Natal, South Africa

Contact Info

Product

Resources

About