Operation of the Basketball Jump Shooting Accuracy Test: Intra- and inter-rater reliability of scoring procedures and floor and ceiling effects for test performance

Abstract

The purpose of this study was to determine the intra-and inter-rater reliability of scoring procedures used in the newly developed Basketball Jump Shooting Accuracy Test (BJSAT) and assess for floor and ceiling effects in test performance. Thirty-one semi-professional basketball athletes completed four trials of the BJSAT. The BJSAT contains one jump shot at eight different locations, equally distributed across two-and three-point shots. Intra-rater reliability was determined by assessing the level of agreement between scores live in-person and watching captured video by the same assessor. Inter-rater reliability was determined by examining the level of agreement between two assessors who separately scored the BJSAT while watching captured video. Descriptive statistics and Cohen's kappa () were calculated to quantify the intra-and inter-rater reliability of the BJSAT. Floor and ceiling effects in scoring outcomes were analyzed to evaluate the suitability of the BJSAT. Significance for the study was set at p <0.05. Intra-rater reliability demonstrated an almost perfect ( = 0.85, p <0.01) agreement between scores (12.6 ± 2.5 vs 13.1 ± 2.8). The agreement for inter-rater reliability was rated as substantial (12.3 ± 2.5 vs 13.5 ± 2.9,  = 0.70, p <0.01). Floor and ceiling effects were absent in the BJSAT indicating the assessment is suitable for semi-professional basketball athletes. The BJSAT is an assessment where one or multiple assessors can reliably score shooting performance for functions including player monitoring, to assess the efficacy of interventions aimed at improving skills and to assist with team selection across the season.

Player chronotype does not affect shooting accuracy at different times of the day in a professional, male basketball team: a pilot study

“…Overall test performance was measured as the total summed score from all shots taken across all five positions. This scoring system has previously demonstrated strong intrarater reliability when applied in the original version of the BJSAT (Cohen’s kappa= 0.85, p <0.01; 24 ).…”

“…The two shooting protocols were modified versions of the Basketball Jump Shooting Accuracy Test (BJSAT). The BJSAT has demonstrated suitable content validity (two-point vs. three-point shooting scores: p <0.01) and retest reliability (two-point shooting score: intraclass correlation coefficient [ICC] = 0.68; three-point shooting score: ICC = 0.58) in assessing basketball shooting accuracy in semi-professional, male and female basketball players 23 , 24 . Non-perimeter shooting players completed shots from five locations, including four locations around the key and one location at the centre of the free-throw line ( Figure 1 ).…”

“…Overall test performance was measured as the total summed score from all shots taken across all five positions. This scoring system has previously demonstrated strong intrarater reliability when applied in the original version of the BJSAT (Cohen's kappa= 0.85, p <0.01; 24 ). Players undertook a standardised 5-min warm-up consisting of jogging, countermovement jumps, and dynamic stretching before commencing the familiarisation trial (Figure 4).…”

A comparison of multidimensional qualities discriminant of selection in elite adolescent Australian basketball athletes

“…The Basketball Jump Shooting Accuracy Test (BJSAT) was utilised to assess shooting accuracy in each athlete. This test has been shown to be reliable (CV = 16.2%, ICC = 0.71) and valid (comparison between two and three-point shots p <0.01) in assessing shooting accuracy in male semi-professional basketball athletes [30,31]. Athletes were required to shoot the ball from eight different locations including four two-point shots and four three-point shots during the BJSAT.…”

“…Each shot was scored as 0 (missed shot that does not touch rim or backboard), 1 (missed shot that contacts the rim or PLOS ONE backboard), 2 (made shot which contacts the rim or backboard), or 3 (made shot without touching the rim or backboard). Each athlete completed two trials and the total summed score across all shots in both trials was used for analysis [31]. Prior to completing the BJSAT, athletes were familiarised with test procedures and operation through extensive instruction, demonstration, and a 2-min shooting warm-up.…”