Demonstrating the use of a professional skills framework to support the assessment of dispositions in IT education

Abstract

The skills and competencies of IT professionals are often described using employer-led skills frameworks. They express competencies as technical knowledge and skills combined with a range of personal qualities. Employers have indicated the importance of developing such qualities for new graduates. In response, recent ACM/IEEE curricular recommendations have shifted their emphases from bodies of knowledge to the development of competencies. The IT2017 ACM/IEEE Curriculum Guidelines for Baccalaureate Degree Programs proposed a model of IT competency comprising three interrelated components: content knowledge, skills, and dispositions, where dispositions represent personal qualities desirable in the workplace. The ACM/IEEE Computing Curricula 2020 (CC2020) report enriched the IT2017 disposition concept by identifying eleven dispositions that all computing programs should include for the career preparation of their graduates. However, developing and assessing dispositions in a degree program remain challenges, often involving internships, work placements and similar student opportunities. A recent mapping of the eleven CC2020 dispositions to the responsibility characteristics of the Skills Framework for the Information Age (SFIA), a widely used professional skills framework, suggested a promising approach to addressing this challenge. Inspired by this mapping, this paper aims to help educators assess students’ achievement of CC2020 dispositions by mapping real-world experiences they have recorded in individual portfolios against the SFIA responsibility characteristics. First, the selection of SFIA to operationalize the CC2020 dispositions is validated by demonstrating that alternative frameworks pose significant challenges for any assessment approach that needs to be independent of particular technical skills. A tool is described that maps demonstration of SFIA responsibility characteristics to CC2020 dispositions, applying a simple, consistent assessment algorithm. Finally, the assessment process and outcomes are illustrated using a fictional student portfolio, constructed to reflect one author’s experience of work placement students’ achievements.

A Practical Approach to Assessing IT Professional Skills

“…An assessment tool for the responsibility characteristics is described in [1,3]. The tool counts the portfolio entries corresponding to each responsibility characteristic and performs calculations to determine if a responsibility characteristics threshold has been met.…”

“…The tool counts the portfolio entries corresponding to each responsibility characteristic and performs calculations to determine if a responsibility characteristics threshold has been met. Our tool for assessing technical competence is to be used in conjunction with that in [3] to produce a robust overall judgment on the competence of a student, as evidenced by their portfolio. The two tools are consistent, as they are both based on mapping portfolio entries to elements of SFIA.…”