Four transition-to-practice programs for new RN graduates who had not yet found employment in nursing were based on the Quality and Safety Education for Nurses (QSEN) competencies of knowledge, skills, and attitudes (KSAs). To support consistent evaluation of participants by preceptors, a 35-item tool was developed that used a 4-point scale to assess selected behaviors. This article describes the initial reliability and validity testing of the tool, which had good internal consistency, with a Cronbach's alpha of 0.92 for preceptor evaluation of participants and 0.82 when used as a self-evaluation tool. Six content experts evaluated the tool's face validity; it successfully discriminated between junior-level baccalaureate nursing students and nursing faculty. Although the tool does not exhaustively reflect the QSEN KSAs, it provides a way to assess competencies among new nurse graduates.