How to Evaluate BDD Scenarios' Quality?

Abstract

A scenario from the Behavior-driven development (BDD) practice is a known format to represent acceptance tests in agile methodologies, communicating assumptions and expectations by expressing the details that result from the conversations between customers and developers. We believe that this formalization of behavior need to be of good quality to avoid known requirement problems that arise from bad documentation, such as incomplete, underspecified and inconsistent requirements. However, there are only informal guidelines to guide practitioners on their BDD scenarios' elaboration and quality evaluations. To address this lack of guidance, we define a set of quality attributes and propose a question-based checklist to assist BDD scenarios' quality evaluations. [Methods] The quality attributes were identified from an interview-based study with 18 practitioners. In this study, practitioners shared their interpretations on an initial set of literature-informed quality attributes and their own personal evaluation criteria. We consolidated both in a single list of newly redefined attributes, used in the definition of our proposed checklist. We believe that our newly re-defined quality attributes and question-based checklist can enhance the existing guidelines and practitioners' ability to evaluate BDD scenario's quality by providing them with an standard guideline for scenarios' refinement conversations. CCS CONCEPTS• Software and its engineering → Software development techniques.

Explorando a especificação de cenários de teste de segurança no desenvolvimento orientado por comportamento (Behavior Driven Development)

“…O trabalho apresentado em [20] menciona que as práticas de desenvolvimento orientado por comportamento (BDD) são utilizadas para representar testes de aceitação em metodologias ágeis e se faz necessário uma formalização de comportamento de boa qualidade para evitar problemas de requisitos oriundos de documentação ruim, como informações incompletas e requisitos inconsistentes. Porém, existem apenas diretrizes informais para orientar os profissionais na elaboração de seus cenários de BDD e avaliações de qualidade.…”

Construção Colaborativa De Requisitos De Qualidade

“…A pesquisa seguiu os passos representados nos desenhos das figuras 5, 6, 7 e 8. A forma de desenhar utilizada foi inspirada no desenho de pesquisa (seção 4, página 483) do trabalho de Oliveira (Oliveira et al, 2019). Os passos são detalhados em seguida as figuras.…”

Automated Generation of Executable Cucumber Scenarios from a RDBMS Schema

“…Introduced by Dan North, Behavior-Driven Development (BDD) [19] is a set of practices that uses user stories in a common language to describe and model a system [20]. BDD encourages developers and stakeholders to collaborate through a shared understanding of how the software should behave by using conversations and concrete examples [28].…”