A Study on Challenges of Testing Robotic Systems

Afzal, Afsoon; Goues, Claire Le; Hilton, Michael; Timperley, Christopher Steven

doi:10.1109/icst46399.2020.00020

Cited by 66 publications

(27 citation statements)

References 50 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Those considerations are essential from the perspective of the product release, especially when robots have a value on their character. The QA or quality control process in computer-aided entertainment is well-established in the computer game industry [21] and gaining momentum in the robotics field [22,23]. However, because home robots differ from the industrial robots concerning interactivity and differ from computer games for character motion in the real world, we were required to develop a QA flow for releasing the LOVOT software.…”

Section: Quality Assurancementioning

confidence: 99%

Production of Character Animation in a Home Robot: A Case Study of LOVOT

Yoshida

Yonemura

Emoto³

et al. 2021

Int J of Soc Robotics

View full text Add to dashboard Cite

This is a case study focused on the development of LOVOT, a consumer home robot that went on sale in 2019. Since its unveiling in 2018, approximately 20,000 people have visited the LOVOT demonstration event as of the end of July 2019. In practical terms, LOVOT lives at home with the user long-term, similar to a companion animal; LOVOT performs continuous natural motion for user comfort. We applied movements using professional animator techniques based on the principles of traditional animation to LOVOT. We have identified specific practical techniques in home robot animation through iterative prototyping in our synergetic development of character animation techniques and tools. In this paper, we introduce our practical methods to develop many behaviors in a single robotic agent and is the collaborative efforts of a group of people with diverse professional backgrounds. Furthermore, we summarize how traditional techniques of character animation were applied, and new techniques were required from the perspective of professional animators.

show abstract

Section: Quality Assurancementioning

confidence: 99%

Production of Character Animation in a Home Robot: A Case Study of LOVOT

Yoshida

Yonemura

Emoto³

et al. 2021

Int J of Soc Robotics

View full text Add to dashboard Cite

show abstract

“…We assessed the impact of nondeterminism in the reproducibility of simulation-based evaluation of MRS components by analysing the best MRS configuration and CI algorithm pair for each case study over 30 independent runs. Non-determinism can be due to robot behaviour (e.g., path planning), components of the simulation engine, or the operating system [29]. Non-deterministic simulations can produce behaviour that is not representative of real systems.…”

Section: Rq2 (Collective Intelligence Analysis)mentioning

confidence: 99%

Model-Driven Simulation-Based Analysis for Multi-Robot Systems

Harbin

Gerasimou

Matragkas

et al. 2021

2021 ACM/IEEE 24th International Conference on Model Driven Engineering Languages and Systems (MODELS)

View full text Add to dashboard Cite

“…However, the use of simulations for testing safety constraints raises important issues. First, the safety case must ensure the simulated environment is representative of the system under consideration [2,16]. Second, the tools must decide on a set of configurations (from the effective-infinite configuration space) to drive testing and evaluate confidence in the system safety [18].…”

Section: Introductionmentioning

confidence: 99%

SASSI: Safety Analysis Using Simulation-Based Situation Coverage for Cobot Systems

Lesage

Alexander

2021

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Assessing the safety of collaborative robot (cobot) systems is a difficult task due to the myriad of possible interactions between robots and operators, and the potential for injury to the operators. Using a situation coverage approach we can define the individual components of such interactions, and thereby describe the problem space and the coverage achieved when testing it. In this paper, we propose a situation coverage approach for testing the safety of a cobot system. Our approach suggests using a combination of safety analysis techniques and simulation-based testing to define situations of interest and explore hazardous situations while only endangering virtual operators. We challenge our assumptions by applying our method to an example based on a realworld use-case. The proposed metrics, if they provide no advantage to guided test generation techniques over random ones, helped us trim the generated configuration landscape to identify safety gaps.

show abstract

A Study on Challenges of Testing Robotic Systems

Cited by 66 publications

References 50 publications

Production of Character Animation in a Home Robot: A Case Study of LOVOT

Production of Character Animation in a Home Robot: A Case Study of LOVOT

Model-Driven Simulation-Based Analysis for Multi-Robot Systems

SASSI: Safety Analysis Using Simulation-Based Situation Coverage for Cobot Systems

Contact Info

Product

Resources

About