euRathlon and ERL Emergency: A Multi-domain Multi-robot Grand Challenge for Search and Rescue Robots

Winfield, Alan F. T.; Franco, Marta Palau; Brueggemann, B.; Castro, Amilcar de; Ferri, Gabriele; Ferreira, Fausto; Liu, Xingcun; Pétillot, Yvan; Röning, Juha; Schneider, Frank E.; Stengler, Erik; Sosa, Dario; Viguria, Antidio

doi:10.1007/978-3-319-70836-2_22

Cited by 10 publications

(15 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In general, these qualitative assessment methodologies are now based on a 'story' or 'scenario'-based approach [16], as this method has proven to be the most useful to incorporate the views of the human stakeholders in the evaluation process. An example of a quantitative evaluation methodology in the field of robotics is the euRathlon challenge [17], [18]. Following this evaluation model, test subjects need to perform a high-level task (e.g.…”

Section: Previous Work and A Discussion On Quantitative And Qualitatimentioning

confidence: 99%

“…• User involvement: Considers the amount by which end users of the product under test are involved in the evaluation process. This is typically very high in mixedmethod approaches (and in many qualitative approaches, but less in [17]). It is related to the level of realism of the test as well as the cost.…”

Section: Conceptual Differences Between the Proposed Methods And The Smentioning

confidence: 99%

“…WinField et al [17] Jacoff et al [14] Rao et al [23] Goldman et al [24] Doroftei et al [ no specific reluctance to use such technology, among these border security agents (even quite to the contrary). Therefore, the user involvement aspect within the proposed evaluation methodology was lowered with respect to [20].…”

Section: Methodsmentioning

confidence: 99%

See 2 more Smart Citations

Using a qualitative and quantitative validation methodology to evaluate a drone detection system

Doroftei

Cubber

2019

ACTA IMEKO

View full text Add to dashboard Cite

Now that the use of drones is becoming more common, the need to regulate the access to airspace for these systems is becoming more pressing. A necessary tool in order to do this is a means of detecting drones. Numerous parties have started the development of such drone detection systems. A big problem with these systems is that the evaluation of the performance of drone detection systems is a difficult operation that requires the careful consideration of all technical and non-technical aspects of the system under test. Indeed, weather conditions and small variations in the appearance of the targets can have a huge difference on the performance of the systems. In order to provide a fair evaluation, it is therefore paramount that a validation procedure that finds a compromise between the requirements of end users (who want tests to be performed in operational conditions) and platform developers (who want statistically relevant tests) is followed. Therefore, we propose in this article a qualitative and quantitative validation methodology for drone detection systems. The proposed validation methodology seeks to find this compromise between operationally relevant benchmarking (by providing qualitative benchmarking under varying environmental conditions) and statistically relevant evaluation (by providing quantitative score sheets under strictly described conditions).

show abstract

Section: Previous Work and A Discussion On Quantitative And Qualitatimentioning

confidence: 99%

Section: Conceptual Differences Between the Proposed Methods And The Smentioning

confidence: 99%

See 1 more Smart Citation

Using a qualitative and quantitative validation methodology to evaluate a drone detection system

Doroftei

Cubber

2019

ACTA IMEKO

View full text Add to dashboard Cite

show abstract

“…ERL Emergency Robots (Röning, Kauppinen, Pitkänen, Kemppainen, & Tikanmäki, ; Winfield et al, ) is a civilian, outdoor robotics competition, with focus on realistic, multidomain emergency response scenarios. Inspired by the 2011 Fukushima accident, the ERL Emergency Grand Challenge can only be overcome when land, underwater, and flying robots successfully cooperate.…”

Section: Introductionmentioning

confidence: 99%

Low‐cost solution in international robotic challenge: Lessons learned by Tuscany Robotics Team at ERL Emergency Robots 2017

Limosani

Manzi

Faggiani

et al. 2018

Journal of Field Robotics

View full text Add to dashboard Cite

European Robotics League (ERL) Emergency Robots is an outdoor robotics contest focusing on multidomain emergency response scenarios. In this context, the deployed robots are expected to fulfill land, underwater, and flying cooperative tasks which emulate real-world situations inspired by the 2011 Fukushima accident.Participation of the Tuscany Robotics Team at ERL Emergency Robots 2017 was deeply affected by damage to (and resulting unavailability of) the unmanned ground vehicle to be used in the competition. This damage occurred 3 days before the challenge. An entirely new working mobile platform was built from scratch using a low-cost chassis. It was able to compete with the other participants in the challenge and achieved various tasks (~83% of the tasks completed by the best performer).The paper provides a complete description of the work carried out and the system used during the competition. The development was based on low-cost solutions, in particular:• Adoption of open-hardware and open-software technology, providing cheap and fastprototyping solutions.• Use of smartphones, allowing sophisticated sensors to be exploited in an affordable way.• Employment of Cloud infrastructures, to reduce the computational burden of offloading heavy processes.Results of this experience represent a concrete demonstration, showing that even lowcost solutions can achieve complex tasks, such as those required for the European robotic competition. The presented lessons learned aim to provide guidelines useful for reacting to unexpected events. Finally, the team was honored with the Creativity

show abstract

“…Focused on multi-domain cooperation, the 2015 euRathlon competition required flying, land and marine robots acting together to survey the disaster, collect environmental data, and identify critical hazards. The first (land) competition was held in 2013 in Berchtesgaden, Germany [1]. In September 2014, the second (sea) competition was held in La Spezia, Italy [2,3].…”

Section: Introductionmentioning

confidence: 99%

euRathlon 2015: A Multi-domain Multi-robot Grand Challenge for Search and Rescue Robots

Winfield

Franco

Brueggemann

et al. 2016

Towards Autonomous Robotic Systems

Self Cite

View full text Add to dashboard Cite

Abstract. Staged at Piombino, Italy in September 2015, euRathlon 2015 was the world's first multi-domain (air, land and sea) multi-robot search and rescue competition. In a mock-disaster scenario inspired by the 2011 Fukushima NPP accident, the euRathlon 2015 Grand Challenge required teams of robots to cooperate to map the area, find missing workers and stem a leak. In this paper we outline the euRathlon 2015 Grand Challenge and the approach used to benchmark and score teams. We conclude the paper with an evaluation of both the competition and the performance of the robot-robot teams in the Grand Challenge.

show abstract

euRathlon and ERL Emergency: A Multi-domain Multi-robot Grand Challenge for Search and Rescue Robots

Cited by 10 publications

References 4 publications

Using a qualitative and quantitative validation methodology to evaluate a drone detection system

Using a qualitative and quantitative validation methodology to evaluate a drone detection system

Low‐cost solution in international robotic challenge: Lessons learned by Tuscany Robotics Team at ERL Emergency Robots 2017

euRathlon 2015: A Multi-domain Multi-robot Grand Challenge for Search and Rescue Robots

Contact Info

Product

Resources

About