Cognitive Autonomous Diving BUDDY

 

Name: Cognitive Autonomous Diving BUDDY
Acronym: CADDY
Funding scheme: FP7- ICT Collaborative project, Small or medium-scale focused research project (STREP)
Grant Agreement Number: 611373
Total budget: € 4,881,103
Start and end dates: 1 January 2014 – 31 December 2016
Coordinator: UNIZG-FER LABUST (HR)
Partners: Consiglio Nazionale delle Richerche - CNR (IT), Instituto Superior Técnico, Institute for Systems and Robotics -IST (PT), Jacobs University – JACOBS (DE), University of Vienna, Faculty of Life Sciences, Department of Anthropology – UNIVIE (AT), Newcastle University, School of Electrical & Electronic Engineering - UNEW (UK), Diver Alert Network Europe - DANEU (MT)

Project website: http://www.caddy-fp7.eu
Social media: CADDY Facebook page, CADDY YouTube channel

 


Abstract

Divers operate in harsh and poorly monitored environments in which the slightest unexpected disturbance, technical malfunction, or lack of attention can have catastrophic consequences. They manoeuvre in complex 3D environments and carry cumbersome equipment while performing their missions. To overcome these problems, the CADDY project aimed to establish an innovative setup between a diver and companion autonomous robots (underwater and surface) that exhibit cognitive behaviour through learning, interpreting, and adapting to the diver’s behaviour, physical state, and actions.

 

 

1. Excellence

The CADDY project replaced a human buddy diver with an autonomous underwater vehicle and added a new autonomous surface vehicle to improve monitoring, assistance, and overall safety of the diver’s mission. The resulting system plays a threefold role similar to that of a human buddy diver: the buddy “observer” continuously monitors the diver; the buddy “slave” is the diver's “extended hand” during CADDY concept underwater operations; and the buddy “guide” leads the diver through the underwater environment.
 

 

The advances made within the three core research fields ("Seeing the Diver", "Understanding the Diver" and "Diver-Robot Cooperation and Control") demonstrate scientific excellence in terms improved systems functionality, quality, and performance. The achieved technical developments in the form of the multicomponent robotic system, and the development of acoustic sensors, the DiverNet sensor network, etc. demonstrate technical excellence that significantly contributed to the area of marine robotics.

 

The developed features were demonstrated in real-world scenarios during two validation trials in 2016 and 2017 in Croatia. For this purpose, end-users from the areas of underwater archaeology and the search & rescue community helped validate the performance of the overall CADDY system.

2. Impact

A multicomponent system of marine robots and vehicles was developed, consisting of the BUDDY AUV, custom-made for interaction with divers, equipped with an underwater tablet as a means of interaction with the diver, with custom software and a specially constructed waterproof casing, a stereo camera, mono camera, and multibeam sonar; and the MEDUSA ASV modified to serve as the surface vehicle in the CADDY scenario. In order to ensure reliable communication, a new generation of small-scale USBL and acoustic modems has been developed together with a new calibration procedure, resulting in significantly improved accuracies in azimuth and elevation errors. These acoustic modems developed by UNEW have achieved commercialisation as Seatrac acoustic modems and USBL via Blueprint Subsea. The product is now being actively marketed leading to substantial orders. All developed code is open-source.

CADDY was responsible for starting up a new series of workshops “EMRA - Workshop on EU-funded Marine Robotics and Applications” to bridge the gap between industry, end-users, and academia in the marine robotics industry. CADDY partners involved directly in marine robotics have become members of euRobotics, an international non-profit association for both academic and industrial stakeholders in European robotics, collaborating with the European Commission to develop and implement a strategy and a roadmap for research, technological development, and innovation in robotics.

3. Implementation - Goals and Achievements

The CADDY project had an ambitious list of goals and managed to achieve great advancements in all of them: 

  1. Development of a cooperative multi-component system capable of interacting with a diver;
  2. Establishing a robust and flexible underwater sensing network;
  3. Achieving full understanding of conscious and unconscious diver behaviour;
  4. Defining and implementing the execution of cognitive guidance and control algorithms;
  5. Developing a cognitive mission (re)planner.

 

1: Underwater vehicle BUDDY, part
of the multi-component system
2: DiverNet sensor network mounted on custom diving suit
3: Diver pose and behaviour data collection and interpretation
4: Diver-BUDDY cooperative control and guidance concept

 

5: An example of diver hand gestures being parsed and translated into a series of tasks for the BUDDY
 

Some achievements in numbers:

There are 8 products/services developed using CADDY-incubated technologies identified to have a commercialisation potential, two of which have TRL 9 (Technology readiness level) – actual system proven in operational environment. The rest are either TRL 6-7 - technology/prototype demonstrated in relevant/operational environment, or TRL 4-5 - technology validated.

 

 

The project was represented through:

•    14 exhibitions
•    21 presentations and public events
•    50 press releases
•    22 media appearances
•    47 internet portal reports

A talk on CADDY for the public

 

CADDY presentation at the UNIZG Fair

On the scientific side of things, the CADDY project boasts:

•    46 conferences attended, primarily: Oceanology International London 2016, Mediterranean Conference on Control and Automation (MED'14), European Robotics Forum – ERF 2016, MTS/IEEE OCEANS'15 Genova Conference & Exhibit, 10th IFAC Conference on Control Applications in Marine Systems (CAMS'16)

•    4 special sessions:

  • Marine robotics and applications at Mediterranean Conference on Control and Automation (MED'14), Palermo, Italy
  • IFAC World Congress 2014 Invited Track (4 sessions) on Navigation, Control, and Sensing in the Marine Environment, Cape Town, South Africa, August 2014
  • FP7 CADDY Project Workshop Dissemination special session at OCEANS'15, Genova, Italy
  • Robotics in the Western Balkans session at the European Robotics Forum – ERF 2016, 20 March, Ljubljana (Slovenia)

•    55 scientific (peer reviewed) publications, out of which 14 journal papers

•    29 invited lectures and courses

•    7 educational and training outreach events at international workshops: the International Interdisciplinary Field Workshop of Maritime Robotics and Applications Breaking the Surface – BTS 2014, 2015, 2016; and the Workshop on EU funded marine robotics research EMRA 2014, 2015, 2016 and 2017.

CADDY booth at the Oceanology International 2016 conference
The 3rd CADDY workshop at EMRA'16 in Newcastle, UK
CADDY workshop at Breaking the Surface in Biograd, Croatia
Project team after the successful final review meeting in Zagreb