Many proposed autonomous systems are safety critical and will have to be certified before they can be operated. This paper reviews the challenges that autonomous systems pose for safety and the current state of relevant safety standards, concluding that autonomous system certification is possible under current regimes, but difficult given current safety analysis techniques. Some promising techniques are reviewed.

There is growing interest in many sectors in developing highly autonomous systems such as Unmanned Air Vehicles (UAVs) with significant in-mission executive power. Such systems have the potential to replace humans in a variety of dangerous tasks, but there is concern that the combination of novel technologies with demanding tasks and unpredictable environments will lead to new safety challenges. This paper reviews proposed scenarios of autonomous system applications and identifies the safety concerns that they raise. It then explores how autonomous systems can be certified as safe to operate within the terms of the existing safety standards that are used by the UK military. The combination of difficulties arising from the nature of autonomous systems and the provisions of the existing safety standards raise serious concerns about the practicality of certification. With this in mind, promising work on new techniques for analysing and ensuring the safety of autonomous systems is reviewed. Finally, some future concerns and directions are identified.

requirements for the degree of

Many proposed autonomous systems are safety critical and will have to be certified before they can be operated. This paper reviews the challenges that autonomous systems pose for safety and the current state of relevant safety standards, concluding that autonomous system certification is possible under current regimes, but difficult given current safety analysis techniques. Some promising techniques are reviewed.