000007547 001__ 7547
000007547 005__ 20240318155451.0
000007547 02470 $$2doi$$a10.24868/issn.2515-8171.2019.001
000007547 035__ $$a3381108
000007547 037__ $$aGENERAL
000007547 245__ $$aThe Test and Evaluation of Intelligent Autonomous Systems (IAS)
000007547 269__ $$a2019-07-02
000007547 336__ $$aConference Proceedings
000007547 520__ $$aIntelligent autonomous systems (IAS) are set to become a feature of future defence programmes, and their introduction will pose challenges to traditional systems engineering and acquisition practice. Whilst the need for operational and technical assurance will endure, the need to manage programmes that deliver iteratively and which are continually evolving requires fresh thinking. New increments may well be undergoing acceptance testing against a backdrop of continual developments to higher level concepts of operation – there may be no stable baseline. Furthermore, the unbounded and potentially non-deterministic nature of IAS means testing alone is unlikely to provide satisfactory assurance, especially for systems that are able to learn from previous mission data. Lastly, at the very core of what is referred to as human-autonomy teaming is a notion of trust by the operator of the IAS, a trust which builds through development, integration, training and deployment, implying a blurring of boundaries between that which is technical assurance and that which is operational. In response to these challenges, QinetiQ are investing in UK test and evaluation infrastructure and developing, with partners, approaches that will mitigate the risks posed by these new technologies. As outlined in this paper, these include distributed live, virtual and constructive facilities, brokered policy enforcement by software and developing a body of trusted software components. The paper argues how these developments address the identified challenges, highlighting remaining gaps and drawing on evidence from ongoing UK MOD research and development; it concludes with the approaching investment and programmatic choices that will need to be made to ensure best-for-enterprise outcomes.
000007547 542__ $$fCC-BY-4.0
000007547 6531_ $$aMaritime
000007547 6531_ $$aAutonomy
000007547 6531_ $$aTest and Evaluation
000007547 6531_ $$aArtificial Intelligence
000007547 7001_ $$aFigueiredo, H$$uQinetiQ Ltd UK
000007547 7001_ $$aCook, D$$uQinetiQ Ltd UK
000007547 7001_ $$aBiggs, W$$uQinetiQ Ltd UK
000007547 773__ $$tConference Proceedings of EAAW
000007547 773__ $$jEAAW VIII
000007547 789__ $$whttps://zenodo.org/record/3381108$$2URL$$eIsIdenticalTo
000007547 85641 $$uhttps://www.imarest.org/eaaw$$yConference website
000007547 8564_ $$9eb9452e1-80bd-407f-9fc4-be68a3d312a6$$s2233653$$uhttps://library.imarest.org/record/7547/files/EAAW%20VIII%20Paper%20001%20Biggs%20Final%20P.pdf