000007729 001__ 7729 000007729 005__ 20241024114711.0 000007729 02470 $$2doi$$a10.24868/issn.2631-8741.2018.016 000007729 035__ $$a2536903 000007729 037__ $$aGENERAL 000007729 245__ $$aThree laws good: Technology is a dangerous master 000007729 269__ $$a2018-10-03 000007729 336__ $$aConference Proceedings 000007729 520__ $$aA philosophy of technology use has developed in many safety-critical industries that is based upon the view that human operators are feckless and unreliable system operators, so wherever possible should not be trusted to execute safety-critical tasks.  The implicit view of automation is that it invariably improves system performance and increases reliability. After many decades or even centuries of machine and automation development human error remains one of the dominant features in failures of modern systems. The drive towards introducing automation has claimed a larger performance envelope, lower operating costs with fewer people, less risk of hazard realisation, and a more economical path in development. One of the aims of introducing automation is to introduce higher reliability in the belief that this implicitly brings with it increases in safety. As Leveson (2011) points out high reliability can be misleading because interactions between elements that are working as expected may trigger the system failure because of transverse consequences. The propagation of the view that human operators are the weakest operational link and the pervasive myths about the reliability of automated solutions, which affords automation the easier scenarios of task execution, need to be re-visited (Cook, Thody and Garrett, 2017). This should ensure that the best capability and optimal safety case is developed for future systems based upon operator and system in synergy. This may be especially true if the claims for automation are treated more aggressively in terms of liability. 000007729 542__ $$fCC-BY-NC-ND-4.0 000007729 7001_ $$aCook, M J$$uBAE SYSTEMS (Maritime), Barrow-in-Furness, Cumbria, LA14 1AF 000007729 7001_ $$aSimpson, T$$uBAE SYSTEMS (Maritime), Barrow-in-Furness, Cumbria, LA14 1AF 000007729 7001_ $$aGarrett, D$$uBAE SYSTEMS (Maritime), Barrow-in-Furness, Cumbria, LA14 1AF 000007729 7001_ $$aThody, M$$uBAE SYSTEMS (Maritime), Barrow-in-Furness, Cumbria, LA14 1AF 000007729 773__ $$tConference Proceedings of iSCSS 000007729 773__ $$jiSCSS 2018 000007729 789__ $$whttps://zenodo.org/record/2536903$$2URL$$eIsIdenticalTo 000007729 8564_ $$9ca288c01-3528-4ab1-a963-d4bec3ea40ff$$s950837$$uhttps://library.imarest.org/record/7729/files/ISCSS%202018%20Paper%20056%20Cook%20FINAL.pdf