000010696 001__ 10696 000010696 005__ 20240531171551.0 000010696 0247_ $$2doi$$a10.24868/10696 000010696 245__ $$aAssessing the Effectiveness of Naval Ship Automation: Opportunities and Challenges 000010696 269__ $$a2022-09-27 000010696 336__ $$aConference Proceedings 000010696 520__ $$aAutomation is of significant interest to the field of naval ship design and operations, resulting in substantial research, development and implementation efforts being carried out in this field. Many of the expected benefits of automation, such as increased situational awareness and reduced operator workload, have a rather abstract, qualitative nature, and cannot easily be measured. This makes it difficult to predict or evaluate the effectiveness of automation projects. In order to address this challenge, this paper explores to which extent a need for such effectiveness assessment methods is experienced, and what type of information could be provided by such methods. A literature study into methods that are currently available for assessing the effectiveness of automation shows that most methods focus on either quantitative assessments for measuring specific effects, or qualitative assessments for measuring generic effects. Subsequently, a survey with Subject Matter Experts (SME’s) of the Netherlands Ministry of Defence shows that qualitative assessments with user feedback are widely adopted to assess the effectiveness of automation. At the same time, many SME’s recognise the subjective nature of this type of information as a challenge. Based on the literature review and the SME survey, the authors conclude that user feedback, though being subjective, remains an adequate method for assessing the effectiveness of automation, but that additional efforts are needed to apply user feedback effectively in automation programmes. More specifically, there should be an adequate mechanism for dealing with user feedback, as well as opportunity and commitment of all parties involved in the collaboration, in order to make naval automation a success. 000010696 542__ $$fCC-BY 000010696 6531_ $$aNaval Ship Design 000010696 6531_ $$aAutomation 000010696 6531_ $$aEffectiveness Metrics 000010696 6531_ $$aKPIs 000010696 6531_ $$aSME survey 000010696 7001_ $$aHabben Jansen, A$$uDefence Materiel Organisation 000010696 7001_ $$aStuivenberg, T$$uDefence Materiel Organisation 000010696 7001_ $$aViegers, M$$uDefence Materiel Organisation 000010696 773__ $$tConference Proceedings of INEC 000010696 773__ $$jINEC 2022 000010696 85641 $$uhttps://www.imarest.org/events/category/categories/imarest-event/international-naval-engineering-conference-and-exhibition-2022$$yConference website 000010696 8564_ $$9167010aa-89e2-4598-90f0-60a8b009e32c$$s422707$$uhttps://library.imarest.org/record/10696/files/INEC_2022_paper_35.pdf 000010696 980__ $$aConference Proceedings