• https://doi.org/10.1007/978-94-6265-631-4_4Copy DOI Icon

Measures of Performance

  • Jan 1, 2024
  • Jonathan Kwik
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Literature on autonomous weapon systems (AWS) make frequent reference to measures of performance (MoP) like accuracy, reliability or robustness, often to make normative statements (e.g. regarding the prohibition on indiscriminate weapons). How users of AWS are expected to interpret and use such MoPs, however, is rarely addressed. This is problematic as many indicators, such as accuracy, are measured very differently for AI systems compared to conventional weapons. This chapter explores in depth four MoPs specific to AI—accuracy, robustness, reliability and understandability—that are crucial to consider when making legal decisions concerning the deployment of AWS. For accuracy, a warning is issued to not take the metric at face value, but instead to decompose the metric into Recall and Specificity, representing an AWS’s military utility and ability to discriminate respectively. The importance of understandability from a legal and practical perspective is also highlighted, and juxtaposed to modern AI models which often feature a degree of opacity. For MoPs in general, the chapter concludes that this is an element of Technical Awareness that is largely out of a field commander’s hands: instead, responsibility lies with the Providing Entity to engage in careful and effective development and testing to ensure legal and operational benchmarks are upheld. At the same time, end-users of AWS retain important supporting roles, e.g. by providing diligent reports after use to improve robustness and reliabillity predictions of systems.

Similar Papers
  • Research Article
  • Citations101

ACCF/AHA New Insights Into the Methodology of Performance Measurement

  • Nov 08, 2010
  • Circulation
  • John A Spertus +11
  • Book Chapter
  • Citations9

Performance measurement and executive compensation: Practices of high-performance companies

  • Jan 01, 2008
  • Belverd E Needles +2
  • Research Article
  • Citations9

Effect of Compliance to Updated AHA/ACC Performance and Quality Measures Among Patients With Atrial Fibrillation on Outcome (from Japanese Multicenter Registry)

  • May 30, 2017
  • The American Journal of Cardiology
  • Taku Inohara +11
  • Research Article
  • Citations5

The relative and incremental information content of earnings vs cash recovery rates

  • Oct 31, 2008
  • Review of Accounting and Finance
  • Amal A Said +2
  • Discussion
  • Citations3

Diabetes mellitus performance measures in individuals with limited life expectancy.

  • Feb 01, 2012
  • Journal of the American Geriatrics Society
  • Sei J Lee +1
  • Research Article
  • Citations93

Decreased maximal aerobic capacity with use of a triphasic oral contraceptive in highly active women: a randomised controlled trial

  • Jul 31, 2003
  • British Journal of Sports Medicine
  • C M Lebrun +4
  • Research Article
  • Citations120

The role of firm characteristics on the relationship between gender diversity and firm performance

  • Jul 11, 2016
  • Management Decision
  • Mehmet Nihat Solakoglu +1
  • Research Article
  • Citations33

Functional brain connectivity and cognition: effects of adult age and task demands

  • Mar 21, 2013
  • Neurobiology of Aging
  • Ying-Hui Chou +2
  • Dissertation

Counting family support? : the influence of performance measurement on child protection policy and practice

  • Jan 01, 2004
  • The University of Queensland
  • Clare Tilbury
  • Research Article
  • Citations67

Performance, reliability, and performability of material handling systems

  • Feb 01, 1998
  • International Journal of Production Research
  • B M Beamon
  • Research Article
  • Citations38

The use of performance measures: case studies from the microfinance sector in Kenya

  • Apr 06, 2012
  • Qualitative Research in Accounting & Management
  • Nelson Waweru +1
  • Research Article
  • Citations499

Performance Measurement in Municipal Government: Assessing the State of the Practice

  • Jul 01, 1999
  • Public Administration Review
  • Theodore H Poister +1
  • Research Article
  • Citations227

Errors in Laboratory Medicine: Practical Lessons to Improve Patient Safety

  • Oct 01, 2005
  • Archives of Pathology & Laboratory Medicine
  • Peter J Howanitz
  • Front Matter
  • Citations24

Cost-effectiveness analysis in cardiac surgery: A review of its concepts and methodologies

  • Nov 15, 2017
  • The Journal of Thoracic and Cardiovascular Surgery
  • Bart S Ferket +4
  • Research Article
  • Citations308

Performance measures were necessary to obtain a complete picture of osteoarthritic patients

  • Dec 27, 2005
  • Journal of Clinical Epidemiology
  • Paul W Stratford +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.