WG-9
Personnel Analytics
Exploring Comparative Rating Methods for Army Talent Evaluation
Ian Moss
Naval Postgraduate School
Army organizations rely on subjective evaluations to identify high performers, support promotion decisions, and guide talent management.
Abstract
Army organizations rely on subjective evaluations to identify high performers, support promotion decisions, and guide talent management. However, when evaluators are asked to assess individuals across different roles, experience levels, and observation opportunities, the resulting rankings may vary substantially depending on the metric used and point estimates of rank may obscure considerable uncertainty.
This research explores comparative ranking methods for evaluating human performance in Army-relevant settings. The study considers Elo-style methods and related approaches such as pairwise comparison models, skill-estimation models, and methods that produce Bayesian confidence or uncertainty intervals around rankings.
The project considers how these methods could inform Army officer evaluation and talent management by providing structured, uncertainty-aware performance signals. The goal is to assess whether comparative methods can help distinguish demonstrated performance, developmental feedback, and future potential with greater transparency. The expected contribution is a framework for understanding not only who appears to rank highly, but how confident decision-makers should be in that assessment.
This research explores comparative ranking methods for evaluating human performance in Army-relevant settings. The study considers Elo-style methods and related approaches such as pairwise comparison models, skill-estimation models, and methods that produce Bayesian confidence or uncertainty intervals around rankings.
The project considers how these methods could inform Army officer evaluation and talent management by providing structured, uncertainty-aware performance signals. The goal is to assess whether comparative methods can help distinguish demonstrated performance, developmental feedback, and future potential with greater transparency. The expected contribution is a framework for understanding not only who appears to rank highly, but how confident decision-makers should be in that assessment.
Presenters
- Ian MossNaval Postgraduate School