A Comparison of Scoring Strategies for Operational Situational Judgment Tests

Authors

  • Byon H. Miller Ford Motor Company
  • Calvin C. Hoffman Los Angeles County Sheriff’s Department
  • Carlos Valle Los Angeles County Sheriff’s Department

DOI:

https://doi.org/10.33423/jop.v19i1.1090

Keywords:

Situational Judgment Tests, Human Resource, Assessment Tool, Employment

Abstract

The use of situational judgment tests (SJTs) has increased recently. SJTs offer many advantages compared to other assessments, including validity, flexibility in administration, objective scoring, and reduced mean group differences. While use has increased (Roth, Bobko, & Buster, 2013), there is little consensus regarding SJT scoring (Bergman et al., 2006). This study used data from operational SJTs to evaluate and compare scoring strategies in terms of convergence, reliability, mean group differences, and candidate rank order. Results demonstrate that different scoring strategies can produce wildly different rank orders and can contribute to differences in reliability values and mean group test scores.

Downloads

Published

2019-03-19

How to Cite

Miller, B. H., Hoffman, C. C., & Valle, C. (2019). A Comparison of Scoring Strategies for Operational Situational Judgment Tests. Journal of Organizational Psychology, 19(1). https://doi.org/10.33423/jop.v19i1.1090

Issue

Section

Articles