Abstract
This paper details a methodology for measuring human judgment in general, and the fit between human judgment and the output of alerting algorithms in particular. Building on judgment analysis methods, the utility of using n-system lens modeling to directly compare the judgment correspondence between human judgments and those provided by automated systems is demonstrated. This method can highlight the degree of agreement between human judgment and automated system judgments, thereby predicting situations wherein the human may disagree with, and potentially not rely on, an automated system. To illustrate this methodology, a study previously analyzed using nomothetic methods is examined using the n-system model.