How to measure lineup fairness: concurrent and predictive validity of lineup-fairness measures

References

• References marked with an asterisk indicate studies reviewed for our preliminary examination in Footnote 6.
   Google Scholar
• Bajusz, D., Miranda-Quintana, R. A., Rácz, A., & Héberger, K. (2021). Extended many-item similarity indices for sets of nucleotide and protein sequences. Computational and Structural Biotechnology Journal, 19, 3628–3639. https://doi.org/10.1016/j.csbj.2021.06.021
   PubMed Web of Science ®Google Scholar
• Baselga, A. (2013). Multiple site dissimilarity quantifies compositional heterogeneity among several sites, while average pairwise dissimilarity may be misleading. Ecography, 36(2), 124–128. https://doi.org/10.1111/j.1600-0587.2012.00124.x
   Web of Science ®Google Scholar
• Bergold, A. N., & Heaton, P. (2018). Does filler database size influence identification accuracy? Law and Human Behavior, 42(3), 227–243. https://doi.org/10.1037/lhb0000289
   PubMed Web of Science ®Google Scholar
• *Brewer, N., Vagadia, A. N., Hope, L., & Gabbert, F. (2018). Interviewing witnesses: Eliciting coarse-grain information. Law and Human Behavior, 42(5), 458–471. https://doi.org/10.1037/lhb0000294
   PubMed Web of Science ®Google Scholar
• Brigham, J. C., & Brandt, C. C. (1992). Measuring lineup fairness: Mock-witness responses versus direct evaluations of lineups. Law and Human Behavior, 16(5), 475–489. https://doi.org/10.1007/BF01044619
   Web of Science ®Google Scholar
• *Brown, C., Portch, E., Nelson, L., & Frowd, C. D. (2020). Reevaluating the role of verbalization of faces for composite production: Descriptions of offenders matter!. Journal of Experimental Psychology: Applied, 26(2), 248–265. https://doi.org/10.1037/xap0000251
   PubMed Web of Science ®Google Scholar
• *Brown, D. A., Lamb, M. E., Lewis, C., Pipe, M.-E., Orbach, Y., & Wolfman, M. (2013). The NICHD investigative interview protocol: An analogue study. Journal of Experimental Psychology: Applied, 19(4), 367–382. https://doi.org/10.1037/a0035143
   PubMed Web of Science ®Google Scholar
• *Brown, D. A., Lewis, C. N., Lamb, M. E., Gwynne, J., Kitto, O., & Stairmand, M. (2019). Developmental differences in children’s learning and use of forensic ground rules during an interview about an experienced event. Developmental Psychology, 55(8), 1626–1639. https://doi.org/10.1037/dev0000756
   PubMed Web of Science ®Google Scholar
• Bruer, K. C., Fitzgerald, R. J., Therrien, N. M., & Price, H. L. (2015). Line-up member similarity influences the effectiveness of a salient rejection option for eyewitnesses. Psychiatry, Psychology and Law, 22(1), 124–133. https://doi.org/10.1080/13218719.2014.919688
   Web of Science ®Google Scholar
• Colloff, M. F., Wilson, B. M., Seale-Carlisle, T. M., & Wixted, J. T. (2021). Optimizing the selection of fillers in police lineups. Proceedings of the National Academy of Sciences, 118(8), e2017292118. https://doi.org/10.1073/pnas.2017292118
   PubMed Web of Science ®Google Scholar
• *Crozier, W. E., & Strange, D. (2019). Correcting the misinformation effect. Applied Cognitive Psychology, 33(4), 585–595. https://doi.org/10.1002/acp.3499
   Web of Science ®Google Scholar
• Doob, A. N., & Kirshenbaum, H. M. (1973). The effects on arousal of frustration and aggressive films. Journal of Experimental Social Psychology, 9(1), 57–64. https://doi.org/10.1016/0022-1031(73)90062-0
   Web of Science ®Google Scholar
• *Eisen, M. L., Ying, R., Williams, J., & Gabbert, F. (n.d.). “I think he had a tattoo on his neck”: How co-witness discussions about a perpetrator’s description can affect eyewitness identification decisions. Journal of Applied Research in Memory and Cognition, 6(3), 274–282. https://doi.org/10.1016/j.jarmac.2017.01.009
   Web of Science ®Google Scholar
• Evelo, A., Lee, J., Modjadidi, K., & Penrod, S. D. (2018, June 26–29). The role of lineup bias in witness accuracy, the confidence-accuracy relationship and the courtroom value of witness confidence. Paper presentation. The annual conference of the European Association of Psychology and Law in Turku, Finland.
   Google Scholar
• *Fahsing, I. A., Ask, K., & Granhag, P. A. (2004). The man behind the mask: Accuracy and predictors of eyewitness offender descriptions. Journal of Applied Psychology, 89(4), 722–729. https://doi.org/10.1037/0021-9010.89.4.722
   PubMed Web of Science ®Google Scholar
• Fitzgerald, R. J., Price, H. L., Oriet, C., & Charman, S. D. (2013). The effect of suspect-filler similarity on eyewitness identification decisions: A meta-analysis. Psychology, Public Policy, and Law, 19(2), 151–164. https://doi.org/10.1037/a0030618
   Web of Science ®Google Scholar
• Hao, M., Corral-Rivas, J. J., González-Elizondo, M. S., Ganeshaiah, K. N., Nava-Miranda, M. G., Zhang, C., Zhao, X., & Gadow, K. V. (2019). Assessing biological dissimilarities between five forest communities. Forest Ecosystems, 6(1), 1–8. https://doi.org/10.1186/s40663-019-0161-7
   Google Scholar
• Hirschberg, N., Jones, L. E., & Haggerty, M. (1978). What's in a face: Individual differences in face perception. Journal of Research in Personality, 12(4), 488–499. https://doi.org/10.1016/0092-6566(78)90074-0
   Web of Science ®Google Scholar
• Horry, R., Fitzgerald, R. J., & Mansour, J. K. (2021). “Only your first yes will count”: The impact of prelineup instructions on sequential lineup decisions. Journal of Experimental Psychology: Applied, 27(1), 170–186. https://doi.org/10.1037/xap0000337
   PubMed Web of Science ®Google Scholar
• Lee, J., Mansour, J. K., & Penrod, S. D. (2022). Validity of mock-witness measures for assessing lineup fairness. Psychology, Crime & Law, 28(3), 215–245. https://doi.org/10.1080/1068316X.2021.1905811
   Web of Science ®Google Scholar
• Lee, J., & Penrod, S. D. (2019). New signal detection theory-based framework for eyewitness performance in lineups. Law and Human Behavior, 43(5), 436–454. https://doi.org/10.1037/lhb0000343
   PubMed Web of Science ®Google Scholar
• *Lindholm, T., Jönsson, F. U., & Liuzza, M. T. (2018). Retrieval effort cues predict eyewitness accuracy. Journal of Experimental Psychology: Applied, 24(4), 534–542. https://doi.org/10.1037/xap0000175
   PubMed Web of Science ®Google Scholar
• *Lindsay, R. C. L., Martin, R., & Webber, L. (1994). Default values in eyewitness descriptions: A problem for the match-to-description lineup foil selection strategy. Law and Human Behavior, 18(5), 527–541. https://doi.org/10.1007/BF01499172
   Web of Science ®Google Scholar
• Lindsay, R. C. L., & Wells, G. L. (1980). What price justice? Exploring the relationship of lineup fairness to identification accuracy. Law and Human Behavior, 4(4), 303–313. https://doi.org/10.1007/BF01040622
   Google Scholar
• Lucas, C. A., & Brewer, N. (2022). Could precise and replicable manipulations of suspect-filler similarity optimize eyewitness identification performance? Psychology, Public Policy, and Law, 28(1), 108–122. https://doi.org/10.1037/law0000329
   Web of Science ®Google Scholar
• Luus, C. A. E., & Wells, G. L. (1991). Eyewitness identification and the selection of distracters for lineups. Law and Human Behavior, 15(1), 43–57. https://doi.org/10.1007/BF01044829
   Web of Science ®Google Scholar
• Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user's guide (2nd ed.). Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Malpass, R. S. (1981). Effective size and defendant bias in eyewitness identification lineups. Law and Human Behavior, 5(4), 299–309. https://doi.org/10.1007/BF01044945
   Google Scholar
• Malpass, R. S., & Lindsay, R. C. L. (1999). Measuring lineup fairness. Applied Cognitive Psychology, 13(S1), 1–7. https://doi.org/10.1002/(SICI)1099-0720(199911)13:1+<S1::AID-ACP678>3.0.CO;2-9
   Google Scholar
• Mansour, J. K. (2020). The confidence-accuracy relationship using scale versus other methods of assessing confidence. Journal of Applied Research in Memory and Cognition, 9(2), 215–231. https://doi.org/10.1037/h0101846
   Web of Science ®Google Scholar
• Mansour, J. K., Beaudry, J. L., Kalmet, N., Bertrand, M. I., & Lindsay, R. C. L. (2017). Evaluating lineup fairness: Variations across methods and measures. Law and Human Behavior, 41(1), 103–115. https://doi.org/10.1037/lhb0000203
   PubMed Web of Science ®Google Scholar
• Mansour, J. K., Lindsay, R. C. L., Brewer, N., & Munhall, K. G. (2009). Characterizing visual behaviour in a lineup task. Applied Cognitive Psychology, 23(7), 1012–1026. https://doi.org/10.1002/acp.1570
   Web of Science ®Google Scholar
• *McCallum, N. A., Brewer, N., & Weber, N. (2016). Memorial monitoring and control: How confidence and social and financial consequences affect eyewitnesses’ reporting of fine-grain information. Applied Cognitive Psychology, 30(3), 375–386. https://doi.org/10.1002/acp.3212
   Web of Science ®Google Scholar
• *Meissner, C. A., Sporer, S. L., & Schooler, J. W. (2007). Person descriptions as eyewitness evidence. In R. C. L. Lindsay, D. F. Ross, J. D. Read, & M. P. Toglia (Eds.), The handbook of eyewitness psychology, Vol. 2. Memory for people (pp. 3–34). Lawrence Erlbaum Associates Publishers.
   Google Scholar
• *Mickes, L. (2016). The effects of verbal descriptions on eyewitness memory: Implications for the real-world. Journal of Applied Research in Memory and Cognition, 5(3), 270–276. https://doi.org/10.1016/j.jarmac.2016.07.003
   Web of Science ®Google Scholar
• Milord, J. T. (1978). Aesthetic aspects of faces: A (somewhat) phenomenological analysis using multidimensional scaling methods. Journal of Personality and Social Psychology, 36(2), 205–216. https://doi.org/10.1037/0022-3514.36.2.205
   Web of Science ®Google Scholar
• Miranda-Quintana, R. A., Bajusz, D., Rácz, A., & Hebergerm, K. (2021). Extended similarity indices: The benefits of comparing more than two objects simultaneously. Part 1: Theory and characteristics. Journal of Cheminformatics, 13(1), 1–18. https://doi.org/10.1186/s13321-020-00477-w
   PubMed Web of Science ®Google Scholar
• *Nixon, M. S., Guo, B. H., Jaha, E. S., Almudhahka, N., Martinho-Corbishley, D., & Stevenage, S. V. (n.d.). Towards automated eyewitness descriptions: Describing the face, body and clothing for recognition. Visual Cognition, 25(4–6), 524–538. https://doi.org/10.1080/13506285.2016.1266426
   Web of Science ®Google Scholar
• O'Neill, B. (2006). Elementary differential geometry (2nd ed.). Academic Press.
   Google Scholar
• Oriet, C., & Fitzgerald, R. J. (2018). The single lineup paradigm: A new way to manipulate target presence in eyewitness identification experiments. Law and Human Behavior, 42(1), 1–12. https://doi.org/10.1037/lhb0000272
   PubMed Web of Science ®Google Scholar
• Pennekamp, P., Batstone, R. J., & Mansour, J. K. (2019, December). Eyewitness identification confidence: Requesting, articulating, and apperceiving. Poster at the Scottish Institute for Policing Research.
   Google Scholar
• Penrod, S. D. (2003). Eyewitness identification evidence: How well are witnesses and police performing? Criminal Justice Magazine, Spring, 36–47.
   Google Scholar
• Quigley-McBride, A., & Wells, G. L. (2021). Methodological considerations in eyewitness identification experiments. In A. M. Smith, M. Toglia, & J. M. Lampinen (Eds.), Methods, measures, and theories in eyewitness identification tasks (pp. 85–112). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9781003138105-8.
   Google Scholar
• Semmelmann, K., & Weigelt, S. (2018). Online webcam-based eye tracking in cognitive science: A first look. Behavior Research Methods, 50(2), 451–465. https://doi.org/10.3758/s13428-017-0913-7
   PubMed Web of Science ®Google Scholar
• *Sporer, S. L., Kaminski, K. S., Davids, M. C., & McQuiston, D. (2016). The verbal facilitation effect: Re-reading person descriptions as a system variable to improve identification performance. Memory (Hove, England), 24(10), 1329–1344. https://doi.org/10.1080/09658211.2015.1106561
   PubMed Web of Science ®Google Scholar
• Tredoux, C. (2002). A direct measure of facial similarity and its relation to human similarity perceptions. Journal of Experimental Psychology: Applied, 8(3), 180–193. https://doi.org/10.1037/1076-898X.8.3.180
   PubMed Web of Science ®Google Scholar
• Tredoux, C. G. (1998). Statistical inference on measures of lineup fairness. Law and Human Behavior, 22(2), 217–237. https://doi.org/10.1023/A:1025746220886
   Web of Science ®Google Scholar
• Tredoux, C. G. (1999). Statistical considerations when determining measures of lineup size and lineup bias. Applied Cognitive Psychology, 13(S1), 9–26. https://doi.org/10.1002/(SICI)1099-0720(199911)13:1+<S9::AID-ACP634>3.0.CO;2-1
   Google Scholar
• *Van Koppen, P. J., & Lochun, S. K. (1997). Portraying perpetrators: The validity of offender descriptions by witnesses. Law and Human Behavior, 21(6), 661–685. https://doi.org/10.1023/A:1024812831576
   Web of Science ®Google Scholar
• *Vredeveldt, A., Hildebrandt, A., & van Koppen, P. J. (n.d.). Acknowledge, repeat, rephrase, elaborate: Witnesses can help each other remember more. Memory (Hove, England), 24(5), 669–682. https://doi.org/10.1080/09658211.2015.1042884
   PubMed Web of Science ®Google Scholar
• Wells, G. L., & Bradfield, A. L. (1999). Measuring the goodness of lineups: Parameter estimation, question effects, and limits to the mock witness paradigm. Applied Cognitive Psychology, 13(Special Issue), S27–S39. https://doi.org/10.1002/(SICI)1099-0720(199911)13:1+<S27::AID-ACP635>3.0.CO;2-M
   Google Scholar
• Wells, G. L., Kovera, M. B., Douglass, A. B., Brewer, N., Meissner, C. A., & Wixted, J. T. (2020). Policy and procedure recommendations for the collection and preservation of eyewitness identification evidence. Law and Human Behavior, 44(1), 3–36. https://doi.org/10.1037/lhb0000359
   PubMed Web of Science ®Google Scholar
• Wells, G. L., Leippe, M. R., & Ostrom, T. M. (1979). Guidelines for empirically assessing the fairness of a lineup. Law and Human Behavior, 3(4), 285–293. https://doi.org/10.1007/BF01039807
   Google Scholar
• Wells, G. L., Rydell, S. M., & Seelau, E. P. (1993). The selection of distractors for eyewitness lineups. Journal of Applied Psychology, 78(5), 835–844. https://doi.org/10.1037/0021-9010.78.5.835
   Web of Science ®Google Scholar
• Werchan, D. M., Thomason, M. E., & Brito, N. H. (2022). OWLET: An automated, open-source method for infant gaze tracking using smartphone and webcam recordings. Behavior Research Methods. Advanced online publication. https://doi.org/10.3758/s13428-022-01962-w
   PubMed Web of Science ®Google Scholar
• *Wilford, M. M., Chan, J. C. K., & Tuhn, S. J. (2014). Retrieval enhances eyewitness suggestibility to misinformation in free and cued recall. Journal of Experimental Psychology: Applied, 20(1), 81–93. https://doi.org/10.1037/xap0000001
   PubMed Web of Science ®Google Scholar
• *Yuille, J. C., & Cutshall, J. L. (1986). A case study of eyewitness memory of a crime. Journal of Applied Psychology, 71(2), 291–301. https://doi.org/10.1037/0021-9010.71.2.291
   PubMed Web of Science ®Google Scholar