Title page for ETD etd-03262008-102743

Type of Document Master's Thesis
Author Tison, Emilee B
Author's Email Address etison@vt.edu
URN etd-03262008-102743
Title Differential Prediction: Understanding a Tool for Detecting Rating Bias in Performance Ratings
Degree Master of Science
Department Psychology
Advisory Committee
Advisor Name Title
Hauenstein, Neil M. A. Committee Chair
Foti, Roseanne J. Committee Member
Stephens, Robert S. Committee Member
  • Rating Bias
  • Differential Prediction
  • Performance Ratings
  • Race Effects
  • Intercept Bias
Date of Defense 2008-03-19
Availability unrestricted
Three common methods have been used to assess the existence of rating bias in performance ratings: the total association approach, the differential constructs approach and the direct effects approach. One purpose of this study was to examine how the direct effects approach, and more specifically differential prediction analysis, is more useful than the other two approaches in examining the existence of rating bias. However, the usefulness of differential prediction depends on modeling the full rater race X ratee race interaction. Therefore, the second purpose of this study was to examine the conditions where differential prediction has sufficient power to detect this interaction. This was accomplished using monte carlo simulations. Total sample size, magnitude of rating bias, validity of predictor scores, rater race proportion and ratee race proportion were manipulated to identify which conditions of these parameters provided acceptable power to detect the rater race X ratee race interaction; in the conditions where power levels are acceptable, differential prediction is a useful tool in examining the existence of rating bias. The simulation results suggest that total sample size, magnitude of rating bias and rater race proportion have the most impact on power levels. Furthermore, these three parameters interact to effect power. Implications of these results are discussed.
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  TisonThesisETD.pdf 846.58 Kb 00:03:55 00:02:00 00:01:45 00:00:52 00:00:04

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.