Title page for ETD etd-05092003-081506

Type of Document Master's Thesis
Author Watt, Alisa H.
URN etd-05092003-081506
Title Holistic versus Decomposed Rating Scales: Which causes higher levels of cognitive load?
Degree Master of Science
Department Psychology
Advisory Committee
Advisor Name Title
Foti, Roseanne J. Committee Chair
Crawford, Helen J. Committee Member
Finney, Jack W. Committee Member
Harvey, Robert J. Committee Member
  • Decomposed
  • Holistic
  • Job Analysis
  • Cognitive load
Date of Defense 2003-05-07
Availability unrestricted
The purpose of this study was to help explore the assumptions in job analysis literature involving whether holistic or decomposed job analysis items lead to a higher level of cognitive load for raters. The main study, involving 303 undergraduate university students, was a 2 (Type of measure: holistic or decomposed) X 2 (Level of extraneous cognitive load: additional load or no additional load) within-subjects design. The 160 decomposed items analyzed in this study were pilot tested to ensure that they would correlate with the 17 holistic items. Under the additional cognitive load condition, participants memorized an 8-digit number, and then were asked to recall and recognize this number upon the completion of the rating task (this manipulation was performed for both the holistic and decomposed measures). Stability of ratings across conditions and interrater agreement were used as dependent measures. Results indicated that the holistic items (r=.74) had higher levels of stability across cognitive load conditions than did the decomposed items (r=.66). The levels of interrater agreement were not significantly different between three of the four conditions. In partial support of Butler and Harvey (1988), the level of interrater agreement for the Holistic additional cognitive load condition (r*wg=.33) was significantly lower than the interrater agreement for the remaining three conditions. The pattern of results supported prior research (Cornelius & Lyness, 1980; Lyness & Cornelius, 1982) indicating that, depending on the criteria being used, holistic items do not necessarily cause a higher level of cognitive load for raters than do decomposed items.
  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  alisawattetd.pdf 550.11 Kb 00:02:32 00:01:18 00:01:08 00:00:34 00:00:02

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.