You are here

Assessment Center Structure and Construct Validity: A New Hope

Download pdf | Full Screen View

Date Issued:
2015
Abstract/Description:
Assessment Centers (ACs) are a fantastic method to measure behavioral indicators of job performance in multiple diverse scenarios. Based upon a thorough job analysis, ACs have traditionally demonstrated very strong content and criterion-related validity. However, researchers have been puzzled for over three decades with the lack of evidence concerning construct validity. ACs are designed to measure critical job dimensions throughout multiple situational exercises. However, research has consistently revealed that different behavioral ratings within these scenarios are more strongly related to one another (exercise effects) than the same dimension rating across scenarios (dimension effects). That is, results from ACs suggest that we are unsure of what these behavioral measures represent. Over the last three decades, researchers have sought to illuminate why same dimension ratings are inconsistent across scenarios. However, these investigations have been limited to changes influencing the source of the ratings (e.g., assessors, trained raters). No approach has been taken to change the structure of the AC. This study breaks with tradition and introduces a structurally different AC: A Day-In-The Life AC (DITLAC). A DITLAC structure is designed to mimic that of a normal day on the job. In the present study, the construct validity between a DITLAC and a traditionally structured AC is compared with the argument that the DITLAC will demonstrate stronger construct validity evidence. In several cases, this was found to be true.
Title: Assessment Center Structure and Construct Validity: A New Hope.
25 views
13 downloads
Name(s): Wiese, Christopher, Author
Jentsch, Kimberly, Committee Chair
Salas, Eduardo, Committee Member
Jentsch, Florian, Committee Member
Burke, Shawn, Committee Member
University of Central Florida, Degree Grantor
Type of Resource: text
Date Issued: 2015
Publisher: University of Central Florida
Language(s): English
Abstract/Description: Assessment Centers (ACs) are a fantastic method to measure behavioral indicators of job performance in multiple diverse scenarios. Based upon a thorough job analysis, ACs have traditionally demonstrated very strong content and criterion-related validity. However, researchers have been puzzled for over three decades with the lack of evidence concerning construct validity. ACs are designed to measure critical job dimensions throughout multiple situational exercises. However, research has consistently revealed that different behavioral ratings within these scenarios are more strongly related to one another (exercise effects) than the same dimension rating across scenarios (dimension effects). That is, results from ACs suggest that we are unsure of what these behavioral measures represent. Over the last three decades, researchers have sought to illuminate why same dimension ratings are inconsistent across scenarios. However, these investigations have been limited to changes influencing the source of the ratings (e.g., assessors, trained raters). No approach has been taken to change the structure of the AC. This study breaks with tradition and introduces a structurally different AC: A Day-In-The Life AC (DITLAC). A DITLAC structure is designed to mimic that of a normal day on the job. In the present study, the construct validity between a DITLAC and a traditionally structured AC is compared with the argument that the DITLAC will demonstrate stronger construct validity evidence. In several cases, this was found to be true.
Identifier: CFE0005905 (IID), ucf:50878 (fedora)
Note(s): 2015-08-01
Ph.D.
Sciences, Psychology
Doctoral
This record was generated from author submitted information.
Subject(s): Assessment Centers -- Construct Validity -- day in the life -- day in a life -- exercise effects -- dimension effects -- AC -- nomological network
Persistent Link to This Record: http://purl.flvc.org/ucf/fd/CFE0005905
Restrictions on Access: public 2015-08-15
Host Institution: UCF

In Collections