You are here
Assessment Center Structure and Construct Validity: A New Hope
- Date Issued:
- 2015
- Abstract/Description:
- Assessment Centers (ACs) are a fantastic method to measure behavioral indicators of job performance in multiple diverse scenarios. Based upon a thorough job analysis, ACs have traditionally demonstrated very strong content and criterion-related validity. However, researchers have been puzzled for over three decades with the lack of evidence concerning construct validity. ACs are designed to measure critical job dimensions throughout multiple situational exercises. However, research has consistently revealed that different behavioral ratings within these scenarios are more strongly related to one another (exercise effects) than the same dimension rating across scenarios (dimension effects). That is, results from ACs suggest that we are unsure of what these behavioral measures represent. Over the last three decades, researchers have sought to illuminate why same dimension ratings are inconsistent across scenarios. However, these investigations have been limited to changes influencing the source of the ratings (e.g., assessors, trained raters). No approach has been taken to change the structure of the AC. This study breaks with tradition and introduces a structurally different AC: A Day-In-The Life AC (DITLAC). A DITLAC structure is designed to mimic that of a normal day on the job. In the present study, the construct validity between a DITLAC and a traditionally structured AC is compared with the argument that the DITLAC will demonstrate stronger construct validity evidence. In several cases, this was found to be true.
Title: | Assessment Center Structure and Construct Validity: A New Hope. |
25 views
13 downloads |
---|---|---|
Name(s): |
Wiese, Christopher, Author Jentsch, Kimberly, Committee Chair Salas, Eduardo, Committee Member Jentsch, Florian, Committee Member Burke, Shawn, Committee Member University of Central Florida, Degree Grantor |
|
Type of Resource: | text | |
Date Issued: | 2015 | |
Publisher: | University of Central Florida | |
Language(s): | English | |
Abstract/Description: | Assessment Centers (ACs) are a fantastic method to measure behavioral indicators of job performance in multiple diverse scenarios. Based upon a thorough job analysis, ACs have traditionally demonstrated very strong content and criterion-related validity. However, researchers have been puzzled for over three decades with the lack of evidence concerning construct validity. ACs are designed to measure critical job dimensions throughout multiple situational exercises. However, research has consistently revealed that different behavioral ratings within these scenarios are more strongly related to one another (exercise effects) than the same dimension rating across scenarios (dimension effects). That is, results from ACs suggest that we are unsure of what these behavioral measures represent. Over the last three decades, researchers have sought to illuminate why same dimension ratings are inconsistent across scenarios. However, these investigations have been limited to changes influencing the source of the ratings (e.g., assessors, trained raters). No approach has been taken to change the structure of the AC. This study breaks with tradition and introduces a structurally different AC: A Day-In-The Life AC (DITLAC). A DITLAC structure is designed to mimic that of a normal day on the job. In the present study, the construct validity between a DITLAC and a traditionally structured AC is compared with the argument that the DITLAC will demonstrate stronger construct validity evidence. In several cases, this was found to be true. | |
Identifier: | CFE0005905 (IID), ucf:50878 (fedora) | |
Note(s): |
2015-08-01 Ph.D. Sciences, Psychology Doctoral This record was generated from author submitted information. |
|
Subject(s): | Assessment Centers -- Construct Validity -- day in the life -- day in a life -- exercise effects -- dimension effects -- AC -- nomological network | |
Persistent Link to This Record: | http://purl.flvc.org/ucf/fd/CFE0005905 | |
Restrictions on Access: | public 2015-08-15 | |
Host Institution: | UCF |