Current Search: situational judgment tests (x)
-
-
Title
-
THE CONSTRUCT VALIDITY OF A SITUATIONAL JUDGMENT TEST IN A MAXIMUM PERFORMANCE CONTEXT.
-
Creator
-
Stagl, Kevin, Salas, Eduardo, University of Central Florida
-
Abstract / Description
-
A Predictor Response Process model (see Ployhart, 2006) and research findings were leveraged to formulate research questions about, and generate construct validity evidence for, a new situational judgment test (SJT) designed to measure declarative and strategic knowledge. The first question asked if SJT response instructions (i.e., 'Should Do', 'Would Do') moderated the validity of an SJT in a maximum performance context. The second question asked what the upper-bound...
Show moreA Predictor Response Process model (see Ployhart, 2006) and research findings were leveraged to formulate research questions about, and generate construct validity evidence for, a new situational judgment test (SJT) designed to measure declarative and strategic knowledge. The first question asked if SJT response instructions (i.e., 'Should Do', 'Would Do') moderated the validity of an SJT in a maximum performance context. The second question asked what the upper-bound criterion-related validity coefficient is for SJTs in talent selection contexts in which typical performance is the criterion of interest. The third question asked whether the SJT used in the present study was fair for gender and ethnic-based subgroups according to Cleary's (1968) definition of test fairness. Participants were randomly assigned to complete an SJT with either 'Should Do' or 'Would Do' response instructions and their maximum decision making performance outcomes were captured during a moderate fidelity poker simulation. The findings of this study suggested knowledge, as measured by the SJT, interacted with response instructions when predicting aggregate and average performance outcomes such that the 'Should Do' SJT had stronger criterion-related validity coefficients than the 'Would Do' version. The findings also suggested the uncorrected upper-bound criterion-related validity coefficient for SJTs in selection contexts is at least moderate to strong (β = .478). Moreover, the SJT was fair according to Cleary's definition of test fairness. The implications of these findings are discussed.
Show less
-
Date Issued
-
2006
-
Identifier
-
CFE0001309, ucf:47020
-
Format
-
Document (PDF)
-
PURL
-
http://purl.flvc.org/ucf/fd/CFE0001309
-
-
Title
-
HOW DO SITUATIONAL JUDGMENT TESTS AND SITUATIONAL INTERVIEWS COMPARE? AN EXAMINATION OF CONSTRUCT AND CRITERION-RELATED VALIDITY.
-
Creator
-
Gunter, James, Fritzsche, Barbara, University of Central Florida
-
Abstract / Description
-
This study replicated and extended an earlier study by Banki and Latham (2010) and developed an equivalent SJT and SI in order to examine whether the two methods correlated differently with cognitive ability, personality, job experience, and job performance. The results of this study showed that the SJT and SI only correlated .20 and that the correlations for the SI with Extraversion, customer service experience, and overall work experience were significantly different from the correlations...
Show moreThis study replicated and extended an earlier study by Banki and Latham (2010) and developed an equivalent SJT and SI in order to examine whether the two methods correlated differently with cognitive ability, personality, job experience, and job performance. The results of this study showed that the SJT and SI only correlated .20 and that the correlations for the SI with Extraversion, customer service experience, and overall work experience were significantly different from the correlations for the SJT. Participants felt that the SJT and SI provided the same opportunity to perform oneÂÂ's skills and level of scoring consistency. However, participants felt significantly more anxiety during the SI than the SJT. The practical and theoretical implications of these findings are discussed.
Show less
-
Date Issued
-
2010
-
Identifier
-
CFE0003522, ucf:48941
-
Format
-
Document (PDF)
-
PURL
-
http://purl.flvc.org/ucf/fd/CFE0003522
