Literature DB >> 25953477

An Improved Correction for Range Restricted Correlations Under Extreme, Monotonic Quadratic Nonlinearity and Heteroscedasticity.

Steven Andrew Culpepper1.   

Abstract

Standardized tests are frequently used for selection decisions, and the validation of test scores remains an important area of research. This paper builds upon prior literature about the effect of nonlinearity and heteroscedasticity on the accuracy of standard formulas for correcting correlations in restricted samples. Existing formulas for direct range restriction require three assumptions: (1) the criterion variable is missing at random; (2) a linear relationship between independent and dependent variables; and (3) constant error variance or homoscedasticity. The results in this paper demonstrate that the standard approach for correcting restricted correlations is severely biased in cases of extreme monotone quadratic nonlinearity and heteroscedasticity. This paper offers at least three significant contributions to the existing literature. First, a method from the econometrics literature is adapted to provide more accurate estimates of unrestricted correlations. Second, derivations establish bounds on the degree of bias attributed to quadratic functions under the assumption of a monotonic relationship between test scores and criterion measurements. New results are presented on the bias associated with using the standard range restriction correction formula, and the results show that the standard correction formula yields estimates of unrestricted correlations that deviate by as much as 0.2 for high to moderate selectivity. Third, Monte Carlo simulation results demonstrate that the new procedure for correcting restricted correlations provides more accurate estimates in the presence of quadratic and heteroscedastic test score and criterion relationships.

Entities:  

Keywords:  college admissions; heteroscedasticity; nonlinearity; personnel selection; range restriction

Mesh:

Year:  2015        PMID: 25953477     DOI: 10.1007/s11336-015-9466-9

Source DB:  PubMed          Journal:  Psychometrika        ISSN: 0033-3123            Impact factor:   2.500


  12 in total

1.  Correction for range restriction: an expanded typology.

Authors:  P R Sackett; H Yang
Journal:  J Appl Psychol       Date:  2000-02

2.  Large-sample confidence intervals for validity and reliability coefficients.

Authors:  J L Mendoza; K L Stafford; J M Stauffer
Journal:  Psychol Methods       Date:  2000-09

3.  Using SAT-grade and ability-job performance relationships to test predictions derived from stereotype threat theory.

Authors:  Michael J Cullen; Chaitra M Hardison; Paul R Sackett
Journal:  J Appl Psychol       Date:  2004-04

4.  Too much of a good thing: curvilinear relationships between personality traits and job performance.

Authors:  Huy Le; In-Sue Oh; Steven B Robbins; Remus Ilies; Ed Holland; Paul Westrick
Journal:  J Appl Psychol       Date:  2011-01

5.  Studying Individual Differences in Predictability With Gamma Regression and Nonlinear Multilevel Models.

Authors:  Steven Andrew Culpepper
Journal:  Multivariate Behav Res       Date:  2010-01-29       Impact factor: 5.923

6.  Bayesian Interval Estimation of Multiple Correlations with Missing Data: A Gibbs Sampling Approach.

Authors:  A L Gross
Journal:  Multivariate Behav Res       Date:  2000-04-01       Impact factor: 5.923

7.  Implications of direct and indirect range restriction for meta-analysis methods and findings.

Authors:  John E Hunter; Frank L Schmidt; Huy Le
Journal:  J Appl Psychol       Date:  2006-05

8.  Ability-performance relationships in education and employment settings: critical tests of the more-is-better and the good-enough hypotheses.

Authors:  Justin J Arneson; Paul R Sackett; Adam S Beatty
Journal:  Psychol Sci       Date:  2011-09-19

9.  Revisiting Case IV: a reassessment of bias and standard errors of Case IV under range restriction.

Authors:  Dustin A Fife; Jorge L Mendoza; Robert Terry
Journal:  Br J Math Stat Psychol       Date:  2012-10-10       Impact factor: 3.380

10.  Bootstrap confidence intervals for the mean correlation corrected for Case IV range restriction: a more adequate procedure for meta-analysis.

Authors:  Johnson Ching-Hong Li; Ying Cui; Wai Chan
Journal:  J Appl Psychol       Date:  2012-10-22
View more
  1 in total

1.  Revisiting the 4-Parameter Item Response Model: Bayesian Estimation and Application.

Authors:  Steven Andrew Culpepper
Journal:  Psychometrika       Date:  2015-09-23       Impact factor: 2.500

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.