A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability
- PMID: 12926514
- DOI: 10.1080/00221300309601160
A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability
Abstract
The author presented descriptive statistics for 937 reliability coefficients for various reliability methods (e.g., alpha) and test types (e.g., intelligence). He compared the average reliability coefficients with the reliability standards that are suggested by experts and found that most average reliabilities were less than ideal. Correlations showed that over the past several decades there has been neither a rise nor a decline in the value of internal consistency, retest, or interjudge reliability coefficients. Of the internal consistency approaches, there has been an increase in the use of coefficient alpha, whereas use of the split-half method has decreased over time. Decision analysis and true-score confidence intervals showed how low reliability can result in clinical decision errors.
Similar articles
-
Study samples are too small to produce sufficiently precise reliability coefficients.J Gen Psychol. 2003 Apr;130(2):117-29. doi: 10.1080/00221300309601280. J Gen Psychol. 2003. PMID: 12773016
-
[Determination of reliability of psychometric tests in psychiatry using canonical correlation].Psychiatr Prax. 2003 May;30 Suppl 2:S157-60. Psychiatr Prax. 2003. PMID: 14509065 German.
-
Statistical approaches to achieving sufficiently high test score reliabilities for research purposes.J Gen Psychol. 2008 Jul;135(3):241-51. doi: 10.3200/GENP.135.3.241-251. J Gen Psychol. 2008. PMID: 18649491
-
WAIS-III reliability data for clinical groups.J Int Neuropsychol Soc. 2001 Nov;7(7):862-6. J Int Neuropsychol Soc. 2001. PMID: 11771629
-
Use of internal consistency coefficients for estimating reliability of experimental task scores.Psychon Bull Rev. 2016 Jun;23(3):750-63. doi: 10.3758/s13423-015-0968-3. Psychon Bull Rev. 2016. PMID: 26546100 Free PMC article. Review.
Cited by
-
Problematic Social Network Use: Structure and Assessment.Int J Ment Health Addict. 2021 Dec 2:1-16. doi: 10.1007/s11469-021-00711-y. Online ahead of print. Int J Ment Health Addict. 2021. PMID: 34876890 Free PMC article.
-
A psychometric evaluation of Chinese chronic hepatitis B virus infection-related stigma scale using classical test theory and item response theory.Front Psychol. 2023 Feb 1;14:1035071. doi: 10.3389/fpsyg.2023.1035071. eCollection 2023. Front Psychol. 2023. PMID: 36818123 Free PMC article.
-
Leiden Index of Depression Sensitivity-Revised (LEIDS-R): Spanish validation proposal.Int J Clin Health Psychol. 2017 May-Aug;17(2):139-150. doi: 10.1016/j.ijchp.2017.02.001. Epub 2017 Mar 19. Int J Clin Health Psychol. 2017. PMID: 30487889 Free PMC article.
-
Development and Psychometric Properties of the Questionnaire for Assessing Educational Podcasts (QAEP).Front Psychol. 2020 Nov 23;11:579454. doi: 10.3389/fpsyg.2020.579454. eCollection 2020. Front Psychol. 2020. PMID: 33329233 Free PMC article.
-
Application of the Delphi Method for Content Validity Analysis of a Questionnaire to Determine the Risk Factors of the Chemsex.Healthcare (Basel). 2023 Nov 5;11(21):2905. doi: 10.3390/healthcare11212905. Healthcare (Basel). 2023. PMID: 37958049 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous