A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability
- PMID: 12926514
- DOI: 10.1080/00221300309601160
A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability
Abstract
The author presented descriptive statistics for 937 reliability coefficients for various reliability methods (e.g., alpha) and test types (e.g., intelligence). He compared the average reliability coefficients with the reliability standards that are suggested by experts and found that most average reliabilities were less than ideal. Correlations showed that over the past several decades there has been neither a rise nor a decline in the value of internal consistency, retest, or interjudge reliability coefficients. Of the internal consistency approaches, there has been an increase in the use of coefficient alpha, whereas use of the split-half method has decreased over time. Decision analysis and true-score confidence intervals showed how low reliability can result in clinical decision errors.
Similar articles
-
Study samples are too small to produce sufficiently precise reliability coefficients.J Gen Psychol. 2003 Apr;130(2):117-29. doi: 10.1080/00221300309601280. J Gen Psychol. 2003. PMID: 12773016
-
[Determination of reliability of psychometric tests in psychiatry using canonical correlation].Psychiatr Prax. 2003 May;30 Suppl 2:S157-60. Psychiatr Prax. 2003. PMID: 14509065 German.
-
Statistical approaches to achieving sufficiently high test score reliabilities for research purposes.J Gen Psychol. 2008 Jul;135(3):241-51. doi: 10.3200/GENP.135.3.241-251. J Gen Psychol. 2008. PMID: 18649491
-
WAIS-III reliability data for clinical groups.J Int Neuropsychol Soc. 2001 Nov;7(7):862-6. J Int Neuropsychol Soc. 2001. PMID: 11771629
-
Use of internal consistency coefficients for estimating reliability of experimental task scores.Psychon Bull Rev. 2016 Jun;23(3):750-63. doi: 10.3758/s13423-015-0968-3. Psychon Bull Rev. 2016. PMID: 26546100 Free PMC article. Review.
Cited by
-
Problematic Social Network Use: Structure and Assessment.Int J Ment Health Addict. 2021 Dec 2:1-16. doi: 10.1007/s11469-021-00711-y. Online ahead of print. Int J Ment Health Addict. 2021. PMID: 34876890 Free PMC article.
-
Reliability, construct validity, and measurement invariance of the PROMIS Physical Function 8b-Adult Short Form v2.0.Qual Life Res. 2020 Dec;29(12):3397-3406. doi: 10.1007/s11136-020-02603-5. Epub 2020 Aug 18. Qual Life Res. 2020. PMID: 32812143 Free PMC article.
-
Content validity and perceived utility of a self-help online acceptance and commitment therapy program focused on repetitive negative thinking.J Contextual Behav Sci. 2022 Oct;26:1-10. doi: 10.1016/j.jcbs.2022.08.003. Epub 2022 Aug 17. J Contextual Behav Sci. 2022. PMID: 35990417 Free PMC article.
-
Exploratory Graph Analysis of the Strengths and Difficulties Questionnaire for Aboriginal and/or Torres Strait Islander Children.Front Psychol. 2021 Aug 18;12:573825. doi: 10.3389/fpsyg.2021.573825. eCollection 2021. Front Psychol. 2021. PMID: 34484017 Free PMC article.
-
The Reliability of the Wisconsin Card Sorting Test in Clinical Practice.Assessment. 2021 Jan;28(1):248-263. doi: 10.1177/1073191119866257. Epub 2019 Aug 2. Assessment. 2021. PMID: 31375035 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous