Using a depression-scale item to measure loneliness: low validity and tautological inflation of the loneliness–depression association
DOI:
https://doi.org/10.62051/zw54f193Keywords:
loneliness; depressive symptoms; CES-D; measurement validity; criterion contamination.Abstract
In several large ageing cohorts, loneliness is measured with the single "felt lonely" item of the Center for Epidemiologic Studies Depression (CES-D) scale, while the CES-D total score serves as the depression outcome, so that one item stands on both sides of the association. Using the 2018 wave of the Health and Retirement Study (HRS) leave-behind subsample (N = 5,083, survey-weighted, Rao–Wu rescaled cluster bootstrap with 1,000 replicates), two properties of this practice were quantified in the same respondents. The adjusted coefficient of the item was 3.2408 against the eight-item CES-D and 2.2408 against the same scale with the item removed; the difference was 1.0000 in every bootstrap replicate, an algebraic consequence of the item being one of the components of the total. In the main specification this definitional component accounts for 30.9% (95% confidence interval 29.3–33.0) of the contaminated coefficient, and for between 27.6% and 30.9% across twelve alternative specifications. Against the three-item University of California, Los Angeles (UCLA) loneliness scale the item had a sensitivity of 37.7% and a kappa of 0.363, missing 62.3% of respondents classified as lonely; this criterion-validity comparison independently replicates and extends the validation reported by Yu et al. (2025) in the same cohort. In a mediation specification the proportion mediated was 1.33 times its value under the clean specification, with an interval of 0.63–2.29 that includes unity. The item is neither an adequate measure of loneliness nor independent of the outcome it is used to predict.
Downloads
References
[1] Wen Z, Wang H, Liang Q, Liu L, Zhang W, Zhang X. Mediating effect of social support and resilience between loneliness and depression in older adults: A systematic review and meta-analytic structural equation modeling. Journal of Affective Disorders, 2024, 365: 246-257. DOI: https://doi.org/10.1016/j.jad.2024.08.062
[2] Radloff LS. The CES-D Scale: A Self-Report Depression Scale for Research in the General Population. Applied Psychological Measurement, 1977, 1(3): 385-401. DOI: https://doi.org/10.1177/014662167700100306
[3] Turvey CL, Wallace RB, Herzog R. A Revised CES-D Measure of Depressive Symptoms and a DSM-Based Measure of Major Depressive Episodes in the Elderly. International Psychogeriatrics, 1999, 11(2): 139-148. DOI: https://doi.org/10.1017/S1041610299005694
[4] Yu X, Zahodne LB, Gross AL, Needham BL, Langa KM, Cho T, et al. Could differential underreporting of loneliness between men and women bias the gender-specific association between loneliness duration and rate of memory decline? A probabilistic bias analysis of effect modification. American Journal of Epidemiology, 2025, 194(3): 811-819. DOI: https://doi.org/10.1093/aje/kwae186
[5] Fokkema T, Gierveld JDJ, Dykstra PA. Cross-National Differences in Older Adult Loneliness. The Journal of Psychology, 2012, 146(1-2): 201-228. DOI: https://doi.org/10.1080/00223980.2011.631612
[6] Chamberlain SA, Griffith LE, Savage RD, Batara J, Yan W, Gruneir A. Single-item versus scale: Comparing respondent demographic, social, and health characteristics by measure of loneliness using the Canadian Longitudinal Study on Aging (CLSA) data. PLOS One, 2026, 21(2): e0341572. DOI: https://doi.org/10.1371/journal.pone.0341572
[7] Sha S, Pan Y, Xu Y, Chen L. Associations between loneliness and frailty among older adults: Evidence from the China Health and Retirement Longitudinal Study. BMC Geriatrics, 2022, 22(1): 537. DOI: https://doi.org/10.1186/s12877-022-03044-0
[8] Pincus T, Hassett AL, Callahan LF. Criterion Contamination of Depression Scales in Patients with Rheumatoid Arthritis: The Need for Interpretation of Patient Questionnaires (as All Clinical Measures) in the Context of All Information About the Patient. Rheumatic Disease Clinics of North America, 2009, 35(4): 861-864. DOI: https://doi.org/10.1016/j.rdc.2009.10.015
[9] Lee SL, Pearce E, Ajnakina O, Johnson S, Lewis G, Mann F, et al. The association between loneliness and depressive symptoms among adults aged 50 years and older: a 12-year population-based cohort study. The Lancet Psychiatry, 2021, 8(1): 48-57. DOI: https://doi.org/10.1016/S2215-0366(20)30383-7
[10] Salinas J, Beiser AS, Samra JK, O'Donnell A, DeCarli CS, Gonzales MM, et al. Association of Loneliness With 10-Year Dementia Risk and Early Markers of Vulnerability for Neurocognitive Decline. Neurology, 2022, 98(13): e1337-e1348. DOI: https://doi.org/10.1212/WNL.0000000000200039
[11] Hughes ME, Waite LJ, Hawkley LC, Cacioppo JT. A Short Scale for Measuring Loneliness in Large Surveys: Results From Two Population-Based Studies. Research on Aging, 2004, 26(6): 655-672. DOI: https://doi.org/10.1177/0164027504268574
[12] Sonnega A, Faul JD, Ofstedal MB, Langa KM, Phillips JW, Weir DR. Cohort Profile: the Health and Retirement Study (HRS). International Journal of Epidemiology, 2014, 43(2): 576-585. DOI: https://doi.org/10.1093/ije/dyu067
[13] Newmyer L, Verdery AM, Margolis R, Pessin L. Measuring Older Adult Loneliness Across Countries. The Journals of Gerontology: Series B, 2021, 76(7): 1408-1414. DOI: https://doi.org/10.1093/geronb/gbaa109
[14] Maxwell SE, Cole DA. Bias in cross-sectional analyses of longitudinal mediation. Psychological Methods, 2007, 12(1): 23-44. DOI: https://doi.org/10.1037/1082-989X.12.1.23
[15] Health and Retirement Study, (RAND HRS Longitudinal File 2022 (V1)) public use dataset. Produced and distributed by the University of Michigan with funding from the National Institute on Aging (grant number NIA U01AG009740). Ann Arbor, MI, (2025).
[16] RAND HRS Longitudinal File 2022 (V1). Produced by the RAND Center for the Study of Aging, with funding from the National Institute on Aging (grant numbers NIA U01AG009740 and NIA R01AG073289) and the Social Security Administration. Santa Monica, CA (May 2025).
[17] Health and Retirement Study, (2018 HRS Core (Final V2.0)) public use dataset. Produced and distributed by the University of Michigan with funding from the National Institute on Aging (grant number NIA U01AG009740). Ann Arbor, MI, (2022).
[18] Health and Retirement Study, (Cross-Wave Tracker File (Final 2022 V1.0)) public use dataset. Produced and distributed by the University of Michigan with funding from the National Institute on Aging (grant number NIA U01AG009740). Ann Arbor, MI, (2025).
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Transactions on Materials, Biotechnology and Life Sciences

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.






