Examining Factor Structure of a Widely Used Measure of Psychiatric Symptoms in Collegiate Athletes
DOI:
https://doi.org/10.33043/24xzdzbbKeywords:
symptom checklist, athlete mental health, assessment, screen, confirmatory factor analysisAbstract
The Symptom Checklist 90 – Revised (SCL-90-R; Derogatis, 1994) is one of the most widely utilized measures of general psychiatric distress. However, its factor structure varies across populations, and psychometric properties of this scale have yet to be investigated in athletes. In this study several frequently reported factor structures of the SCL-90-R were examined in 311 collegiate athletes. None of the tested models were a good fit based on Confirmatory Factor Analysis (CFI) criteria, although the bi-factor model was reasonable using RMSEA (.06) and AIC (55951) criteria. Explained common variance of the global factor was 73%, reflecting a stronger general factor relative to specific construct factors. Indeed, several items did not significantly load on previously identified factors. Results suggest the SCL-90-R is a good tool to determine general symptom severity of mental health disorders in collegiate athletes.
Downloads
References
Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52(3), 371-386.
Appaneal, R. N., Levine, B. R., Perna, F. M., & Roh, J. L. (2009). Measuring postinjury
depression among male and female competitive athletes. Journal of Sport & Exercise
Psychology, 31(1), 60-76. https://doi.org/10.1123/jsep.31.1.60
Ardakani, A., Seghatoleslam, T., Habil, H., Jameei, F., Rashid, R., Zahirodin, A., ... & Arani, A.
M. (2016). Construct validity of symptom checklist-90-revised (SCL-90-R) and general
health questionnaire-28 (GHQ-28) in patients with drug addiction and diabetes, and
normal population. Iranian Journal of Public Health, 45(4), 451-459.
Arrindell, W. A., & Ettema, J. H. M. (2005). Symptom checklist: handleiding bij
multidimensionale psychopathologie-indicator [Symptom checklist: manual of the
multidimensional psychopathology indicator]. Amsterdam: Harcourt Test Publishers.
Arrindell, W. A., Barelds, D. P., Janssen, I. C., Buwalda, F. M., & van der Ende, J. (2006).
Invariance of SCL‐90‐R dimensions of symptom distress in patients with peri partum
pelvic pain (PPPP) syndrome. British Journal of Clinical Psychology, 45(3), 377-391.
https://doi.org/10.1348/014466505X68924
Bakhshaie, J., Sharifi, V., & Amini, J. (2011). Exploratory factor analysis of SCL90-R symptoms
relevant to psychosis. Iranian Journal of Psychiatry, 6(4), 128.
Bakhshalipour, V., Sareshkeh, S. K., Zivdar, Z., & Touba, N. (2016). The comparison of mental
health between male athlete and non-athlete students in Islamic Azad University
Branches of Guilan Province. Sport Scientific & Practical Aspects, 13(2), 25-29.
Barry, A. E., Howell, S. M., Riplinger, A., & Piazza-Gardner, A. K. (2015). Alcohol use among
college athletes: do intercollegiate, club, or intramural student athletes drink differently?.
Substance Use & Misuse, 50(3), 302-307. https://doi.org/10.3109/10826084.2014.977398
Beidler, E., Bretzin, A. C., Hanock, C., & Covassin, T. (2018). Sport-related concussion:
knowledge and reporting behaviors among collegiate club-sport athletes. Journal of Athletic Training, 53(9), 866-872. https://doi.org/10.4085/1062-6050-266-17
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin,
(2), 238-246. https://doi.org/10.1037/0033-2909.107.2.238
Bratland-Sanda, S., & Sundgot-Borgen, J. (2013). Eating disorders in athletes: overview of
prevalence, risk factors and recommendations for prevention and treatment. European Journal of Sport Science, 13(5), 499-508. https://doi.org/10.1080/17461391.2012.740504
Breslin, G., Haughey, T., O’Brien, W., Caulfield, L., Robertson, A., & Lawlor, M. (2018).
Increasing athlete knowledge of mental health and intentions to seek help: The State of Mind Ireland (SOMI) Pilot Program. Journal of Clinical Sport Psychology, 12(1), 39-56.
https://doi.org/10.1123/jcsp.2016-0039
Brown, G. T., Hainline, B., Kroshus, E., & Wilfert, M. (2014). Mind, body and sport:
Understanding and supporting student-athlete mental wellness. Indianapolis, IN: NCAA.
Browne, M. W., & Cudeck, R. (1992). Alternative Ways of Assessing Model Fit. Sociological
Methods & Research, 21(2), 230.
https://doiorg.ezproxy.library.unlv.edu/10.1177/0049124192021002005
Carless, D., & Douglas, K. (2013). “In the boat” but “selling myself short”: Stories, narratives,
and identity development in elite sport. The Sport Psychologist, 27(1), 27-39.
https://doi.org/10.1123/tsp.27.1.27
Castaldelli-Maia, J. M., e Gallinaro, J. G. D. M., Falcão, R. S., Gouttebarge, V., Hitchcock, M.
E., Hainline, B., ... & Stull, T. (2019). Mental health symptoms and disorders in elite athletes: A systematic review on cultural influencers and barriers to athletes seeking treatment. British Journal of Sports Medicine, 53(11), 707-721. http://dx.doi.org/10.1136/bjsports-2019-100710
Cyr, J. J., J. M. McKenna-Foley, & E. Peacock. (1985). Factor structure of the SCL-90-R: is
there one?. Journal of Personality Assessment, 49(6), 571-578.
https://doi.org/10.1207/s15327752jpa4906_2
Darcy, A. M., Hardy, K. K., Crosby, R. D., Lock, J., & Peebles, R. (2013). Factor structure of the
Eating Disorder Examination Questionnaire (EDE-Q) in male and female college athletes. Body Image, 10(3), 399-405. https://doi.org/10.1016/j.bodyim.2013.01.008
Davis, C., & Strachan, S. (2001). Elite female athletes with eating disorders: A study of
psychopathological characteristics. Journal of Sport & Exercice Psychology, 23(3), 245-253. https://doi.org/10.1123/jsep.23.3.245
Derogatis, L. R. (1994). SCL-90-R: symptom checklist-90-R: Administration, scoring &
procedures manual (3rd ed.). Minneapolis, MN: National Computer Systems, Inc.
Derogatis, L. R., & Cleary, P. A. (1977). Confirmation of the dimensional structure of the SCL
: A study in construct validation. Journal of Clinical Psychology, 33(4), 981-989.
https://doi.org/10.1002/1097-4679(197710)33:4<981::AID-JCLP2270330412>3.0.CO;2-0
Despres, J., Brady, F., & McGowan, A. S. (2008). Understanding the Culture of the Student
Athlete: Implications for College Counselors. The Journal of Humanistic Counseling, Education & Development, 47(2), 200-211. https://doi.org/10.1002/j.2161-1939.2008.tb00058.x
DiBartolo, P. M., & Shaffer, C. (2002). A comparison of female college athletes and nonathletes:
Eating disorder symptomatology and psychological well-being. Journal of Sport & Exercise Psychology, 24(1), 33-41. https://doi.org/10.1123/jsep.24.1.33
Donohue, B., Covassin, T., Lancer, K., Dickens, Y., Miller, A., Hash, A., & Genet, J. (2004).
Examination of psychiatric symptoms in student athletes. The Journal of General Psychology, 131(1), 29-35. https://doi.org/10.3200/GENP.131.1.29-35
Donohue, B., Gavrilova, Y., Galante, M., Burnstein, B., Aubertin, P., Gavrilova, E., ... &
Benning, S. D. (2020). Empirical development of a screening method for mental, social, and physical wellness in amateur and professional circus artists. Psychology of Aesthetics, Creativity, & the Arts, 14(3), 313. https://doi.org/10.1037/aca0000199
Donohue, B., Scott, J., Goodwin, G., Barchard, K.A., Bohall, G, & Allen, D.N. (2023). Initial
examination of the Mental Health Disorders Screening Instrument for Athletes. Frontiers
Psychology, 14.
Donohue, B., Silver, N. C., Dickens, Y., Covassin, T., & Lancer, K. (2007). Development and
initial psychometric evaluation of the sport interference checklist. Behavior Modification,
(6), 937-957. https://doi.org/10.1177/0145445507303827
Driller, M. W., Dixon, Z. T., & Clark, M. I. (2017). Accelerometer-based sleep behavior and
activity levels in student athletes in comparison to student non-athletes. Sport Sciences for Health, 13(2), 411-418. https://doi.org/10.1007/s11332-017-0373-6
Dugan, J. P., Torrez, M. A., & Turman, N. T. (2014). Leadership in intramural sports and club
sports: Examining influences to enhance educational impact. Corvallis, OR: NIRSA.
Foster, B. J., & Chow, G. M. (2019). Development of the Sport Mental Health Continuum
Short Form (Sport MHC-SF). Journal of Clinical Sport Psychology, 13(4), 593-608.
https://doi.org/10.1123/jcsp.2017-0057
Giannone, Z. A., Haney, C. J., Kealy, D., & Ogrodniczuk, J. S. (2017). Athletic identity and
psychiatric symptoms following retirement from varsity sports. International Journal of Social Psychiatry, 63(7), 598-601. https://doi.org/10.1177/0020764017724184
Gomes, A. R., Martins, C., & Silva, L. (2011). Eating disordered behaviors in Portuguese
athletes: The influence of personal, sport, and psychological variables. European Eating
Disorders Review, 19(3), 190-200. https://doi.org/10.1002/erv.1113
Holcomb, W. R., Adams, N. A., & Ponder, H. M. (1983). Factor structure of the Symptom
Checklist-90 with acute psychiatric inpatients. Journal of Consulting & Clinical Psychology, 51(4), 535. https://doi.org/10.1037/0022-006X.51.4.535
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis:
Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Hughes, L., & Leavey, G. (2012). Setting the bar: athletes and vulnerability to mental illness.
The British Journal of Psychiatry, 200(2), 95-96. https://doi.org/10.1192/bjp.bp.111.095976
Hurley, A. E., Scandura, T. A., Schriesheim, C. A., Brannick, M. T., Seers, A., Vandenberg, R.
J., & Williams, L. J. (1997). Exploratory and confirmatory factor analysis: Guidelines, issues, and alternatives. Journal of Organizational Behavior, 18(6), 667-683.
https://doi-org.ezproxy.library.unlv.edu/10.1002/(SICI)1099-1379(199711)18:6<667:AIDJOB874>3.0.CO;2-T
Kimball, A., & Freysinger, V. J. (2003). Leisure, stress, and coping: The sport participation of
collegiate student-athletes. Leisure Sciences, 25(2-3), 115-141.
https://doi.org/10.1080/01490400306569
Kline, R. B. (2015). Principles and practice of structural equation modeling (Methodology in the
social sciences). The Guilford Press.
Kunst, L. E., Maas, J., van Balkom, A. J., van Assen, M. A., Kouwenhoven, B., & Bekker, M. H.
(2021). Group autonomy enhancing treatment versus cognitive behavioral therapy for anxiety disorders: A cluster‐randomized clinical trial. Depression & Anxiety, 1– 13.
https://doi.org/10.1002/da.23231
Lifschutz, L. (2012). Club sports: Maximizing positive outcomes and minimizing risks.
Recreational Sports Journal, 36(2), 104-112. https://doi.org/10.1123/rsj.36.2.104
Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications.
Biometrika, 57(3), 519-530. https://doi.org/10.1093/biomet/57.3.519
Martin, R. J., Nelson, S. E., & Gallucci, A. R. (2016). Game on: Past year gambling, gambling
related problems, and fantasy sports gambling among college athletes and non-athletes.
Journal of Gambling Studies, 32(2), 567-579. https://doi.org/10.1007/s10899-015-9561-y
Martinsen, M., Bahr, R., Børresen, R. U. N. I., Holme, I., Pensgaard, A. M., & Sundgot-Borgen,
J. (2014). Preventing eating disorders among young elite athletes: a randomized
controlled trial. Medicine & Science in Sports & Exercise, 46(3), 435-447.
https://doi-org.ezproxy.library.unlv.edu/10.1249/MSS.0b013e3182a702fc
Marzell, M., Morrison, C., Mair, C., Moynihan, S., & Gruenewald, P. J. (2015). Examining
drinking patterns and high-risk drinking environments among college athletes at different
competition levels. Journal of Drug Education, 45(1), 5-16.
https://doi.org/10.1177/0047237915575281
National Collegiate Athletics Association [NCAA]. (2009). Defining Countable Athletically
Related Activities. http://www.ncaa.org/sites/default/files/Charts.pdf
National Collegiate Athletics Association [NCAA]. (2019). 1981-82 – 2018-19 NCAA sports
sponsorship and participation rates report.
https://ncaaorg.s3.amazonaws.com/research/sportpart/2018-
RES_SportsSponsorshipParticipationRatesReport.pdf
National Collegiate Athletics Association [NCAA]. (2020). Summary of NCAA Eligibility
Regulations − NCAA Division I. https://ncaaorg.s3.amazonaws.com/compliance/d1/2020
D1Comp_SummaryofNCAARegulations.pdf
National Intramural-Recreational Sports Association [NIRSA]. (2016). Player Eligibility
Requirements. http://play.nirsa.net/nirsa-championship-series/player-eligibility
requirements/
National Intramural-Recreational Sports Association [NIRSA]. (n.d.). Intramural Sport Rules.
https://nirsa.net/nirsa/sport-rules/
Nicolas, M., Martinent, G., & Campo, M. (2014). Evaluation of the psychometric properties of a
modified Positive and Negative Affect Schedule including a direction scale (PANAS-D)
among French athletes. Psychology of Sport & Exercise, 15(3), 227-237.
https://doi.org/10.1016/j.psychsport.2014.01.005
Olsen, L. R., Mortensen, E. L., & Bech, P. (2004). The SCL‐90 and SCL‐90R versions validated
by item response models in a Danish community sample. Acta Psychiatrica
Scandinavica, 110(3), 225-229. https://doi.org/10.1111/j.1600-0447.2004.00399.x
Patel, D. R., Omar, H., & Terry, M. (2010). Sport-related performance anxiety in young female
athletes. Journal of Pediatric & Adolescent Gynecology, 23(6), 325-335.
https://doi.org/10.1016/j.jpag.2010.04.004
Pennington, B. (2008). Rapid rise of college club teams creates a whole new level of success.
New York Times, p. B11. https://search-proquest-
com.ezproxy.library.unlv.edu/docview/897158959?rfr_id=info%3Axri%2Fsid%3Aprimo
Primack, B. A., Fertman, C. I., Rice, K. R., Adachi-Mejia, A. M., & Fine, M. J. (2010).
Waterpipe and cigarette smoking among college athletes in the United States. Journal of
Adolescent Health, 46(1), 45-51. https://doi.org/10.1016/j.jadohealth.2009.05.004
Proctor, S. L., & Boan-Lenzo, C. (2010). Prevalence of depressive symptoms in male
intercollegiate student-athletes and nonathletes. Journal of Clinical Sport Psychology, 4(3), 204-220. https://doi.org/10.1123/jcsp.4.3.204
Reinking, M. F., & Alexander, L. E. (2005). Prevalence of disordered-eating behaviors in
undergraduate female collegiate athletes and nonathletes. Journal of Athletic Training, 40(1), 47-51.
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral
Research, 47(5), 667-696. https://doi.org/10.1080/00273171.2012.715555
Rescorla, L. A., & Achenbach, T. M. (2004). The Achenbach System of Empirically Based
Assessment (ASEBA) for Ages 18 to 90 Years. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment: Instruments for adults (pp. 115–152). Lawrence Erlbaum Associates Publishers.
Rice, S. M., Purcell, R., De Silva, S., Mawren, D., McGorry, P. D., & Parker, A. G. (2016). The
mental health of elite athletes: a narrative systematic review. Sports Medicine, 46(9), 1333-1353. https://doi.org/10.1007/s40279-016-0492-2
Ronan, G. F., Dreer, L. E., & Dollard, K. M. (2000). Measuring patient symptom change on rural
psychiatry units: utility of the symptom checklist-90 revised. The Journal of Clinical Psychiatry, 61(7), 493-497. https://doi.org/10.4088/jcp.v61n0706
Rössler, W., Riecher-Rössler, A., Angst, J., Murray, R., Gamma, A., Eich, D., ... & Gross, V. A.
(2007). Psychotic experiences in the general population: a twenty-year prospective community study. Schizophrenia Research, 92(1-3), 1-14. https://doi.org/10.1016/j.schres.2007.01.002
Ruis, C., van den Berg, E., van Stralen, H. E., Huenges Wajer, I. M., Biessels, G. J., Kappelle, L.
J., ... & van Zandvoort, M. J. (2014). Symptom Checklist 90–Revised in neurological
outpatients. Journal of Clinical & Experimental Neuropsychology, 36(2), 170-177.
https://doi.org/10.1080/13803395.2013.875519
Schmitz, N., Hartkamp, N., & Franke, G. H. (2000). Assessing clinically significant change:
Application to the SCL-90–R. Psychological Reports, 86(1), 263-274.
https://doi.org/10.2466/pr0.2000.86.1.263
Schmitz, N., Kruse, J., Heckrath, C., Alberti, L., & Tress, W. (1999). Diagnosing mental
disorders in primary care: the General Health Questionnaire (GHQ) and the Symptom Check List
(SCL-90-R) as screening instruments. Social Psychiatry & Psychiatric Epidemiology, 34(7),
-366. https://doi.org/10.1007/s001270050156
Smits, I. A., Timmerman, M. E., Barelds, D. P., & Meijer, R. R. (2014). The Dutch symptom
checklist-90-revised: Is the use of the subscales justified? European Journal of Psychological Assessment, 31(4), 263–271.
https://doi-org.ezproxy.library.unlv.edu/10.1027/1015-5759/a000233
Somasundaram, P., & Burgess, A. M. (2018). The role of division iii sports participation in the
relationship between perfectionism and disordered eating symptomology. Journal of Clinical Sport Psychology, 12, 57-74. https://doi.org/10.1123/jcsp.2017-0013
Steiger, J. H. (1980). Statistically based tests for the number of common factors. In the annual
meeting of the Psychometric Society. Iowa City, IA.
Stewart, R. E. (1992). A brief history of the intramural movement. Recreational Sports Journal,
(1), 12-14.
Storch, E. A., Storch, J. B., Killiany, E. M., & Roberti, J. W. (2005). Self-reported
psychopathology in athletes: a comparison of intercollegiate student-athletes and non-athletes. Journal of Sport Behavior, 28(1), 86-97.
Sundgot-Borgen, J., Torstveit, M. K., & Skårderud, F. (2004). Eating disorders among athletes.
Tidsskrift for den Norske laegeforening: tidsskrift for praktisk medicin, ny raekke, 124(16), 2126-2129.
Swann, C., Moran, A., & Piggott, D. (2015). Defining elite athletes: Issues in the study of expert
performance in sport psychology. Psychology of Sport & Exercise, 16, 3-14.
https://doi.org/10.1016/j.psychsport.2014.07.004
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA:
Allyn and Bacon.
Tahtinen, R. E., & Kristjansdottir, H. (2018). The influence of anxiety and depression symptoms
on help-seeking intentions in individual sport athletes and non-athletes: the role of gender and athlete status. Journal of Clinical Sport Psychology, 13(1), 134-151.
https://doi.org/10.1123/jcsp.2017-0028
The National Federation of State High School Associations. (2019). 2018-19 High School
Athletics Participation Survey. https://www.nfhs.org/media/1020412/2018
_participation_survey.pdf
Urbán, R., Arrindell, W. A., Demetrovics, Z., Unoka, Z., & Timman, R. (2016). Cross-cultural
confirmation of bi-factor models of a symptom distress measure: Symptom Checklist-90-Revised in clinical samples. Psychiatry Research, 239, 265-274.
https://doi.org/10.1016/j.psychres.2016.03.039
van de Grift, T. C., Elaut, E., Cerwenka, S. C., Cohen-Kettenis, P. T., & Kreukels, B. P. (2018).
Surgical satisfaction, quality of life, and their association after gender-affirming surgery: a follow-up study. Journal of Sex & Marital Therapy, 44(2), 138-148.
https://doi.org/10.1080/0092623X.2017.1326190
Watson, J. C. (2006). Student-athletes and counseling: Factors influencing the decision to seek
counseling services. College Student Journal, 40(1), 35-42.
Wilson, M. (2016). Differences in Depression, Anxiety, and Life Satisfaction between
Intercollegiate Athletes, Intramural Participants, and Non-Athletes. Masters Theses & Specialist Projects. Paper 1739. http://digitalcommons.wku.edu/theses/1739
Wolanin, A., Gross, M., & Hong, E. (2015). Depression in athletes: prevalence and risk factors.
Current Sports Medicine Reports, 14(1), 56-60. https://doi.org/10.1249/JSR.0000000000000123
Yusko, D. A., Buckman, J. F., White, H. R., & Pandina, R. J. (2008). Alcohol, tobacco, illicit
drugs, and performance enhancers: A comparison of use by college student athletes and
nonathletes. Journal of American College Health, 57(3), 281-290.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Elena Gavrilova, Bradley Donohue, Daniel N. Allen, Kimberly Barchard
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
