Examining Factor Structure of a Widely Used Measure of Psychiatric Symptoms in Collegiate Athletes
DOI:
https://doi.org/10.33043/24xzdzbbKeywords:
symptom checklist, athlete mental health, assessment, screen, confirmatory factor analysisAbstract
The Symptom Checklist 90 – Revised (SCL-90-R; Derogatis, 1994) is one of the most widely utilized measures of general psychiatric distress. However, its factor structure varies across populations, and psychometric properties of this scale have yet to be investigated in athletes. In this study several frequently reported factor structures of the SCL-90-R were examined in 311 collegiate athletes. None of the tested models were a good fit based on Confirmatory Factor Analysis (CFI) criteria, although the bi-factor model was reasonable using RMSEA (.06) and AIC (55951) criteria. Explained common variance of the global factor was 73%, reflecting a stronger general factor relative to specific construct factors. Indeed, several items did not significantly load on previously identified factors. Results suggest the SCL-90-R is a good tool to determine general symptom severity of mental health disorders in collegiate athletes.
Downloads
References
Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52(3), 371-386.
Appaneal, R. N., Levine, B. R., Perna, F. M., & Roh, J. L. (2009). Measuring postinjury depression among male and female competitive athletes. Journal of Sport & Exercise Psychology, 31(1), 60-76. https://doi.org/10.1123/jsep.31.1.60
Ardakani, A., Seghatoleslam, T., Habil, H., Jameei, F., Rashid, R., Zahirodin, A., ... & Arani, A.M. (2016). Construct validity of symptom checklist-90-revised (SCL-90-R) and general health questionnaire-28 (GHQ-28) in patients with drug addiction and diabetes, and normal population. Iranian Journal of Public Health, 45(4), 451-459.
Arrindell, W. A., & Ettema, J. H. M. (2005). Symptom checklist: handleiding bij multidimensionale psychopathologie-indicator [Symptom checklist: manual of the multidimensional psychopathology indicator]. Amsterdam: Harcourt Test Publishers.
Arrindell, W. A., Barelds, D. P., Janssen, I. C., Buwalda, F. M., & van der Ende, J. (2006). Invariance of SCL‐90‐R dimensions of symptom distress in patients with peri partum pelvic pain (PPPP) syndrome. British Journal of Clinical Psychology, 45(3), 377-391.https://doi.org/10.1348/014466505X68924
Bakhshaie, J., Sharifi, V., & Amini, J. (2011). Exploratory factor analysis of SCL90-R symptoms relevant to psychosis. Iranian Journal of Psychiatry, 6(4), 128.
Bakhshalipour, V., Sareshkeh, S. K., Zivdar, Z., & Touba, N. (2016). The comparison of mental health between male athlete and non-athlete students in Islamic Azad University Branches of Guilan Province. Sport Scientific & Practical Aspects, 13(2), 25-29.
Barry, A. E., Howell, S. M., Riplinger, A., & Piazza-Gardner, A. K. (2015). Alcohol use among college athletes: do intercollegiate, club, or intramural student athletes drink differently?. Substance Use & Misuse, 50(3), 302-307. https://doi.org/10.3109/10826084.2014.977398
Beidler, E., Bretzin, A. C., Hanock, C., & Covassin, T. (2018). Sport-related concussion: knowledge and reporting behaviors among collegiate club-sport athletes. Journal of Athletic Training, 53(9), 866-872. https://doi.org/10.4085/1062-6050-266-17
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238-246. https://doi.org/10.1037/0033-2909.107.2.238
Bratland-Sanda, S., & Sundgot-Borgen, J. (2013). Eating disorders in athletes: overview of prevalence, risk factors and recommendations for prevention and treatment. European Journal of Sport Science, 13(5), 499-508. https://doi.org/10.1080/17461391.2012.740504
Breslin, G., Haughey, T., O’Brien, W., Caulfield, L., Robertson, A., & Lawlor, M. (2018). Increasing athlete knowledge of mental health and intentions to seek help: The State of Mind Ireland (SOMI) Pilot Program. Journal of Clinical Sport Psychology, 12(1), 39-56. https://doi.org/10.1123/jcsp.2016-0039
Brown, G. T., Hainline, B., Kroshus, E., & Wilfert, M. (2014). Mind, body and sport: Understanding and supporting student-athlete mental wellness. Indianapolis, IN: NCAA.
Browne, M. W., & Cudeck, R. (1992). Alternative Ways of Assessing Model Fit. Sociological Methods & Research, 21(2), 230. https://doiorg.ezproxy.library.unlv.edu/10.1177/0049124192021002005
Carless, D., & Douglas, K. (2013). “In the boat” but “selling myself short”: Stories, narratives, and identity development in elite sport. The Sport Psychologist, 27(1), 27-39. https://doi.org/10.1123/tsp.27.1.27
Castaldelli-Maia, J. M., e Gallinaro, J. G. D. M., Falcão, R. S., Gouttebarge, V., Hitchcock, M. E., Hainline, B., ... & Stull, T. (2019). Mental health symptoms and disorders in elite athletes: A systematic review on cultural influencers and barriers to athletes seeking treatment. British Journal of Sports Medicine, 53(11), 707-721. http://dx.doi.org/10.1136/bjsports-2019-100710
Cyr, J. J., J. M. McKenna-Foley, & E. Peacock. (1985). Factor structure of the SCL-90-R: is there one?. Journal of Personality Assessment, 49(6), 571-578. https://doi.org/10.1207/s15327752jpa4906_2
Darcy, A. M., Hardy, K. K., Crosby, R. D., Lock, J., & Peebles, R. (2013). Factor structure of the Eating Disorder Examination Questionnaire (EDE-Q) in male and female college athletes. Body Image, 10(3), 399-405. https://doi.org/10.1016/j.bodyim.2013.01.008
Davis, C., & Strachan, S. (2001). Elite female athletes with eating disorders: A study of psychopathological characteristics. Journal of Sport & Exercice Psychology, 23(3), 245-253. https://doi.org/10.1123/jsep.23.3.245
Derogatis, L. R. (1994). SCL-90-R: symptom checklist-90-R: Administration, scoring & procedures manual (3rd ed.). Minneapolis, MN: National Computer Systems, Inc.
Derogatis, L. R., & Cleary, P. A. (1977). Confirmation of the dimensional structure of the SCL 90: A study in construct validation. Journal of Clinical Psychology, 33(4), 981-989. https://doi.org/10.1002/1097-4679(197710)33:4<981::AID-JCLP2270330412>3.0.CO;2-0
Despres, J., Brady, F., & McGowan, A. S. (2008). Understanding the Culture of the Student Athlete: Implications for College Counselors. The Journal of Humanistic Counseling, Education & Development, 47(2), 200-211. https://doi.org/10.1002/j.2161-1939.2008.tb00058.x
DiBartolo, P. M., & Shaffer, C. (2002). A comparison of female college athletes and nonathletes: Eating disorder symptomatology and psychological well-being. Journal of Sport & Exercise Psychology, 24(1), 33-41. https://doi.org/10.1123/jsep.24.1.33
Donohue, B., Covassin, T., Lancer, K., Dickens, Y., Miller, A., Hash, A., & Genet, J. (2004). Examination of psychiatric symptoms in student athletes. The Journal of General Psychology, 131(1), 29-35. https://doi.org/10.3200/GENP.131.1.29-35
Donohue, B., Gavrilova, Y., Galante, M., Burnstein, B., Aubertin, P., Gavrilova, E., ... & Benning, S. D. (2020). Empirical development of a screening method for mental, social, and physical wellness in amateur and professional circus artists. Psychology of Aesthetics, Creativity, & the Arts, 14(3), 313. https://doi.org/10.1037/aca0000199
Donohue, B., Scott, J., Goodwin, G., Barchard, K.A., Bohall, G, & Allen, D.N. (2023). Initial examination of the Mental Health Disorders Screening Instrument for Athletes. Frontiers Psychology, 14.
Donohue, B., Silver, N. C., Dickens, Y., Covassin, T., & Lancer, K. (2007). Development and initial psychometric evaluation of the sport interference checklist. Behavior Modification, 31(6), 937-957. https://doi.org/10.1177/0145445507303827
Driller, M. W., Dixon, Z. T., & Clark, M. I. (2017). Accelerometer-based sleep behavior and activity levels in student athletes in comparison to student non-athletes. Sport Sciences for Health, 13(2), 411-418. https://doi.org/10.1007/s11332-017-0373-6
Dugan, J. P., Torrez, M. A., & Turman, N. T. (2014). Leadership in intramural sports and club sports: Examining influences to enhance educational impact. Corvallis, OR: NIRSA.
Foster, B. J., & Chow, G. M. (2019). Development of the Sport Mental Health Continuum Short Form (Sport MHC-SF). Journal of Clinical Sport Psychology, 13(4), 593-608. https://doi.org/10.1123/jcsp.2017-0057
Giannone, Z. A., Haney, C. J., Kealy, D., & Ogrodniczuk, J. S. (2017). Athletic identity and psychiatric symptoms following retirement from varsity sports. International Journal of Social Psychiatry, 63(7), 598-601. https://doi.org/10.1177/0020764017724184
Gomes, A. R., Martins, C., & Silva, L. (2011). Eating disordered behaviors in Portuguese athletes: The influence of personal, sport, and psychological variables. European Eating Disorders Review, 19(3), 190-200. https://doi.org/10.1002/erv.1113
Holcomb, W. R., Adams, N. A., & Ponder, H. M. (1983). Factor structure of the Symptom Checklist-90 with acute psychiatric inpatients. Journal of Consulting & Clinical Psychology, 51(4), 535. https://doi.org/10.1037/0022-006X.51.4.535
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Hughes, L., & Leavey, G. (2012). Setting the bar: athletes and vulnerability to mental illness. The British Journal of Psychiatry, 200(2), 95-96. https://doi.org/10.1192/bjp.bp.111.095976
Hurley, A. E., Scandura, T. A., Schriesheim, C. A., Brannick, M. T., Seers, A., Vandenberg, R. J., & Williams, L. J. (1997). Exploratory and confirmatory factor analysis: Guidelines, issues, and alternatives. Journal of Organizational Behavior, 18(6), 667-683. https://doi-org.ezproxy.library.unlv.edu/10.1002/(SICI)1099-1379(199711)18:6<667:AIDJOB874>3.0.CO;2-T
Kimball, A., & Freysinger, V. J. (2003). Leisure, stress, and coping: The sport participation of collegiate student-athletes. Leisure Sciences, 25(2-3), 115-141. https://doi.org/10.1080/01490400306569
Kline, R. B. (2015). Principles and practice of structural equation modeling (Methodology in the social sciences). The Guilford Press.
Kunst, L. E., Maas, J., van Balkom, A. J., van Assen, M. A., Kouwenhoven, B., & Bekker, M. H. (2021). Group autonomy enhancing treatment versus cognitive behavioral therapy for anxiety disorders: A cluster‐randomized clinical trial. Depression & Anxiety, 1– 13. https://doi.org/10.1002/da.23231
Lifschutz, L. (2012). Club sports: Maximizing positive outcomes and minimizing risks. Recreational Sports Journal, 36(2), 104-112. https://doi.org/10.1123/rsj.36.2.104
Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519-530. https://doi.org/10.1093/biomet/57.3.519
Martin, R. J., Nelson, S. E., & Gallucci, A. R. (2016). Game on: Past year gambling, gambling related problems, and fantasy sports gambling among college athletes and non-athletes. Journal of Gambling Studies, 32(2), 567-579. https://doi.org/10.1007/s10899-015-9561-y
Martinsen, M., Bahr, R., Børresen, R. U. N. I., Holme, I., Pensgaard, A. M., & Sundgot-Borgen, J. (2014). Preventing eating disorders among young elite athletes: a randomized controlled trial. Medicine & Science in Sports & Exercise, 46(3), 435-447. https://doi-org.ezproxy.library.unlv.edu/10.1249/MSS.0b013e3182a702fc
Marzell, M., Morrison, C., Mair, C., Moynihan, S., & Gruenewald, P. J. (2015). Examining drinking patterns and high-risk drinking environments among college athletes at different competition levels. Journal of Drug Education, 45(1), 5-16. https://doi.org/10.1177/0047237915575281
National Collegiate Athletics Association [NCAA]. (2009). Defining Countable Athletically Related Activities. http://www.ncaa.org/sites/default/files/Charts.pdf
National Collegiate Athletics Association [NCAA]. (2019). 1981-82 – 2018-19 NCAA sports sponsorship and participation rates report. https://ncaaorg.s3.amazonaws.com/research/sportpart/2018-19RES_SportsSponsorshipParticipationRatesReport.pdf
National Collegiate Athletics Association [NCAA]. (2020). Summary of NCAA Eligibility Regulations − NCAA Division I. https://ncaaorg.s3.amazonaws.com/compliance/d1/202021D1Comp_SummaryofNCAARegulations.pdf
National Intramural-Recreational Sports Association [NIRSA]. (2016). Player Eligibility Requirements. http://play.nirsa.net/nirsa-championship-series/player-eligibility requirements/
National Intramural-Recreational Sports Association [NIRSA]. (n.d.). Intramural Sport Rules. https://nirsa.net/nirsa/sport-rules/
Nicolas, M., Martinent, G., & Campo, M. (2014). Evaluation of the psychometric properties of a modified Positive and Negative Affect Schedule including a direction scale (PANAS-D) among French athletes. Psychology of Sport & Exercise, 15(3), 227-237. https://doi.org/10.1016/j.psychsport.2014.01.005
Olsen, L. R., Mortensen, E. L., & Bech, P. (2004). The SCL‐90 and SCL‐90R versions validated by item response models in a Danish community sample. Acta Psychiatrica Scandinavica, 110(3), 225-229. https://doi.org/10.1111/j.1600-0447.2004.00399.x
Patel, D. R., Omar, H., & Terry, M. (2010). Sport-related performance anxiety in young female athletes. Journal of Pediatric & Adolescent Gynecology, 23(6), 325-335. https://doi.org/10.1016/j.jpag.2010.04.004
Pennington, B. (2008). Rapid rise of college club teams creates a whole new level of success. New York Times, p. B11. https://search-proquest-com.ezproxy.library.unlv.edu/docview/897158959?rfr_id=info%3Axri%2Fsid%3Aprimo
Primack, B. A., Fertman, C. I., Rice, K. R., Adachi-Mejia, A. M., & Fine, M. J. (2010). Waterpipe and cigarette smoking among college athletes in the United States. Journal of Adolescent Health, 46(1), 45-51. https://doi.org/10.1016/j.jadohealth.2009.05.004
Proctor, S. L., & Boan-Lenzo, C. (2010). Prevalence of depressive symptoms in male intercollegiate student-athletes and nonathletes. Journal of Clinical Sport Psychology, 4(3), 204-220. https://doi.org/10.1123/jcsp.4.3.204
Reinking, M. F., & Alexander, L. E. (2005). Prevalence of disordered-eating behaviors in undergraduate female collegiate athletes and nonathletes. Journal of Athletic Training, 40(1), 47-51.
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667-696. https://doi.org/10.1080/00273171.2012.715555
Rescorla, L. A., & Achenbach, T. M. (2004). The Achenbach System of Empirically Based Assessment (ASEBA) for Ages 18 to 90 Years. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment: Instruments for adults (pp. 115–152). Lawrence Erlbaum Associates Publishers.
Rice, S. M., Purcell, R., De Silva, S., Mawren, D., McGorry, P. D., & Parker, A. G. (2016). The mental health of elite athletes: a narrative systematic review. Sports Medicine, 46(9), 1333-1353. https://doi.org/10.1007/s40279-016-0492-2
Ronan, G. F., Dreer, L. E., & Dollard, K. M. (2000). Measuring patient symptom change on rural psychiatry units: utility of the symptom checklist-90 revised. The Journal of Clinical Psychiatry, 61(7), 493-497. https://doi.org/10.4088/jcp.v61n0706
Rössler, W., Riecher-Rössler, A., Angst, J., Murray, R., Gamma, A., Eich, D., ... & Gross, V. A. (2007). Psychotic experiences in the general population: a twenty-year prospective community study. Schizophrenia Research, 92(1-3), 1-14. https://doi.org/10.1016/j.schres.2007.01.002
Ruis, C., van den Berg, E., van Stralen, H. E., Huenges Wajer, I. M., Biessels, G. J., Kappelle, L. J., ... & van Zandvoort, M. J. (2014). Symptom Checklist 90–Revised in neurological outpatients. Journal of Clinical & Experimental Neuropsychology, 36(2), 170-177. https://doi.org/10.1080/13803395.2013.875519
Schmitz, N., Hartkamp, N., & Franke, G. H. (2000). Assessing clinically significant change: Application to the SCL-90–R. Psychological Reports, 86(1), 263-274. https://doi.org/10.2466/pr0.2000.86.1.263
Schmitz, N., Kruse, J., Heckrath, C., Alberti, L., & Tress, W. (1999). Diagnosing mental disorders in primary care: the General Health Questionnaire (GHQ) and the Symptom Check List (SCL-90-R) as screening instruments. Social Psychiatry & Psychiatric Epidemiology, 34(7), 360-366. https://doi.org/10.1007/s001270050156
Smits, I. A., Timmerman, M. E., Barelds, D. P., & Meijer, R. R. (2014). The Dutch symptom checklist-90-revised: Is the use of the subscales justified? European Journal of Psychological Assessment, 31(4), 263–271. https://doi-org.ezproxy.library.unlv.edu/10.1027/1015-5759/a000233
Somasundaram, P., & Burgess, A. M. (2018). The role of division iii sports participation in the relationship between perfectionism and disordered eating symptomology. Journal of Clinical Sport Psychology, 12, 57-74. https://doi.org/10.1123/jcsp.2017-0013
Steiger, J. H. (1980). Statistically based tests for the number of common factors. In the annual meeting of the Psychometric Society. Iowa City, IA.
Stewart, R. E. (1992). A brief history of the intramural movement. Recreational Sports Journal, 17(1), 12-14.
Storch, E. A., Storch, J. B., Killiany, E. M., & Roberti, J. W. (2005). Self-reported psychopathology in athletes: a comparison of intercollegiate student-athletes and non-athletes. Journal of Sport Behavior, 28(1), 86-97.
Sundgot-Borgen, J., Torstveit, M. K., & Skårderud, F. (2004). Eating disorders among athletes. Tidsskrift for den Norske laegeforening: tidsskrift for praktisk medicin, ny raekke, 124(16), 2126-2129.
Swann, C., Moran, A., & Piggott, D. (2015). Defining elite athletes: Issues in the study of expert performance in sport psychology. Psychology of Sport & Exercise, 16, 3-14. https://doi.org/10.1016/j.psychsport.2014.07.004
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA:
Allyn and Bacon.
Tahtinen, R. E., & Kristjansdottir, H. (2018). The influence of anxiety and depression symptomson help-seeking intentions in individual sport athletes and non-athletes: the role of gender and athlete status. Journal of Clinical Sport Psychology, 13(1), 134-151. https://doi.org/10.1123/jcsp.2017-0028
The National Federation of State High School Associations. (2019). 2018-19 High School Athletics Participation Survey. https://www.nfhs.org/media/1020412/201819_participation_survey.pdf
Urbán, R., Arrindell, W. A., Demetrovics, Z., Unoka, Z., & Timman, R. (2016). Cross-cultural confirmation of bi-factor models of a symptom distress measure: Symptom Checklist-90-Revised in clinical samples. Psychiatry Research, 239, 265-274. https://doi.org/10.1016/j.psychres.2016.03.039
van de Grift, T. C., Elaut, E., Cerwenka, S. C., Cohen-Kettenis, P. T., & Kreukels, B. P. (2018). Surgical satisfaction, quality of life, and their association after gender-affirming surgery: a follow-up study. Journal of Sex & Marital Therapy, 44(2), 138-148. https://doi.org/10.1080/0092623X.2017.1326190
Watson, J. C. (2006). Student-athletes and counseling: Factors influencing the decision to seek counseling services. College Student Journal, 40(1), 35-42.
Wilson, M. (2016). Differences in Depression, Anxiety, and Life Satisfaction between Intercollegiate Athletes, Intramural Participants, and Non-Athletes. Masters Theses & Specialist Projects. Paper 1739. http://digitalcommons.wku.edu/theses/1739
Wolanin, A., Gross, M., & Hong, E. (2015). Depression in athletes: prevalence and risk factors. Current Sports Medicine Reports, 14(1), 56-60. https://doi.org/10.1249/JSR.0000000000000123
Yusko, D. A., Buckman, J. F., White, H. R., & Pandina, R. J. (2008). Alcohol, tobacco, illicit drugs, and performance enhancers: A comparison of use by college student athletes and nonathletes. Journal of American College Health, 57(3), 281-290. https://doi.org/10.3200/JACH.57.3.281-290
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Elena Gavrilova, Bradley Donohue, Daniel N. Allen, Kimberly Barchard
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
