
==== Front
Sci Rep
Sci Rep
Scientific Reports
2045-2322
Nature Publishing Group UK London

39227677
68814
10.1038/s41598-024-68814-9
Article
Psychometric properties of the Depression Anxiety Stress Scales (DASS-21) in women with breast cancer
Soria-Reyes Lorena M.
Alarcón Rafael ralarcon@uma.es

Cerezo María V.
Blanca María J.
https://ror.org/036b2ww28 grid.10215.37 0000 0001 2298 7828 Department of Psychobiology and Behavioral Sciences Methodology, Faculty of Psychology and Speech Therapy, University of Málaga, Doctor Ortiz Ramos, 12, 29010 Málaga, Spain
3 9 2024
3 9 2024
2024
14 2047326 3 2024
29 7 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by/4.0/ Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Breast cancer impacts the psychological well-being of women, leaving them at risk of developing depression, anxiety, and other stress-related disorders. The Depression Anxiety Stress Scales (DASS-21) is a widely used measure, although empirical evidence regarding its psychometric properties in the breast cancer population is limited. The purpose of this study was to conduct an exhaustive analysis of the psychometric properties of the DASS-21 in a sample of Spanish women diagnosed with breast cancer. Participants were 289 breast cancer patients who completed the DASS-21 and other questionnaires measuring life satisfaction, positive and negative affect, flourishing, perceived stress, and breast cancer-specific stressors. In terms of validity evidence based on the internal structure of the DASS-21, adequate fit indices were obtained for the model based on three first-order factors (depression, anxiety, stress) and one second-order factor (general psychological distress). Reliability coefficients (McDonald’s omega) ranged from .84 to .95. Validity evidence based on relationships with other variables was also provided by moderate and strong correlations with well-being indicators and stress measures. The results support the use of the DASS-21 for measuring general psychological distress in the breast cancer context, where it may provide useful information for the design of psychological interventions with patients.

Keywords

Distress
DASS-21
Validity evidence
Reliability
Breast cancer
Subject terms

Breast cancer
Quality of life
Human behaviour
http://dx.doi.org/10.13039/501100011011 Junta de Andalucía CTS-110 CTS-110 CTS-110 CTS-110 Soria-Reyes Lorena M. Alarcón Rafael Cerezo María V. Blanca María J. issue-copyright-statement© Springer Nature Limited 2024
==== Body
pmcIntroduction

The incidence of cancer continues to grow, with estimates for our country, Spain, predicting as many as 286,664 new cases in 2024. Breast cancer is the most frequently diagnosed cancer among Spanish women, with an estimated total of 35,001 new cases in 20231. Thanks to research, more advanced treatments, and primary screening, the overall 5-year survival rate for breast cancer in women is 90%2.

A diagnosis of breast cancer impacts the psychological well-being of women3–5, leaving them at risk of developing depression, anxiety, and other stress-related disorders6, which importantly may persist beyond the end of medical treatment7. The disease therefore needs to be addressed from a psycho-oncological perspective8.

Reliable and valid measurement tools are essential for assessing health indicators in the context of breast cancer. Widely used measures of psychological health include: for depression, the Beck Depression Inventory-II9 (BDI-II) and the Hamilton Depression Rating Scale10 (HDRS); for anxiety, the State-Trait Anxiety Questionnaire11 (STAI) and the Beck Anxiety Inventory12 (BAI); and for stress, the Perceived Stress Scale13 (PSS-14) and its shortened 10-item version13,14 (PSS-10), as well as specific stress measures developed specifically for the oncological context, such as the Questionnaire on Stress in Cancer Patients15 (QSC-R23), the Newly Diagnosed Breast Cancer Stress Scale16, and the Stressors in Breast Cancer Scale17 (SBCS). There are also instruments that assess depression and anxiety together, such as the Hospital Anxiety and Depression Scale18 (HADS).

However, because depression, anxiety, and stress present high comorbidity, Lovibond and Lovibond19,20 developed the Depression Anxiety Stress Scales (DASS), a composite measure of these negative emotional states. The DASS consists of 42 items distributed equally across the three scales (14 per scale), although the authors also developed a brief 21-item version20 (DASS-21) with 7 items per scale, which has shown similar psychometric properties to the original instrument21. Lovibond and Lovibond19 consider that the Depression scale evaluates negative emotional states such as dysphoria, hopelessness, devaluation of life, feeling gloomy or blue, being convinced that life has no meaning or value, pessimism about the future, and an inability to experience pleasure or satisfaction. The Anxiety scale assesses negative emotional states such as autonomic arousal, apprehension, sense of panic, situational anxiety, and the subjective experience of anxious affect. Finally, the Stress scale evaluates non-specific and chronic over-arousal, such as difficulty relaxing, nervous excitement, and ease of becoming angry/agitated, irritated, upset or impatient. Theoretically, stress can be understood as a stimulus or as a response22,23, with the Stress scale of the DASS-21 reflecting the idea of stress as a response.

The DASS-21 is widely used by psychologists to assess distress as it is brief, its items are easily understood by patients, and interpretation of responses is straightforward: high scores on each scale indicate higher levels of depression, anxiety or stress, while the total score is an indicator of overall distress. High scores on any of the scales would suggest the need for more in-depth assessment and, potentially, psychological treatment. Note too that the authors20 of the DASS-21 have established cut-off points for determining emotional states for each scale, and this can likewise help in psychological diagnosis. The tool is also useful for follow-up, as it can be re-administered to monitor progress and the effectiveness of intervention. Finally, the DASS-21 has exhibited better psychometric properties in breast cancer patients than have other similar tools, such as the HADS or the BDI-II24. It should be noted here that the tool has so far been translated into 55 languages, and hence its psychometric properties have been investigated worldwide21,24–47. In Spain, its psychometric properties have been analyzed by Ruiz et al.25, Daza et al.30, and Fonseca-Pedrero et al31.

Regarding validity evidence based on the internal structure of the DASS-21, two factorial structures have frequently been reported: (1) a model involving three correlated factors (depression, anxiety, and stress) based on the original scale20,21,25,27,29,33,34,37–39,43–46, and (2) a model proposed by Henry and Crawford36 comprising three first-order factors (depression, anxiety, and stress) and one second-order factor (general psychological distress)21,30–32,36,40,41. Both structures have been shown to be invariant across gender27,33,37–40,46, age40,46, countries25,41, time28,44, or group characteristics25,33,42.

Regarding reliability of DASS-21 scores, studies have reported internal consistency coefficients ranging from 0.8031 to 0.9934 for depression, 0.7042–0.9934 for anxiety, 0.7125,26,31,45,46–0.9934 for stress, and 0.7435–0.9633 for general psychological distress.

With respect to validity evidence based on relationships with other variables, scores on depression, anxiety, and stress, as well as the total DASS-21 score (general psychological distress), have shown convergent validity in different populations with scores on other instruments that also measure these constructs. Overall, as expected, scores on the DASS-21 are positively correlated with depression26,29,30,32,34,35,42,45, anxiety26,29,30,32,34,45, and stress28. Research has also shown that scores on the DASS-21 correlate positively with negative affect36,38–40,46 and negatively with several indicators of well-being32,38,39, specifically, life satisfaction39 and flourishing42, meaning in life38,39, resilience38,39, hope38,39, optimism39, gratitude38,39, and quality of life38,42. The relationship between DASS-21 scores and aspects related to mental health32,33,37,38,42,43 and suicidal ideation has likewise been examined42.

Although the DASS-21 has been used in the oncology population, there is limited empirical evidence regarding its psychometric properties34,42,48. Fox42 and Clover48 focused on different types of cancer patients and did not analyze the whole scale (only the Anxiety scale was used in the first of these studies, while the second used the Depression and Anxiety scales). Kumar34 administered the DASS-21 to a sample of patients with head and neck cancer or oral malignant disorders and conducted a principal component analysis with varimax rotation in which they specified four factors. Therefore, to the best of our knowledge, there are no psychometric studies of the DASS-21 in breast cancer patients. Consequently, the aim of this study was to conduct an exhaustive analysis of the psychometric properties of the DASS-21 in a sample of Spanish women diagnosed with breast cancer, a population that has yet to be studied. Specifically, we sought to provide validity evidence based on the internal structure, to carry out reliability and item analysis, and to obtain validity evidence based on relationships with other variables, including well-being indicators (life satisfaction, flourishing, and positive and negative affect) and measures of stress, both globally and cancer-specific. Based on previous evidence, we expected to find that DASS-21 scores (depression, anxiety, stress, and general psychological distress) are negatively related to scores on well-being indicators and positively associated with scores on negative affect and stress measures. Knowledge about the psychometric properties of the DASS-21 in the breast cancer context is important, given that inferences from an instrument should be made for a specific use, context, and population49.

Method

Sample

Participants were 289 Spanish women diagnosed with breast cancer and aged between 28 and 76 years (M = 51.09, SD = 8.76). They had a mean time since diagnosis of 4.70 years (SD = 5.41) and were recruited through different health centers providing cancer care in Spain. The inclusion criteria were a diagnosis of breast cancer, age 18 years or older, and signing informed consent. At the time of the study, 74.4% were married or living with their partner, 49.8% had completed high school and 41.5% university education, 32.5% were in employment, and 45% were at stage II of the TNM tumor classification system. Table 1 shows the sample characteristics.Table 1 Sample characteristics (N = 289).

Variables	Percentage	
Civil status	
 Single/divorced/widowed	25.6	
 Married/living with partner	74.4	
Educational level	
 Elementary	8.7	
 High school	49.8	
 University	41.5	
Employment status	
 Working at home	17.0	
 Medical leave	23.5	
 Retired	18.3	
 Unemployed	8.7	
 Employed	32.5	
Time since diagnosis (years)	
 < 2	42.6	
 2–5	29.0	
 > 5	28.4	
Cancer stage	
 0	5.9	
 I	20.0	
 II	45.0	
 III	24.6	
 IV	4.5	
Affected breast	
 Left	46.4	
 Right	48.8	
 Both	4.8	
Type of breast surgery	
 Conservative	50.9	
 Mastectomy without reconstruction	23.5	
 Mastectomy with immediate reconstruction	11.8	
 Delayed reconstruction	9.0	
 No surgery	4.8	

For the analysis of validity evidence based on relationships with other variables, the total sample was split randomly into two sub-samples (approximately 50–50) in order to administer different questionnaires and avoid fatigue among participants. Thus, in addition to the DASS-21 (all participants), the first sub-sample completed the Satisfaction with Life Scale (SWLS), Flourishing Scale (FS), and Positive and Negative Affect Schedule (PANAS), while the second subsample completed the Perceived Stress Scale (PSS-10) and the Stressors in Breast Cancer Scale (SBCS).

Measures

Depression Anxiety Stress Scales (DASS-21)20, in its Spanish version30. The DASS-21 assesses feelings of depression, anxiety, and stress. It consists of three scales, each with seven items, and respondents are asked to indicate the extent to which the item statement has applied to them during the last week. Responses are given using a 4-point Likert-type scale (0 = does not apply to me at all; 3 = applies to me a lot or most of the time), and thus the total score for each scale ranges from 0 to 21, with high scores indicating a higher level of the respective construct. The total score for the DASS-21 (range from 0 to 63 points) is obtained by summing the total scores obtained on each of the three scales, with high scores reflecting a higher level of general psychological distress. Regarding the proposed cut-off points20 that can be used in clinical practice to determine emotional states for each scale, these are as follows: for the Depression scale, 0–9: normal, 10–13: mild, 14–20: moderate, 21–27: severe, and ≥ 28: extremely severe; for the Anxiety scale, 0–7: normal, 8–9: mild, 10–14: moderate, 15–19: severe, and ≥ 20: extremely severe; for the Stress scale, 0–14: normal, 15–18: mild, 19–25: moderate, 26–33: severe, and ≥ 34: extremely severe. The reliability analysis of scores obtained with the Spanish version of the DASS-2130 reported satisfactory results for the three scales and the total score (Cronbach's alpha coefficients > 0.85).

Satisfaction with Life Scale (SWLS)50, in its Spanish version51, which has also been validated with Spanish breast cancer patients5. The SWLS is a brief 5-item instrument for assessing life satisfaction as a whole. Each item is rated on a 7-point Likert-type scale (1 = strongly disagree; 7 = strongly agree), and high scores indicate a higher level of life satisfaction. McDonald’s omega coefficient in the present sample was 0.85.

Flourishing Scale (FS)52, in its Spanish version53. This 8-item scale assesses psychological well-being from the perspective of fullness in life. Each item is rated using a 7-point Likert-type scale (1 = strongly disagree; 7 = strongly agree). High scores correspond to a higher level of psychological growth or development. McDonald’s omega coefficient in the present sample was 0.82.

Positive and Negative Affect Schedule (PANAS)54, in its Spanish version55. The PANAS comprises 20 items describing emotions, divided into two subscales: Positive Affect (PA) and Negative Affect (NA), each with 10 items. Responses to each item are given using a 5-point Likert-type scale (1 = not at all; 5 = a lot). High scores on a given subscale suggest a stronger presence of the corresponding emotions. McDonald's omega coefficient in the present sample was 0.72 for positive affect and 0.76 for negative affect.

Perceived Stress Scale (PSS-10)13,14, in its Spanish version56, which has also been validated with Spanish breast cancer patients57. This scale comprises 10 items, each rated on a 5-point Likert-type scale (0 = never; 4 = very often), that measure the degree to which daily events are perceived as uncontrollable, unpredictable, and stressful. The PSS-10 yields scores on two factors: perceived helplessness, consisting of six items that assess perceived stress; and perceived self-efficacy, comprising four items referring to the perceived degree of coping ability with respect to current stressors. McDonald's omega coefficients in the present sample were 0.88 and 0.75, respectively.

Stressors in Breast Cancer Scale (SBCS)17, which consists of 24 items assessing breast cancer-specific stressors. The scale is divided into five subscales: physical appearance and sex strains, health and daily difficulties, interpersonal relationship strains, healthcare strains, and worries and concerns about the future. Each item is rated on a 5-point Likert-type scale (1 = not at all stressful or is irrelevant to me; 5 = very stressful), and a total score can be computed by summing the subscale scores. High scores indicate high levels of stress on the respective subscale. McDonald’s omega coefficient in the present sample was 0.94 for the total score, and ranged from 0.81 to 0.87 for scores on the five subscales.

Procedure

The study complied with the ethical standards of the Declaration of Helsinki and was approved by the Experimental Ethics Committee of the University of Málaga. Participants were all volunteers and did not receive any incentives. The research team contacted by email and telephone the staff of different health centers providing care for women with breast cancer. The staff of each center invited patients to participate and those who accepted were sent a link to the questionnaires. The allocation of questionnaires was randomized using the random function of the Excel program. One group received the link to the survey containing the DASS-21, SWLS, FS, and PANAS (N = 143; 54 items), whereas the second group received the link to the DASS-21, PSS-10, and SBCS (N = 146; 55 items). All participants signed an informed consent form specifying that the information collected was anonymous and confidential and would be used for research purposes only. There were no missing data as the questionnaires could not be submitted electronically unless all items had been responded to.

Data analysis

First, a descriptive analysis was carried out for each item, calculating the mean, standard deviation, skewness, and kurtosis. Next, in order to obtain validity evidence based on the internal structure of the DASS-21, we conducted a confirmatory factor analysis (CFA) with the R package lavaan58, testing the structure of three first-order factors and one second-order factor. The method used was diagonally weighted least squares (DWLS) estimation with the polychoric correlation matrix, which has been shown to provide accurate parameter estimates when dealing with categorical items59. The chi-square statistic (χ2) and the following fit indices were calculated: comparative fit index (CFI), non-normed fit index (NNFI), and the root mean square error of approximation (RMSEA) and its 90% confidence interval. These indexes were interpreted according to the following criteria: CFI and NNFI values of 0.95 or higher are considered to indicate satisfactory fit; RMSEA values between 0.06 and 0.08 indicate a reasonable fit56 and those below 0.06 a satisfactory fit.

The reliability (in terms of internal consistency) of DASS-21 scores was then assessed by calculating McDonald’s omega coefficient (ω), considering values of 0.70 or higher as satisfactory. Item analysis was also performed, calculating the corrected item-total correlation coefficient and interpreting values above 0.30 as satisfactory.

Validity evidence based on relationships with other variables was obtained by calculating Pearson correlation coefficients between scores on the three DASS-21 scales (Depression, Anxiety, and Stress), as well as the total score (general psychological distress), and scores on life satisfaction (SWLS), positive and negative affect (PANAS), flourishing (FS), perceived stress (PSS-10), and cancer-specific stressors (SBCS). Coefficients were interpreted in accordance with Cohen's criteria: close to |.10|, low; close to |.30|, moderate; close to |.50| or higher, strong correlation60.

Finally, descriptive statistics for scores on DASS-21 scales and its total score were computed. A one-way analysis of variance (ANOVA) was performed to analyze mean differences in scores on Depression, Anxiety, Stress, and total score as a function of time since diagnosis (< 2 years, 2–5 years, and > 5 years) and cancer stage (0-I, II, and III-IV). For the ANOVAs we followed the guidelines proposed by Blanca et al.61 regarding heterogeneity of variance and control of Type I error, taking into account the variance ratio, the pairing of variance with group size, and the coefficient of sample size variation.

Results

Descriptive analysis for DASS-21 items

Table 2 shows the mean, standard deviation, and skewness and kurtosis statistics for each item. Some skewness and kurtosis values indicate deviation from normality.Table 2 Descriptive statistics for DASS-21 items (N = 289).

Item	M	SD	Skewness	Kurtosis	
1	1.61	0.98	− 0.01	− 1.04	
2	1.22	1.10	0.37	− 1.19	
3	0.93	0.95	0.74	− 0.44	
4	0.80	0.98	0.93	− 0.35	
5	1.02	0.94	0.56	− 0.65	
6	1.22	1.01	0.40	− 0.93	
7	0.60	0.95	1.38	0.62	
8	1.32	1.05	0.18	− 1.18	
9	0.89	0.98	0.73	− 0.66	
10	0.83	1.00	0.90	− 0.45	
11	1.27	1.04	0.28	− 1.10	
12	1.51	1.03	0.04	− 1.15	
13	1.47	1.04	0.12	− 1.17	
14	0.83	0.82	0.74	− 0.03	
15	0.62	0.91	1.30	0.61	
16	0.83	0.93	0.81	− 0.39	
17	0.65	0.90	1.22	0.46	
18	1.18	1.06	0.43	− 1.05	
19	1.06	1.03	0.53	− 0.93	
20	0.91	1.00	0.80	− 0.50	
21	0.61	0.90	1.41	1.00	

Validity evidence based on the internal structure (construct validity)

The CFA results for the second-order factor model showed that all fit indices were satisfactory according to the aforementioned criteria, with values of CFI and NNFI above 0.95 and RMSEA close to 0.06 (Table 3). The standardized parameter values were all significant and are shown in Table 4.Table 3 Fit indices for the second-order factor model of the DASS-21.

Model	χ2	df	CFI	NNFI	RMSEA [90% CI]	
Three first-order factors and one second-order factor	371.81	186	0.995	0.994	0.059 [0.050–0.068]	
N = 289; χ2 = chi-square; df = degrees of freedom; CFI = comparative fit index; NNFI = non-normed fit index; RMSEA = root mean square error of approximation with 90% confidence interval.

Table 4 Standardized factor loadings for the second-order factor model of the DASS-21 and corrected item-total correlation.

Item	Scale	Second-order factor loading	Factor loading	Corrected item-scale correlation	Corrected item-total correlation	
3	Depression	0.90	0.81	0.73	0.69	
5	0.75	0.58	0.65	
10	0.83	0.71	0.68	
13	0.92	0.72	0.79	
16	0.82	0.75	0.66	
17	0.76	0.66	0.60	
21	0.82	0.71	0.63	
2	Anxiety	0.96	0.55	0.49	0.46	
4	0.67	0.57	0.56	
7	0.75	0.64	0.60	
9	0.76	0.58	0.64	
15	0.88	0.69	0.74	
19	0.79	0.68	0.68	
20	0.79	0.64	0.67	
1	Stress	0.94	0.81	0.65	0.64	
6	0.80	0.70	0.71	
8	0.90	0.80	0.79	
11	0.91	0.83	0.80	
12	0.89	0.79	0.72	
14	0.61	0.49	0.51	
18	0.81	0.69	0.71	

Reliability and item analysis

The results showed that the reliability of DASS-21 scale scores and total score was satisfactory, with values of ω equal to 0.90 for Depression, 0.84 for Anxiety, 0.90 for Stress, and 0.95 for the total score. The item analysis yielded values of the corrected item-total correlation above the cut-off of 0.30 (Table 4).

Validity evidence based on relationships with other variables

In the first subsample, scores on the DASS-21 showed negative and significant correlations with scores on life satisfaction, flourishing, and positive affect, and a positive correlation with scores on negative affect. In the second subsample, scores on the DASS-21 yielded positive correlations with scores on perceived helplessness, physical appearance and sex strains, health and daily difficulties, interpersonal relationship strains, healthcare strains, worries and concerns about the future, and the SBCS total score, and a negative correlation with scores on perceived self-efficacy. These results are shown in Table 5.Table 5 Correlation between scores on the DASS-21 and scores on life satisfaction, flourishing positive and negative affect, perceived helplessness, perceived self-efficacy, and the SBCS subscales.

	N	Depression	Anxiety	Stress	Total score	
Life satisfaction	143	− 0.49***	− 0.33***	− 0.32***	− 0.41***	
Flourishing	143	− 0.58***	− 0.36***	− 0.33***	− 0.46***	
Positive affect	143	−0.37***	− 0.24**	− 0.15*	− 0.27***	
Negative affect	143	0.46***	0.47***	0.55***	0.54***	
Perceived helplessness	146	0.69***	0.65***	0.76***	0.77***	
Perceived self-efficacy	146	− 0.24**	− 0.24**	− 0.33***	− 0.30***	
Physical appearance and sex strains	146	0.32***	0.32***	0.32***	0.35**	
Health and daily difficulties	146	0.34***	0.39***	0.38***	0.40***	
Interpersonal relationship strains	146	0.39***	0.35***	0.33***	0.39**	
Healthcare strains	146	0.36***	0.39***	0.39***	0.41***	
Worries and concerns about the future	146	0.45***	0.45***	0.46***	0.50***	
SBCS total score	146	0.45***	0.47***	0.46***	0.50***	
*p < .05, **p < .01, ***p < .001.

Descriptive statistics for DASS-21 scale scores

Table 6 shows the mean and standard deviation for the three DASS-21 scale scores and total score. Considering the cut-off points established for each scale, prevalence was 25.6% for depression (mild 14.6%, moderate 10%, and severe 1%), 33.2% for anxiety (mild 9.7%, moderate 15.6%, severe 6.2%, and extremely severe 1.7%), and 17.6% for stress (mild 11.7%, and moderate 5.9%).Table 6 Descriptive statistics for DASS-21 scale scores in the total sample and as a function of time since diagnosis.

Scale	Total sample	 < 2 years	2 – 5 years	 > 5 years		
(N = 289)	(N = 123)	(N = 84)	(N = 82)	
M	SD	M	SD	M	SD	M	SD	F	
Depression	6.34	5.22	6.63	5.21	7.18	5.52	5.06	4.73	3.80*	
Anxiety	6.11	5.04	6.26	5.12	7.27	5.50	4.70	4.03	5.71**	
Stress	8.95	5.57	9.33	5.56	10.11	5.92	7.20	4.80	6.41**	
Total score	21.40	14.46	22.22	14.18	24.56	15.75	21.41	14.46	6.31**	
*p < .05, **p < .01.

The ANOVA results showed no significant differences according to cancer stage for any scale score. As for time since diagnosis, the test was found to be robust to heterogeneity of variances with the characteristics of the sample data obtained, taking into account the variance ratio, the pairing of variance with group size, and the coefficient of sample size variation61. The results revealed differences in means, specifically, mean scores on Depression, Anxiety, Stress, and General psychological distress (total score) were significantly lower in patients with more than 5 years since diagnosis compared with both other sub-groups, whereas there were no differences between those with less than 2 years and those with between 2 and 5 years since diagnosis (Table 6).

Discussion

The aim of this study was to perform a comprehensive analysis of the psychometric properties of the DASS-21 in a sample of Spanish women with breast cancer, examining validity evidence based on the internal structure, the reliability of test scores and item analysis, and validity evidence based on relationships between DASS-21 scores and life satisfaction, flourishing, positive and negative affect, perceived stress, and stressors in breast cancer. The results extend knowledge about the use of the DASS-21 in the breast cancer context.

Regarding the internal structure, the results provide support for the second-order factor model proposed initially by Henry and Crawford36 and corroborated in subsequent studies with different populations21,30–32,36,40,41. This suggests that the constructs of depression, anxiety, and stress (measured by the three DASS-21 scales) may be subsumed under the higher-order construct of general psychological distress (reflected in the DASS-21 total score), with higher scores indicating higher levels of distress. These results support the use of the DASS-21 as a screening tool to determine the level of psychological distress among women diagnosed with breast cancer, an important first step in the process of targeting psycho-oncological intervention.

Scores on the DASS-21 also showed satisfactory reliability. Values of ω were 0.90 for depression, 0.84 for anxiety, 0.90 for stress, and 0.95 for general psychological distress, all within the range reported previously21,25–28,39–46. Homogeneity indices were also satisfactory for all items.

Regarding validity evidence based on the relationship between DASS-21 scores and well-being indicators, moderate and negative correlations were obtained between scores on all scales of the DASS-21 and those on measures of life satisfaction, flourishing, and positive affect, whereas a positive association was observed with negative affect. This means that patients with high levels of depression (who feel discouraged, blue, and pessimistic about the future), those with high levels of anxiety (who feel apprehensive and worried about a possible loss of control), and those with high levels of stress (who feel overexcited and tense) tend to feel unfulfilled and dissatisfied with their life, are less likely to experience happiness and enthusiasm, and are more prone to negative emotions such as fear, irritability, etc. These results are consistent with previous studies both in the general population26,28–30,36–40,43 and with breast cancer patients5. With respect to stress-related variables, and in line with previous research57, scores on the DASS-21 correlated positively and strongly with scores on perceived helplessness, and moderately and negatively with scores on perceived self-efficacy. These results indicate that patients with high scores on the DASS-21 show a greater tendency to experience their daily life situations as unpredictable and uncontrollable, and are less likely to perceive themselves as able to cope with current stressors.

Considering stress as a stimulus, all DASS-21 scores correlated moderately and positively with scores on the SBCS, a tool designed to measure breast cancer-specific stressors. These results indicate that women with high levels of distress tend to experience stressors in different spheres of the cancer process, specifically those related to body appearance and sex strains, states of physical discomfort such as fatigue or pain, social relationships including family and friends, healthcare strains, and fears about what life may bring in the short or long term. It is worth noting here that the strongest correlations were those between general psychological distress (DASS-21 total score) and worries about the future and the SBCS total score. This is consistent with previous research showing that cancer survivors who experience concerns or fears about the future, often referred to as Damocles syndrome, tend to manifest greater psychological distress7,17. These worries about the future in breast cancer patients should therefore be a target of intervention by psycho-oncologists, as they seem to be one of the most important concerns affecting these women. The fact that it was the DASS-21 total score (rather than individual scale scores) which showed the strongest correlation with breast cancer-specific stressors suggests that the instrument should be used in its entirety. That is to say, researchers and clinical psychologists who wish to use the DASS-21 as a screening tool with these patients are advised to administer all three of the instrument's scales (Depression, Anxiety, Stress). Using only part of the instrument26,42,48 may yield a less accurate or inconclusive picture of the overall level of psychological distress experienced by a woman with breast cancer.

In relation to the levels of psychological distress found in the present sample, the highest prevalence was for anxiety (33.2%), followed by depression (25.6%), and stress (17.6%), although extreme levels were not very common for any of the three. The results regarding anxiety are similar to those obtained in other studies4 in the breast cancer population, which place the percentage of women showing psychological maladjustment (related mainly to anxiety, along with a lower level of optimism and well-being) at 38.24%. The mean scores obtained on the three scales (Depression: 6.34, Anxiety: 6.11, Stress: 8.95; General psychological distress: 21.4) are slightly higher than those reported by Ruiz et al.25 in a sample (n = 813 participants) of the general Spanish population, 71% of whom were women aged between 18 and 82 (Depression: 4.42, Anxiety: 3.53, Stress: 6.74; General psychological distress: 14.68). In the present sample, means were lower in patients with more than 5 years since diagnosis, whereas there were no differences between those with less than 2 years and those with between 2 and 5 years since diagnosis. These results suggest that the first five years following diagnosis are key. During this period, patients have to cope with major changes in their lives that drastically disrupt personal, family, social, and work routines. The importance of monitoring anxiety and depression during the first five years after a cancer diagnosis and identifying factors associated with these conditions has been highlighted previously7,62.

This study has a number of limitations. First, the questionnaires administered are all self-report instruments and might therefore be affected by response bias. Other tools, such as a diagnostic interview, could have been used to complement the information obtained through self-report. Second, the use of a convenience sample and the characteristics of the sample may limit the generalization of results. Third, the study was cross-sectional and there was no second test administration, so test–retest reliability was not analyzed. Future studies should focus on analyzing reliability in terms of stability of scores. Finally, although the study provides validity evidence with respect to a wide set of variables, the relationships with other potentially important variables such as self-esteem, resilience or quality of life have not been studied.

Despite these limitations, the study provides detailed information about the psychometric properties of a scale that is able to measure general psychological distress in Spanish women diagnosed with breast cancer. In addition to supporting the factor structure and reliability of the original scale, the results show that the DASS-21 is a valid instrument for use in this population. The negative relationship observed between DASS-21 scores and indicators of well-being, and the positive relationship between DASS-21 scores and stress-related variables provides useful information for the design of psychological interventions in the context of breast cancer. This is important because breast cancer is known to be one of the most stressful life events that a woman may face during her lifetime3,4,7. Women with high scores on the DASS-21 should be prioritized for psychological intervention to reduce their psychological distress.

Author contributions

L.M.S.-R. and M.V.C. were responsible for data collection. L.M.S.-R. and R.A. wrote the first draft. M.J.B. led the research. All authors contributed to data analysis and were involved in revising the draft manuscript to produce the final version. All authors have read and agree with the submitted version of the manuscript.

Funding

This study was supported by the research group CTS-110, Junta de Andalucía.

Data availability

The dataset used are available at 10.24310/riuma.28123.

Competing interests

The authors declare no competing interests.

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
==== Refs
References

1. Spanish Society of Medical Oncology. Cancer data in Spain 2023. https://seom.org/publicaciones/el-cancer-en-espanyacom (2023).
2. American Cancer Society. Cancer Facts & Figures 2021 (American Cancer Society, 2021).
3. Alarcón R Cerezo MV Hevilla S Blanca MJ Psychometric properties of the Connor-Davidson Resilience Scale in women with breast cancer Int. J. Clin. Health Psychol. 2020 20 81 89 10.1016/j.ijchp.2019.11.001 32021622
Alarcón, R., Cerezo, M. V., Hevilla, S. & Blanca, M. J. Psychometric properties of the Connor-Davidson Resilience Scale in women with breast cancer. Int. J. Clin. Health Psychol. 20, 81–89. 10.1016/j.ijchp.2019.11.001 (2020).32021622 10.1016/j.ijchp.2019.11.001
4. Cerezo MV Blanca MJ Ferragut M Personality profiles and psychological adjustment in breast cancer patients Int. J. Environ. Res. Public Health 2020 17 9452 10.3390/ijerph17249452 33348619
Cerezo, M. V., Blanca, M. J. & Ferragut, M. Personality profiles and psychological adjustment in breast cancer patients. Int. J. Environ. Res. Public Health 17, 9452. 10.3390/ijerph17249452 (2020).33348619 10.3390/ijerph17249452
5. Cerezo MV Soria-Reyes LM Alarcón R Blanca MJ The satisfaction with life scale in breast cancer patients: Psychometric properties Int. J. Clin. Health Psychol. 2022 22 100274 10.1016/j.ijchp.2021.100274 34703465
Cerezo, M. V., Soria-Reyes, L. M., Alarcón, R. & Blanca, M. J. The satisfaction with life scale in breast cancer patients: Psychometric properties. Int. J. Clin. Health Psychol. 22, 100274. 10.1016/j.ijchp.2021.100274 (2022).34703465 10.1016/j.ijchp.2021.100274
6. Pérez-Tejada J Aizpurua-Perez I Labaka A Vegas O Ugartemendia G Arregi A Distress, proinflammatory cytokines and self-esteem as predictors of quality of life in breast cancer survivors Physiol. Behav. 2021 230 113297 10.1016/j.physbeh.2020.113297 33352145
Pérez-Tejada, J. et al. Distress, proinflammatory cytokines and self-esteem as predictors of quality of life in breast cancer survivors. Physiol. Behav. 230, 113297. 10.1016/j.physbeh.2020.113297 (2021).33352145 10.1016/j.physbeh.2020.113297
7. De la Torre-Luque A Cerezo MV López E Sibole JV Emotional distress among long-term breast cancer survivors: The role of insomnia and worry Behav. Psychol. 2020 28 533 549
De la Torre-Luque, A., Cerezo, M. V., López, E. & Sibole, J. V. Emotional distress among long-term breast cancer survivors: The role of insomnia and worry. Behav. Psychol. 28, 533–549 (2020).
8. Lang-Rollin I Berberich G Psycho-oncology Dialogues Clin. Neurosci. 2022 20 30 22 10.31887/DCNS.2018.20.1/ilangrollin
Lang-Rollin, I. & Berberich, G. Psycho-oncology. Dialogues Clin. Neurosci. 20, 30–22. 10.31887/DCNS.2018.20.1/ilangrollin (2022).10.31887/DCNS.2018.20.1/ilangrollin
9. Beck AT Steer RA Brown GK Manual for the Beck Depression Inventory-II 1996 Psychological Corporation
Beck, A. T., Steer, R. A. & Brown, G. K. Manual for the Beck Depression Inventory-II (Psychological Corporation, 1996).
10. Hamilton M Assessment of Depression 1986 Springer
Hamilton, M. Assessment of Depression (Springer, 1986).
11. Spielberger CD Gorsuch RL Lushene RE STAI: Manual for the State Trait Anxiety Inventory (Self-Evaluation Questionnaire) 1970 Santa Clara Palo Alto
Spielberger, C. D., Gorsuch, R. L. & Lushene, R. E. STAI: Manual for the State Trait Anxiety Inventory (Self-Evaluation Questionnaire) (Palo Alto, Santa Clara, 1970).
12. Beck AT Epstein N Brown G Steer RA An inventory for measuring clinical anxiety: Psychometric properties J. Consult. Clin. Psychol. 1988 56 893 897 10.1037/0022-006X.56.6.893 3204199
Beck, A. T., Epstein, N., Brown, G. & Steer, R. A. An inventory for measuring clinical anxiety: Psychometric properties. J. Consult. Clin. Psychol. 56, 893–897. 10.1037/0022-006X.56.6.893 (1988).3204199 10.1037/0022-006X.56.6.893
13. Cohen S Kamarck T Mermelstein R A global measure of perceived stress J. Health Soc. Behav. 1983 24 385 396 10.2307/2136404 6668417
Cohen, S., Kamarck, T. & Mermelstein, R. A global measure of perceived stress. J. Health Soc. Behav. 24, 385–396. 10.2307/2136404 (1983).6668417 10.2307/2136404
14. Cohen S Williamson GM The Social Psychology of Health: Claremont Symposium on Applied Social Psychology 1988 Sage
Cohen, S. & Williamson, G. M. The Social Psychology of Health: Claremont Symposium on Applied Social Psychology (Sage, 1988).
15. Herschbach P Marten-Mittag B Henrich G Revision and psychometric properties of the Questionnaire on Stress in Cancer Patients (QSC-R23) Z. Med. Psychol. 2003 12 69 76
Herschbach, P., Marten-Mittag, B. & Henrich, G. Revision and psychometric properties of the Questionnaire on Stress in Cancer Patients (QSC-R23). Z. Med. Psychol. 12, 69–76 (2003).
16. Lee TY Hsing SC Li CC An improved stress-scale specifically designed to measure stress of women with newly diagnosed breast cancer Int. J. Environ. Res. Public Health 2021 18 2346 10.3390/ijerph18052346 33673627
Lee, T. Y., Hsing, S. C. & Li, C. C. An improved stress-scale specifically designed to measure stress of women with newly diagnosed breast cancer. Int. J. Environ. Res. Public Health 18, 2346. 10.3390/ijerph18052346 (2021).33673627 10.3390/ijerph18052346
17. Cerezo MV Soria-Reyes LM Pajares B Gómez-Millán J Blanca MJ Development and psychometric properties of the Stressors in Breast Cancer Scale Front. Psychol. 2023 14 1102169 10.3389/fpsyg.2023.1102169 37057161
Cerezo, M. V., Soria-Reyes, L. M., Pajares, B., Gómez-Millán, J. & Blanca, M. J. Development and psychometric properties of the Stressors in Breast Cancer Scale. Front. Psychol. 14, 1102169. 10.3389/fpsyg.2023.1102169 (2023).37057161 10.3389/fpsyg.2023.1102169
18. Zigmond AS Snaith RP The hospital anxiety and depression scale Acta Psychiatr. Scand. 1983 67 361 370 10.1111/j.1600-0447.1983.tb09716.x 6880820
Zigmond, A. S. & Snaith, R. P. The hospital anxiety and depression scale. Acta Psychiatr. Scand. 67, 361–370. 10.1111/j.1600-0447.1983.tb09716.x (1983).6880820 10.1111/j.1600-0447.1983.tb09716.x
19. Lovibond PF Lovibond SH The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the beck depression and anxiety inventories Behav. Res. Therapy 1995 33 335 343 10.1016/0005-7967(94)00075-U
Lovibond, P. F. & Lovibond, S. H. The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the beck depression and anxiety inventories. Behav. Res. Therapy 33, 335–343. 10.1016/0005-7967(94)00075-U (1995).10.1016/0005-7967(94)00075-U
20. Lovibond SH Lovibond PF Manual for the Depression Anxiety Stress Scales 1995 2 Psychology Foundation of Australia
Lovibond, S. H. & Lovibond, P. F. Manual for the Depression Anxiety Stress Scales 2nd edn. (Psychology Foundation of Australia, 1995).
21. Makara-Studzińska M Tyburski E Załuski M Adamczyk K Mesterhazy J Mesterhazy A Confirmatory factor analysis of three versions of the Depression Anxiety Stress Scale (DASS-42, DASS-21, and DASS-12) in Polish adults Front. Psychiatry 2022 10.3389/fpsyt.2021.770532 35058818
Makara-Studzińska, M. et al. Confirmatory factor analysis of three versions of the Depression Anxiety Stress Scale (DASS-42, DASS-21, and DASS-12) in Polish adults. Front. Psychiatry10.3389/fpsyt.2021.770532 (2022).35058818 10.3389/fpsyt.2021.770532
22. Biggs A Brough P Drummond S The Handbook of Stress and Health: A Guide to Research and Practice 2017 Wiley
Biggs, A., Brough, P. & Drummond, S. The Handbook of Stress and Health: A Guide to Research and Practice (Wiley, 2017).
23. Koh KB Stress and Somatic Symptoms: Biopsychosociospiritual Perspectives 2018 Springer
Koh, K. B. Stress and Somatic Symptoms: Biopsychosociospiritual Perspectives (Springer, 2018).
24. Bener A Alsulaiman R Doodson LG El Ayoubi HR Comparison of reliability and validity of the breast cancer Depression Anxiety Stress Scales (DASS-21) with the Beck Depression Inventory (BDI-II) and Hospital Anxiety and Depression Scale (HADS) Int. J. Behav. Res. Psychol. 2016 4 197 203 10.19070/2332-3000-1600035
Bener, A., Alsulaiman, R., Doodson, L. G. & El Ayoubi, H. R. Comparison of reliability and validity of the breast cancer Depression Anxiety Stress Scales (DASS-21) with the Beck Depression Inventory (BDI-II) and Hospital Anxiety and Depression Scale (HADS). Int. J. Behav. Res. Psychol. 4, 197–203. 10.19070/2332-3000-1600035 (2016).10.19070/2332-3000-1600035
25. Ruiz FJ Martín MB Falcón JCS González PO The hierarchical factor structure of the Spanish version of Depression Anxiety and Stress Scale 21 Int. J. Psychol. Psychol. Therapy 2017 17 97 105
Ruiz, F. J., Martín, M. B., Falcón, J. C. S. & González, P. O. The hierarchical factor structure of the Spanish version of Depression Anxiety and Stress Scale 21. Int. J. Psychol. Psychol. Therapy 17, 97–105 (2017).
26. Evans L Haeberlein K Chang A Handal P Convergent validity and preliminary cut-off scores for the Anxiety and Depression subscales of the DASS 21 in US adolescents Child Psychiatry Hum. Dev. 2021 52 579 585 10.1007/s10578-020-01050-0 32816139
Evans, L., Haeberlein, K., Chang, A. & Handal, P. Convergent validity and preliminary cut-off scores for the Anxiety and Depression subscales of the DASS 21 in US adolescents. Child Psychiatry Hum. Dev. 52, 579–585. 10.1007/s10578-020-01050-0 (2021).32816139 10.1007/s10578-020-01050-0
27. Ahmed O Faisal RA Alim SMAHM Sharker T Hiramoni FA The psychometric properties of the Depression Anxiety Stress Scale-21 (DASS 21) Bangla version Acta Psychol. 2022 223 103509 10.1016/j.actpsy.2022.103509
Ahmed, O., Faisal, R. A., Alim, S. M. A. H. M., Sharker, T. & Hiramoni, F. A. The psychometric properties of the Depression Anxiety Stress Scale-21 (DASS 21) Bangla version. Acta Psychol. 223, 103509. 10.1016/j.actpsy.2022.103509 (2022).10.1016/j.actpsy.2022.103509
28. Cao CH Liao XL Jiang XY Li XD Chen IH Lin CY Psychometric evaluation of the Depression, Anxiety, and Stress Scale-21 (DASS-21) among Chinese primary and middle school teachers BMC Psychol. 2023 11 209 10.1186/s40359-023-01242-y 37452365
Cao, C. H. et al. Psychometric evaluation of the Depression, Anxiety, and Stress Scale-21 (DASS-21) among Chinese primary and middle school teachers. BMC Psychol. 11, 209. 10.1186/s40359-023-01242-y (2023).37452365 10.1186/s40359-023-01242-y
29. Dreyer Z Henn C Hill C Validation of the Depression Anxiety Stress Scale-21 (DASS-21) in a non-clinical sample of South African working adults J. Psychol. Afr. 2019 29 346 353 10.1080/14330237.2019.1647499
Dreyer, Z., Henn, C. & Hill, C. Validation of the Depression Anxiety Stress Scale-21 (DASS-21) in a non-clinical sample of South African working adults. J. Psychol. Afr. 29, 346–353 (2019).10.1080/14330237.2019.1647499
30. Daza P Novy DM Stanley MA Averill P The Depression Anxiety Stress Scale-21: Spanish translation and validation with a Hispanic sample J. Psychopathol. Behav. Assess. 2002 24 195 205 10.1023/A:1016014818163
Daza, P., Novy, D. M., Stanley, M. A. & Averill, P. The Depression Anxiety Stress Scale-21: Spanish translation and validation with a Hispanic sample. J. Psychopathol. Behav. Assess. 24, 195–205. 10.1023/A:1016014818163 (2002).10.1023/A:1016014818163
31. Fonseca-Pedrero E Paino M Lemos-Giráldez S Muñiz J Psychometric properties of the Depression Anxiety and Stress Scales-21 (DASS-21) in Spanish college students Ansiedad y Estrés 2010 16 215 226
Fonseca-Pedrero, E., Paino, M., Lemos-Giráldez, S. & Muñiz, J. Psychometric properties of the Depression Anxiety and Stress Scales-21 (DASS-21) in Spanish college students. Ansiedad y Estrés 16, 215–226 (2010).
32. Park SH Validation of the 21-item Depression, Anxiety, and Stress Scales (DASS-21) in individuals with autism spectrum disorder Psychiatry Res. 2020 291 113300 10.1016/j.psychres.2020.113300 32763554
Park, S. H. et al. Validation of the 21-item Depression, Anxiety, and Stress Scales (DASS-21) in individuals with autism spectrum disorder. Psychiatry Res. 291, 113300. 10.1016/j.psychres.2020.113300 (2020).32763554 10.1016/j.psychres.2020.113300
33. Ali AM Psychometric evaluation of the Depression Anxiety Stress Scale 8-items (DASS-8)/DASS-12/DASS-21 among family caregivers of patients with dementia Front. Public Health 2022 10 1012311 10.3389/fpubh.2022.1012311 36388286
Ali, A. M. et al. Psychometric evaluation of the Depression Anxiety Stress Scale 8-items (DASS-8)/DASS-12/DASS-21 among family caregivers of patients with dementia. Front. Public Health 10, 1012311. 10.3389/fpubh.2022.1012311 (2022).36388286 10.3389/fpubh.2022.1012311
34. Kumar K Kumar S Mehrotra D Tiwari SC Kumar V Dwivedi RC Reliability and psychometric validity of Hindi version of Depression, Anxiety and Stress Scale-21 (DASS-21) for Hindi speaking head neck cancer and oral potentially malignant disorders patients J. Cancer Res. Ther. 2019 15 653 10.4103/jcrt.JCRT_281_17 31169235
Kumar, K. et al. Reliability and psychometric validity of Hindi version of Depression, Anxiety and Stress Scale-21 (DASS-21) for Hindi speaking head neck cancer and oral potentially malignant disorders patients. J. Cancer Res. Ther. 15, 653. 10.4103/jcrt.JCRT_281_17 (2019).31169235 10.4103/jcrt.JCRT_281_17
35. Moya E Larson LM Stewart RC Fisher J Mwangi MN Phiri KS Reliability and validity of Depression Anxiety Stress Scale (DASS)-21 in screening for common mental disorders among postpartum women in Malawi BMC Psychiatry 2022 22 352 10.1186/s12888-022-03994-0 35606733
Moya, E. et al. Reliability and validity of Depression Anxiety Stress Scale (DASS)-21 in screening for common mental disorders among postpartum women in Malawi. BMC Psychiatry 22, 352. 10.1186/s12888-022-03994-0 (2022).35606733 10.1186/s12888-022-03994-0
36. Henry JD Crawford JR The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample Br. J. Clin. Psychol. 2005 44 227 239 10.1348/014466505X29657 16004657
Henry, J. D. & Crawford, J. R. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. Br. J. Clin. Psychol. 44, 227–239. 10.1348/014466505X29657 (2005).16004657 10.1348/014466505X29657
37. Gómez R Summers M Summers A Wolf A Summers J Depression Anxiety Stress Scales-21: Measurement and structural invariance across ratings of men and women Assessment 2014 21 418 426 10.1177/1073191113514106 24486523
Gómez, R., Summers, M., Summers, A., Wolf, A. & Summers, J. Depression Anxiety Stress Scales-21: Measurement and structural invariance across ratings of men and women. Assessment 21, 418–426. 10.1177/1073191113514106 (2014).24486523 10.1177/1073191113514106
38. Kyriazos TA Stalikas A Prassa K Yotsidi V Can the Depression Anxiety Stress Scales Short be shorter? Factor structure and measurement invariance of DASS-21 and DASS-9 in a Greek, non-clinical sample Psychology 2018 9 1095 1127 10.4236/psych.2018.95069
Kyriazos, T. A., Stalikas, A., Prassa, K. & Yotsidi, V. Can the Depression Anxiety Stress Scales Short be shorter? Factor structure and measurement invariance of DASS-21 and DASS-9 in a Greek, non-clinical sample. Psychology 9, 1095–1127. 10.4236/psych.2018.95069 (2018).10.4236/psych.2018.95069
39. Pezirkianidis C Karakasidou E Lakioti A Stalikas A Galanakis M Psychometric properties of the Depression, Anxiety, Stress Scales-21 (DASS-21) in a Greek sample Psychology 2018 9 2933 2950 10.4236/psych.2018.915170
Pezirkianidis, C., Karakasidou, E., Lakioti, A., Stalikas, A. & Galanakis, M. Psychometric properties of the Depression, Anxiety, Stress Scales-21 (DASS-21) in a Greek sample. Psychology 9, 2933–2950. 10.4236/psych.2018.915170 (2018).10.4236/psych.2018.915170
40. Jovanović V Gavrilov-Jerković V Lazić M Can adolescents differentiate between depression, anxiety and stress? Testing competing models of the Depression Anxiety Stress Scales (DASS-21) Curr. Psychol. 2021 40 6045 6056 10.1007/s12144-019-00540-2
Jovanović, V., Gavrilov-Jerković, V. & Lazić, M. Can adolescents differentiate between depression, anxiety and stress? Testing competing models of the Depression Anxiety Stress Scales (DASS-21). Curr. Psychol. 40, 6045–6056. 10.1007/s12144-019-00540-2 (2021).10.1007/s12144-019-00540-2
41. Zanon C Examining the dimensionality, reliability, and invariance of the Depression, Anxiety, and Stress Scale–21 (DASS-21) across eight countries Assessment 2021 28 1531 1544 10.1177/1073191119887449 31916468
Zanon, C. et al. Examining the dimensionality, reliability, and invariance of the Depression, Anxiety, and Stress Scale–21 (DASS-21) across eight countries. Assessment 28, 1531–1544. 10.1177/1073191119887449 (2021).31916468 10.1177/1073191119887449
42. Fox RS Lillisb TA Gerhartb J Hoergerc M Dubersteind P Multiple group confirmatory factor analysis (CFA) of the DASS-21 Depression and Anxiety Scales: How do they perform in a cancer sample? Psychol. Rep. 2018 121 548 565 10.1177/0033294117727747 28836917
Fox, R. S., Lillisb, T. A., Gerhartb, J., Hoergerc, M. & Dubersteind, P. Multiple group confirmatory factor analysis (CFA) of the DASS-21 Depression and Anxiety Scales: How do they perform in a cancer sample?. Psychol. Rep. 121, 548–565. 10.1177/0033294117727747 (2018).28836917 10.1177/0033294117727747
43. Laranjeira C Querido A Sousa P Dixe MA Assessment and psychometric properties of the 21-item Depression Anxiety Stress Scale (DASS-21) among Portuguese Higher Education Students during the COVID-19 Pandemic Eur. J. Investig. Health Psychol. Educ. 2023 13 2546 2560 10.3390/ejihpe13110177 37998067
Laranjeira, C., Querido, A., Sousa, P. & Dixe, M. A. Assessment and psychometric properties of the 21-item Depression Anxiety Stress Scale (DASS-21) among Portuguese Higher Education Students during the COVID-19 Pandemic. Eur. J. Investig. Health Psychol. Educ. 13, 2546–2560. 10.3390/ejihpe13110177 (2023).37998067 10.3390/ejihpe13110177
44. Chen IH Psychometric properties of the Depression, Anxiety, and Stress Scale (DASS-21) among different Chinese populations: A cross-sectional and longitudinal analysis Acta Psychol 2023 240 104042 10.1016/j.actpsy.2023.104042
Chen, I. H. et al. Psychometric properties of the Depression, Anxiety, and Stress Scale (DASS-21) among different Chinese populations: A cross-sectional and longitudinal analysis. Acta Psychol 240, 104042. 10.1016/j.actpsy.2023.104042 (2023).10.1016/j.actpsy.2023.104042
45. Nilges P Essau C Depression, Anxiety, and Stress Scales: The DASS: A screening procedure not only for patients with chronic pain Schmerz 2015 29 649 657 10.1007/s00482-015-0019-z 26205682
Nilges, P. & Essau, C. Depression, Anxiety, and Stress Scales: The DASS: A screening procedure not only for patients with chronic pain. Schmerz 29, 649–657. 10.1007/s00482-015-0019-z (2015).26205682 10.1007/s00482-015-0019-z
46. Iannattone S Are anxiety, depression, and stress distinguishable in Italian adolescents? An examination through the Depression Anxiety Stress Scales-21 PLoS ONE 2024 19 e0299229 10.1371/journal.pone.0299229 38412147
Iannattone, S. et al. Are anxiety, depression, and stress distinguishable in Italian adolescents? An examination through the Depression Anxiety Stress Scales-21. PLoS ONE 19, e0299229. 10.1371/journal.pone.0299229 (2024).38412147 10.1371/journal.pone.0299229
47. McMullen M Factors associated with psychological distress amongst outpatient chemotherapy patients: An analysis of depression, anxiety and stress using the DASS-21 Appl. Nurs. Res. 2018 40 45 50 10.1016/j.apnr.2017.12.002 29579498
McMullen, M. et al. Factors associated with psychological distress amongst outpatient chemotherapy patients: An analysis of depression, anxiety and stress using the DASS-21. Appl. Nurs. Res. 40, 45–50. 10.1016/j.apnr.2017.12.002 (2018).29579498 10.1016/j.apnr.2017.12.002
48. Clover K Apples to apples? Comparison of the measurement properties of hospital anxiety and depression-anxiety subscale (HADS-A), depression, anxiety and stress scale-anxiety subscale (DASS-A), and generalised anxiety disorder (GAD-7) scale in an oncology setting using Rasch analysis and diagnostic accuracy statistics Curr. Psychol. 2020 41 4592 4601 10.1007/s12144-020-00906-x
Clover, K. et al. Apples to apples? Comparison of the measurement properties of hospital anxiety and depression-anxiety subscale (HADS-A), depression, anxiety and stress scale-anxiety subscale (DASS-A), and generalised anxiety disorder (GAD-7) scale in an oncology setting using Rasch analysis and diagnostic accuracy statistics. Curr. Psychol. 41, 4592–4601. 10.1007/s12144-020-00906-x (2020).10.1007/s12144-020-00906-x
49. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. The Standards for Educational and Psychological Testing (AERA Publications, Washington, DC, 2014).
50. Diener E Emmons R Larsen RJ Griffin S The satisfaction with life scale J. Pers. Assess. 1985 49 71 75 10.1207/s15327752jpa4901_13 16367493
Diener, E., Emmons, R., Larsen, R. J. & Griffin, S. The satisfaction with life scale. J. Pers. Assess. 49, 71–75. 10.1207/s15327752jpa4901_13 (1985).16367493 10.1207/s15327752jpa4901_13
51. Vázquez C Duque A Hervás G Satisfaction with Life Scale in a representative sample of Spanish adults: Validation and normative data Spanish J. Psychol. 2013 16 e82 1 15 10.1017/sjp.2013.82
Vázquez, C., Duque, A. & Hervás, G. Satisfaction with Life Scale in a representative sample of Spanish adults: Validation and normative data. Spanish J. Psychol. 16(e82), 1–15. 10.1017/sjp.2013.82 (2013).10.1017/sjp.2013.82
52. Diener E New well-being measures: Short scales to assess flourishing and positive and negative feelings Soc. Indic. Res. 2010 97 143 156 10.1007/s11205-009-9493-y
Diener, E. et al. New well-being measures: Short scales to assess flourishing and positive and negative feelings. Soc. Indic. Res. 97, 143–156. 10.1007/s11205-009-9493-y (2010).10.1007/s11205-009-9493-y
53. De la Fuente R Parra A Sánchez-Queija I Psychometric properties of the Flourishing Scale and measurement invariance between two samples of Spanish university students Eval. Health Prof. 2017 40 409 424 10.1177/0163278717703446 29096555
De la Fuente, R., Parra, A. & Sánchez-Queija, I. Psychometric properties of the Flourishing Scale and measurement invariance between two samples of Spanish university students. Eval. Health Prof. 40, 409–424. 10.1177/0163278717703446 (2017).29096555 10.1177/0163278717703446
54. Watson D Clark LA Tellegen A Development and validation of brief measures of positive and negative affect: The PANAS scales J. Pers. Soc. Psychol. 1988 54 1063 1070 10.1037/0022-3514.54.6.1063 3397865
Watson, D., Clark, L. A. & Tellegen, A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J. Pers. Soc. Psychol. 54, 1063–1070. 10.1037/0022-3514.54.6.1063 (1988).3397865 10.1037/0022-3514.54.6.1063
55. López-Gómez I Hervás G Vázquez C Adaptation of the Positive and Negative Affect Schedule (PANAS) in a general Spanish population Behav. Psychol. 2015 23 529 548
López-Gómez, I., Hervás, G. & Vázquez, C. Adaptation of the Positive and Negative Affect Schedule (PANAS) in a general Spanish population. Behav. Psychol. 23, 529–548 (2015).
56. Remor E Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS) Spanish J. Psychol. 2006 9 86 93 10.1017/S1138741600006004
Remor, E. Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS). Spanish J. Psychol. 9, 86–93. 10.1017/S1138741600006004 (2006).10.1017/S1138741600006004
57. Soria-Reyes LM Cerezo MV Alarcón R Blanca MJ Psychometric properties of the Perceived Stress Scale (PSS-10) with breast cancer patients Stress Health 2023 39 115 124 10.1002/smi.3170 35657280
Soria-Reyes, L. M., Cerezo, M. V., Alarcón, R. & Blanca, M. J. Psychometric properties of the Perceived Stress Scale (PSS-10) with breast cancer patients. Stress Health 39, 115–124. 10.1002/smi.3170 (2023).35657280 10.1002/smi.3170
58. Rosseel Y Lavaan: An R package for structural equation modeling J. Stat. Softw. 2012 48 1 36 10.18637/jss.v048.i02
Rosseel, Y. Lavaan: An R package for structural equation modeling. J. Stat. Softw. 48, 1–36. 10.18637/jss.v048.i02 (2012).10.18637/jss.v048.i02
59. Li C The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables Psychol. Methods 2016 21 369 387 10.1037/met0000093 27571021
Li, C. The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychol. Methods 21, 369–387. 10.1037/met0000093 (2016).27571021 10.1037/met0000093
60. Cohen J Statistical Power Analysis for the Behavioral Sciences 1988 2 Mahwah Lawrence Erlbaum Associates
Cohen, J. Statistical Power Analysis for the Behavioral Sciences 2nd edn. (Lawrence Erlbaum Associates, Mahwah, 1988).
61. Blanca MJ Alarcón R Arnau J Bono R Bendayan R Effect of variance ratio on ANOVA robustness: Might 15 be the limit? Behav. Res. Methods 2018 50 937 962 10.3758/s13428-017-0918-2 28643157
Blanca, M. J., Alarcón, R., Arnau, J., Bono, R. & Bendayan, R. Effect of variance ratio on ANOVA robustness: Might 15 be the limit?. Behav. Res. Methods 50, 937–962. 10.3758/s13428-017-0918-2 (2018).28643157 10.3758/s13428-017-0918-2
62. Lopes C Prevalence and persistence of anxiety and depression over five years since breast cancer diagnosis: The NEON-BC prospective study Curr. Oncol. 2022 29 2141 2153 10.3390/curroncol29030173 35323373
Lopes, C. et al. Prevalence and persistence of anxiety and depression over five years since breast cancer diagnosis: The NEON-BC prospective study. Curr. Oncol. 29, 2141–2153. 10.3390/curroncol29030173 (2022).35323373 10.3390/curroncol29030173
