
==== Front
Sci Rep
Sci Rep
Scientific Reports
2045-2322
Nature Publishing Group UK London

39251635
71116
10.1038/s41598-024-71116-9
Article
Establishing minimal clinically important differences for the quality of life scale QLICD-SLE for patients with systemic lupus erythematosus based on ROC curve
Liu Yuxi 12
Xue Honghong 34
Wong Wendy 5
Ding Haifeng 1
Chen Mingyang 6
Xie Tong 7
Wan Chonghua wanchh@hotmail.com

12
1 https://ror.org/04k5rxe29 grid.410560.6 0000 0004 1760 3078 Shunde Women and Children’s Hospital of Guangdong Medical University, Shunde, China
2 https://ror.org/04k5rxe29 grid.410560.6 0000 0004 1760 3078 School of Humanities and Management, Key Laboratory for Quality of Life and Psychological Assessment and Intervention, Guangdong Medical University, Dongguan, China
3 grid.410737.6 0000 0000 8653 1072 Huizhou Third People’s Hospital, Guangzhou Medical University, Huizhou, 516000 China
4 https://ror.org/00t33hh48 grid.10784.3a 0000 0004 1937 0482 School of Chinese Medicine, Hong Kong Institute of Integrative Medicine, Chinese University of Hong Kong, Sha Tin, China
5 grid.10784.3a 0000 0004 1937 0482 Hong Kong Institute of Integrative Medicine, Chinese University of Hong Kong, Sha Tin, China
6 Guangdong Prison Central Hospital, Guangzhou, 510430 China
7 https://ror.org/04k5rxe29 grid.410560.6 0000 0004 1760 3078 The Affiliated Hospital of Guangdong Medical University, Zhanjiang, 524001 China
9 9 2024
9 9 2024
2024
14 2098219 9 2023
26 8 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by-nc-nd/4.0/ Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
The minimal clinically important difference (MCID) is an important concept with big appeal in a field struggling to interpret quality of life (QOL) and other patient-reported outcomes (PRO), is also a bridge between statistics and clinical medicine. This study uses the ROC curve to formulate the MCID value of the Quality of Life Instruments for Chronic Diseases of Systemic lupus erythematosus (QLICD-SLE V2.0) scale. Using the representative item “In general, would you say your health is” of the MOS item short form health survey(SF-36) as an anchor, the questionnaire of QLICD-SLE V2.0 and the anchor item were used to investigate the patients on the first day of hospitalization, and the day before the patient was discharged. 279 patients with lupus erythematosus were participated in this longitudinal follow-up study. The ROC curve was constructed by using the classification based on the anchor item as the gold standard and the difference score of the scale as the test variable. The cut-off point corresponding to the maximum value of the Youden index in the ROC curve is taken as the minimum clinical importance difference (MCID) value of the QLICD-SLE (V2.0) scale. The Results showed that the MCID of physical domain, psychological domain, social domain, general module, specific module and QLICD-SLE (V2.0) total scale are 8.3, 2.3, 2.5, 2.7, 9.2 and 3.2, respectively. Area under the ROC curve of QLICD-SLE (V2.0) is 0.898, P (Area = 0.5) < 0.001, the sensitivity is 100%, the specificity is 66.9%. It concluded that if the total scores after treatments changes at least 3.2 points positively, the treatment intervention can be considered as clinically significant. It is more convincing to use the corresponding cut-off point as the MCID for ROC curve method can visualize the sensitivity and specificity.

Keywords

Systemic lupus erythematosus
MCID value
ROC curve
Sensitivity
Specificity
Subject terms

Diseases
Medical research
Rheumatology
the National Natural Science Foundation of China71373058 Wan Chonghua issue-copyright-statement© Springer Nature Limited 2024
==== Body
pmcIntroduction

Systemic lupus erythematosus (SLE) is an autoimmune inflammatory connective tissue disease that affects multiple organs in young women1.The highest incidence of SLE is in North America, with a prevalence rate of 241/100,000/year. Asian and Hispanic ethnic groups have middle incidence. SLE is a chronic progressive autoimmune disease that is easily recurrent and affects multiple systems. Studies found that the death of the SLE patients in Chinese population had higher concurrent infection and serious complications2,3. Corticosteroids and immunosuppressants remain the main treatment strategies for SLE when disease progress. With the new development of stem cell transplantation or biological agents from cell or molecular biology in the treatment of the SLE, the clinical outcomes benchmark was catching attention4.

To evaluate the clinical outcomes of SLE, Quality of life (QOL) or patient-reported outcomes (PRO) is often been used to evaluate the effect for medical decision. Both generic and disease specific QOL instruments are used to investigate the changes of SLE patients in clinical practice. Although generic QOL instruments such as the Brief Version of World Health Organization Quality of Life WHOQOL-BREF, SF-36 are commonly adopted for chronic diseases or tumors patients, the results were found to be less sensitive or irrelevant to patients5. Consequently, some specific QOL/PRO instruments were developed for SLE patients, including SLE symptom checklist (SSC)6, the SLE Quality of Life Questionnaire (SLEQOL)7, Lupus Quality of Life (LupusQol)8, the SLE Quality of Life Scale (L-QoL)9 etc.

In China, the prevalence of SLE is higher than that in Western countries, and the mortality rate in the past is very high. The 10-year survival rate is greater than 80%, but there is no cure, and patients need long-term medication. There is also an urgent need for quality of life measurement and assessment. However, due to cultural dependency on quality of life, the existed QOL scales are not very suitable for Chinese. For example, the family relationship and kinship play very important roles in daily life in Chinese culture. Taoism and traditional medicine focus on good temper and high spirit. Good appetite, sleep, and energy are highly regarded in daily life. As a result, our QOL team developed a system entitled Quality of Life Instruments for Chronic Diseases (QLICD), which included a general module (QLICD-GM), and some specific modules for different diseases10,11. The latest version of the system QLICD (V2.0) contained 34 chronic disease-specific scales11, including QLICD-SLE(V2.0) for Systemic Lupus Erythematosus12 etc. Among them, the QLICD-SLE(V2.0) was developed by combining the 28 items general module of chronic diseases (QLICD-GM) and the 19 items specific module of SLE and confirmed good psychometric properties, with the QLICD-GM being classified into three domains of physical function (9 items), psychological function (11 items), and social function (8 items)12.

For evaluating of clinical outcomes, the interpretation of the Quality of life and clinical efficacy questionnaire score is particularly important13,14. However, the benchmark of QOL/PRO of calculation of scores that collected from subjective feeling somehow would still give statistical but not clinical meaningful changes. Therefore, the calculation of minimum clinical importance difference (MCID) by the anchor and distribution methods was highly recommended internationally13,14. Up to now, there is also great terminological confusion and controversy about the terms MCID, MID (Minimal importance difference) and MIC (Minimal important change) etc14–17. In this paper, we prefer to MCID and its classical definition in 1987 for it provides more powerful evidence for the interpretation of clinical conclusions, and it reflects the clinical significance of the smallest change in scores, in which MCID is defined as the minimum questionnaire dimension score change recognized by the patient without considering side effects and costs, it is a bridge between statistics and clinical establishment relationship13,14. According to the literature18–22, there are two traditional methods for calculating MCID, including anchor-based methods and distribution-based methods. The advantage of anchor-based methods is that clinical indicators can be used as anchors for calculating MCID, but the disadvantage is that it is difficult to find a suitable anchor having higher correlation with scores.

The MCID value has not been established for the QLICD-SLE (V2.0), although the MCID in determining the medical decision or important for predicting the prognosis of SLE is important. This study is aimed to explore the recently presented ROC method23 to calculate the MCID value of the QLICD-SLE (V2.0) for it has much more advantages23,24, in which an anchor item was used as the gold standard, and patients were grouped according to the results of the anchor item to construct ROC curve and calculate MCID of the QLICD-SLE (V2.0).

Methods

Participants

SLE patients who were diagnosed and followed up during their consultation at the Hospital of Kunming Medical University and Zhanjiang hospital were recruited to the participants. The recruitment was started from 2018.9 to 2019.5.

Inclusion criteria: (1) cognitive and physical capable of self-completion of questionnaire; (2) agreed to participate in the survey with the sought of informed consent from a trained research assistant.

Exclusion criteria: Subjects were excluded according to the following exclusion criteria: (1) diagnosed of any mental illness who could not facilitate the self-completion of the questionnaire; (2) cognitive impairment, those who cannot fill in the questionnaire themselves; (3) refused to participate in the research.

Survey methods

This project was reviewed by the Ethics Committee of Guangdong Medical University and Kunming Medical University and found that the qualifications and experience of the project investigator met the requirements, and the research plan and the subject selection plan were in line with scientific and ethical principles. The investigators explained the aims of the trial and the instrument to the patients older than 16 years and obtained informed consent from those patients who agreed to participate in the study and met with the inclusion criteria. The informed consent has been obtained from their parents for study participation for minors under 16 years old. All methods are carried out in accordance with relevant guidelines and regulations.

With the consent being sought of the subjects, they completed the QLICD-SLE (V2.0) scale and the anchor item on the day of admission. Respondents answered completely according to their actual situation. The completed questionnaires were checked immediately by research assistant to ensure no missing value. If any missing items were found, subjects would be asked for completion for follow up assessment. The patients were asked to complete the same questionnaire before the discharge.

The anchor item come from the first item Q1 in the SF-36 scale “overall, your health: (1) Excellent, (2) very good, (3) good, (4) fair, (5) poor”, and thus has five categories and five points.

Scoring methods

The QLICD-SLE (V2.0) contains 47 items, of which 19 items focused on the symptoms of SLE while 28 items for reflection of the physical psychological and social health12. Each question adopts a 5-level scoring method, in which forward questions (that is, as the score increases, the higher the quality of life) is directly based on the original score to calculate 1, 2, 3, 4, 5 points, and the reverse question (that is, as the score increases, the lower the quality of life), the score will be reversed, that is, 5, 4, 3, 2, 1, score. Add the scores of all the items included in each domain to get the score of this domain, and add the scores of all the items included in the scale to get the score of the total scale.

In order to compare the scores of different domains with each other, the raw scores of all domains and the overall are converted into standard scores ranging from 0 to 100 by the formula S = (X-Min) × 100/R, S is the standard score, and X is the raw score, Min is the minimum score of the domain or total scale, R is the range of the domain or total scale (that is, the difference between the maximum score and the minimum score)10,12.

Statistical methods

The primary outcome of this study was to establish the MCID for the QLICD-SLE(V2.0). The specific steps for formulating MCID using ROC curve as recommended and adopted here23:

Anchor-based grouping

If the patient had the same answer on the anchor item on the first day of hospitalization as the day before discharge, they were classified as "no change group". If the answer on the anchor item on the first day of hospitalization and the day before discharge of the patient had changed at least 1 point, they were classified as an "improvement group" or vice versa “deterioration group". Anchor groups were classified according to the changes in the options of anchor item before and after treatments, which are called anchor grouping.

As the first item Q1 in the SF-36 being the anchor, it was classified into three categories: "improvement group = 1 + 2", "no change group = 3 + 4", and "deterioration group = 5".

Determine what MCID to calculate

The aim of this study is to calculate MCID values, and this article clarifies that the minimum clinical importance improvement value will be established, for which patients in the improvement group and no change group will be included in the study. The upper 95% upper limit of the distribution map of the "no change" group is defined as the value with significant improvement (MCID), and the calculation formula is as follows: MCID = Meanchange + 1.645SDchange, and the minimum value of the no change group and its upper limit of 95% are the value range of the MCID value.

Construction of ROC curve

The anchor item was used as the gold standard of classification. The cut-off points in the range of values were used for the test classification, and the sensitivity and specificity of each cut-off point were calculated. Draw points with 1-specificity was used as the abscissa and sensitivity for the ordinate. The cut-off point when the Youden index in the ROC curve was the largest would be estimate as the MCID value.

Medcalc software is used for the statistical analysis of this study. In terms of sample size, according to the article of Hanley et al25., the minimum sample size required for ROC calculation is 172 patients (an error = 0.10; power = 0.90). It is estimated by the variation of the total score of the QLICD-SLE(V2.0) using Medcalc software, and can also basically meet requirement for all domains because of all of them ranging from 0 to 100. Considering a 5% loss rate, this part of the study requires 181 patients at least.

Results

Basic information on the sample

279 patients participated in two measurements before and after treatments and were used to establish MCID. The basic information of 279 patients was shown in Table 1. The sample consisted of 54.1% of age < 30 years old, 28.7% of age 30–39. Most SLE patients were female (92.1%), Han nationality (93.2%) and married (62.9%). Table 1 Characteristics of the Sample (n = 279).

Characteristics	N	%	Characteristics	N	%	
Gender	Marital status	
 Male	22	7.9	 Married	166	59.5	
 Female	257	92.1	 Others	113	40.5	
Ethnic groups	Medical insurance	
 Han	260	93.2	 Self-paid	117	41.9	
 Others	19	6.8	 Partly public insurance	78	28.0	
			 Public insurance	84	30.1	
Age	Occupation	
  < 30	151	54.1	 Factory worker	46	16.5	
 30–39	80	28.7	 Farmer	73	26.2	
 40–49	31	11.1	 Teacher	14	5.0	
 50–59	11	3.9	 Office-bearer	10	3.6	
  ≥ 60	6	2.2	 Others	136	48.7	
Incomea	Treatments	
 Poor	102	36.6	 Hormone joint immunosuppressant	202	72.4	
 Fair	168	60.2	 Hormone	61	21.9	
 High	8	2.9	 immunosuppressant	1	0.4	
 Missing	1	0.4	 Other	15	5.4	
Education				
 Primary school	30	10.8				
 High school	186	66.6				
 College or higher	63	22.6				
athis is evaluated by patients himself/herself according to their perceptions.

The average time between the two assessment time points was 73 days with minimum 3 days and maximum 379 days.

QOL Scores of patients with SLE

The score of QLICD-SLE (V2.0) at baseline, follow-up assessment and the corresponding changes were shown in Table 2. It can be seen that the score of the QLICD-GM before treatments is 66.0 ± 13.8,, and the score after treatments is 65.6 ± 13.7. QLICD-GM was a score that reflects the physiological, psychological, and social functions of a patient, with a wide coverage, so the score was greatly affected by many factors. The score of the specific module was 66.7 ± 13.6. before treatment and 67.1 ± 13.4. The score of the patient-specific module has improved after treatment, which means that the patient’s disease has improved after treatment. The same goes for the total scale score. Table 2 Standard score of QLICD-SLE(V2.0) and Correlations with Anchor (n = 279).

Domains/Modules	Before treatment	After treatment	Differences	Anchor-item	
Mean	SD	Mean	SD	Mean	SD	Correlation(r)	
Physical domain	66.3	14.2	67.7	12.4	1.4	11.9	0.46	
Psychological domain	61.0	18.7	60.1	18.2	-0.9	14.3	0.37	
Social domain	72.4	16.0	70.7	17.4	-1.7	13.2	0.37	
Sub-Total (QLICD-GM)	66.0	13.8	65.6	13.7	-0.4	10.4	0.47	
Specific module	66.7	13.6	67.1	13.4	1.6	12.1	0.27	
Total (QLICD-SLE)	66.3	14.2	67.7	12.4	0.4	9.3	0.43	
Sub-total is the sum of the three domains of the QLICD-GM (general module), Total (QLICD-SLE) is the sum of the QLICD-GM and the specific module.

Patient’s distribution and correlation by anchor

The number of patients in each category of the anchor at two assessment time points was presented in Table 3. Table 3 The number of patients in each category of the anchor at two assessment time points (n = 279).

	1. Excellent	2. Very good	3. Good	4. Fair	5. Poor	
Before treatments	4	20	55	150	50	
After treatments	2	24	59	144	50	

The correlation coefficient between the anchor item and the total score of QLICD-SLE(V2.0) scale was 0.43, and the correlation coefficient with the physiological domain, psychological domain, social domain, and specific module for systemic lupus erythematosus were 0.46, 0.37, 0.37, 0.27, respectively. These correlation coefficients were also showed in Table 2 in detail.

Group and QOL scores based on the anchor

In this study, the correlation coefficient between the score of the patient anchor and the total score of the scale was 0.43. It is generally considered that the correlation is greater than 0.3. Depending on the changes in the scores of the anchor item before and after treatment, the patients were divided into 3 groups. 56 of the 279 patients, the anchor item score after treatment minus the anchor item score before treatment was greater than 0. Therefore, these patients were included in improvement group and the mean value of the score difference of the QLICD-SLE (V2.0) was 4.7 ± 10.5. 169 of the 279 patients, the anchor item score after treatment minus the anchor item score before treatment was 0. Therefore, these patients were included in No change group and the mean value of the score difference of the QLICD-SLE (V2.0) was 0.3 ± 8.1. 54 patients had a negative change after treatment with mean value of the score difference of the QLICD-SLE (V2.0) being − 3.4 ± 10.0.

The score information of different domains of the QLICD-SLE (V2.0) by groupings on anchor was shown in Table 4. Table 4 Difference in scores of scale QLICD-SLE(V2.0) under anchor grouping (n = 279).

Domains/Modules	Anchor-based grouping	N	Minimum	Maximum	Mean	SD	
Physical domain	Improvement group	56	− 22.2	47.2	5.5	14.1	
No change group	169	− 27.8	36.1	1.5	10.7	
Worsening group	54	− 30.6	33.3	− 3.3	11.8	
Psychological domain	Improvement group	56	− 34.1	50.0	4.0	15.4	
No change group	169	− 50.0	50.0	− 1.4	14.0	
Worsening group	54	− 40.9	20.5	− 4.3	13.3	
Social domain	Improvement group	56	− 28.1	25.0	1.3	10.2	
No change group	169	− 53.1	65.6	− 1.7	14.4	
Worsening group	54	− 34.4	18.8	− 4.9	11.6	
Sub-total (QLICD-GM)	Improvement group	56	− 24.1	36.6	3.7	10.9	
No change group	169	− 38.4	29.5	− 0.6	9.9	
Worsening group	54	− 27.7	14.3	− 4.1	9.7	
Specific module	Improvement group	56	− 17.1	48.7	6.0	13.6	
No change group	169	− 38.2	32.9	1.5	10.1	
Worsening group	54	− 34.2	51.3	− 2.4	14.8	
Total (QLICD-SLE)	Improvement group	56	− 17.6	41.5	4.7	10.5	
No change group	169	− 27.7	17.6	0.3	8.1	
Worsening group	54	− 21.8	29.3	− 3.4	10.0	
Sub-total is the sum of the three domains of the QLICD-GM (general module), Total (QLICD-SLE) is the sum of the QLICD-GM and the specific module.

MCID values estimate by the ROC for the QLICD-SLE (V2.0)

The area under the curve (AUC) of the QLICD-SLE (V2.0) were greater than 0.8 and the p < 0.001. The cut-off point was 3.2 of QLICD-SLE (V2.0) (sensitivity = 100%, specificity = 66.9%). In other words, before and after treatment, the QLICD-SLE (V2.0) score should increase by at least 3.2 points before the treatment was considered effective. Therefore, the MCID of the total score of QLICD-SLE (V2.0) was estimated as 3.2.

Similarly, if it is only for the Specific domain of patients with systemic lupus erythematosus, the score must be increased by at least 9.2 points (sensitivity = 75.0%, specificity = 82.8%) before clinical treatment was considered meaningful. The results of MCID values corresponding to different domains in the scale were shown in Table 5. It can be seen that the MCID of physical domain, psychological domain, social domain, QLICD-GM, specific domain and total of QLICD-SLE (V2.0) were 8.3, 2.3, 2.5, 2.7, 9.2 and 3.2, respectively. Table 5 MCIDs estimation of the QLICD-SLE and relevant indicators by ROC curve method (n = 181).

Indicators	Value	
Physical domain	Psychological domain	Social domain	Sub-total (QLICD-GM)	Specific module	Total (QLICD-SLE)	
Area under the ROC curve (AUC)	0.822	0.826	0.820	0.886	0.843	0.898	
Significance level P (Area = 0.5)	 < 0.001	 < 0.001	 < 0.001	 < 0.001	 < 0.001	 < 0.001	
Youden index J	0.489	0.580	0.556	0.680	0.578	0.669	
Associated criterion (MCID)	8.3	2.3	2.5	2.7	9.2	3.2	
Sensitivity	66.7%	100%	91.7%	100%	75.0%	100%	
Specificity	82.3%	57.9%	63.9%	68.1%	82.8%	66.9%	
Sub-total is the sum of the three domains of the QLICD-GM (general module), Total (QLICD-SLE) is the sum of the QLICD-GM and the specific module.

The ROC curves of the specific module and the total scale were shown in Figs. 1 and 2, respectively.Fig. 1 ROC graph of the QLICD-SLE (The sensitivity VS 100-specificity of the QLICD-SLE). Blue solid line: Fitted curve, Blue dotted line: 95% confidence interval of ROC curve, Red solid line: Random line, meaningless.

Fig. 2 ROC graph of the Specific domain (The sensitivity VS 100-specificity of the specific domain of the QLICD-SLE). Blue solid line: Fitted curve, Blue dotted line: 95% confidence interval of ROC curve, Red solid line: Random line, meaningless.

Discussions

In China, there are few reports on the development of quality of life scales for patients with systemic lupus erythematosus. Therefore, our QOL research team developed the QLICD-SLE (V2.0) by modular approach with some advantages12. However, the MCID value is not established for this systemic lupus erythematosus scale. In this study, the MCID value was established by the ROC curve method, which further made up for the shortcomings in the actual application of the scale and facilitated the clinical evaluation of the patient's treatment effect through the change of the scale score.

There are four common methods for calculating MCID values, such as anchor-based method, distribution-based method, etc15,22. In recent years, due to the shortcomings of traditional methods, Roc curve method, multiple regression method, etc. were proposed. With the combination of illustrating the sensitivity and specificity in the same graph, the Roc curve method can facilitate the statistically interpretation with high accuracy26,27. And thus the method was recommended to formulate the MCID in other important PRO instruments such as Wu et al28. use ROC curve calculating MCID for work productivity and activity impairment (WPAI) questionnaire.

In the ROC curve, the cut-off point corresponding to the maximum Youden index has relatively high sensitivity and specificity. Compared with the traditional methods for formulating MCID values, the ROC curve-based method effectively combines the advantages of the anchor method and the distribution method. ROC curve-based method takes into account measurement errors and makes full use of the sample size as much as possible.

The anchor selection is very important for ROC curve method. In practice, it is difficult to find a very appropriate anchor and different anchors will also produce different results. Some literatures29 pointed out that using the data of the entire cohort to construct the ROC curve, the accuracy of formulating the MCID is higher. It is believed that the sufficiency of the anchor is strong if the correlation coefficient between the scale score and the anchor score is greater than 0.322. In this study, the correlation coefficient between the score of the anchor and the total score of QLICD-SLE (V2.0) before the treatment is 0.43. And the correlation coefficients between the score of the anchor and all domain scores was greater than 0.30 (exception of the specific module 0.27). Therefore, the anchor item is suitable for using as a comprehensive indicator to reflect the overall health of patients with systemic lupus erythematosus.

To formulate the minimum clinically significant improvement difference of the QLICD-SLE (V2.0) scale, patients were divided into three different groups according to the changes in the response of the anchor items before and after treatment. According to Table 4, the mean value for different groups of the total score of QLICD-SLE (V2.0) were: + 4.7 (improved group) >  + 0.30(no change group) > -3.4(deteriorated group). This trend is also the same for all domain scores and it implied the grouping of patients based on anchor item was feasible. For easy reference, the negative items in the scale were transformed positively, making the scale score more easily interpreted with the patient's health status. If the treatment is clinically meaningful to the patient, the patient's health will also be improved. After the treatment, the patient's score on the QLICD-SLE (V2.0) scale should be higher than before the treatment, that is, after the treatment. The scale's standardized score minus before treatment should be positive. In this study, the difference was used as the test variable, and the classification based on the anchor item was used as the gold standard to construct the ROC curve.

The MCID of the total score of QLICD-SLE (V2.0) is 3.2. The patient's scale score after treatment is at least 3.2 points higher than that before treatment, and the clinical treatment is considered meaningful. At the domain level, the MCID of physical domain, psychological domain, social domain, QLICD-GM, specific module were 8.3, 2.3, 2.5, 2.7, 9.2, respectively, and these values likewise have the meaning of the lowest score limit. It should be noted that these thresholds are meant for interpreting patient-level data (within-patient change), but not for interpreting mean differences between patient groups or mean change over time. Through MCID determination, it is possible to further explore the different treatment methods, which is more effective and other research.

It should be noted that this paper has also some limitations. First, this paper only focuses on the MCID of improvement, but not MCID of deterioration because of small sample size. Theoretically, ROC curve method can be also used to establish MCID of deterioration group if it has sufficient sample size. Second, this research only explores to establish MCID by ROC curve method. Other methods can also be used to formulate MCID such as anchor-based method, the distribution-based method and the response cumulative distribution function method20,30. Our next research will compute and compare all MCID results of these methods. Additionally, the samples of this study mainly come from the southern cities of Guangdong and Yunnan province with being no statistical difference in the scores of patients in the two regions before treatment (t = 1.600, p = 0.111). The economic situation in southern China is relatively good, and the population flow is relatively large. Selecting patients from the above areas for investigation can reflect the status of patients with lupus erythematosus in the Chinese system to a certain extent. Anyhow, a large sample of patients from other locations is needed to obtain more stable MCID values.

To sum up, formulating MCID value based on ROC curve as a new method has both advantages and disadvantages. The ROC curve intuitively combines sensitivity with specificity and accurately reflects the specificity and sensitivity of an analytical method. However, in the formulation of MCID, an appropriate anchor needs to be selected as the classification gold standard. The MCID value of the total score of QLICD-SLE (V2.0) developed in this study is 3.2, which can assist in determining whether the treatment has a clinical effect on SLE patients. However, due to the number of study subjects and the limitations of the survey points, the effectiveness of its promotion and use needs further verification.

Conclusion

The formulation of the scale MCID has always been the main concern of the questionnaire application. Existing methods for formulating MCID values, such as the anchor-based method and the distribution-based method, have advantages and disadvantages. Today, the ROC curve method has some significant advantages, but some patients will be lost due to the inclusion principle and require larger data support. Although imperfect, it is better than existing methods to a certain extent. The shortcomings of the ROC curve in formulating the MCID value are shown in the following aspects: (1) How to define the minimum change interval, whether to change one point or more points. (2) One of the keys to formulating MCID for ROC curve is the selection of an appropriate anchor. This does not have an accurate conclusion. Therefore, the formulation of the MCID value still needs to refer to the values of various methods for comprehensive evaluation.

Abbreviations

QOL Quality of life

QLICD-SLE (V2.0) Quality of life instruments for chronic diseases of systemic lupus erythematosus

SF-36 The MOS item short from health survey

MCID Minimal clinically important differences

Acknowledgements

The authors would like to thank the affiliated hospital of Guangdong Medical University and the First Affiliated Hospital of Hospital of Kunming Medical University for their support of this study and for their active cooperation.

Author contributions

C.W. and Y.L. designed the study. M.C., RH.CD., T.X. performed the data collection. C.W., Y.L. and H.X. performed data analyses, and all authors contributed to interpreting the data. C.W., H.X. and W.W. wrote the first draft, which was critically revised by all others. All authors have read and approved the final manuscript.

Funding

Funded by the National Natural Science Foundation of China (71373058) and the Guangdong Science and Technology Program (2013B021800074).

Data availability

All datasets collected and analyzed in this survey will be available from the corresponding author upon reasonable request.

Competing interests

The authors declare no competing interests.

Ethical approval

The study protocol was approved by the Institutional Review Board (IRB) of the first affiliated hospital of Guangdong medical university (PJ2013037). The investigators explained the aims of the trial and the instrument to the patients older than 16 years and obtained informed consent from those patients who agreed to participate in the study and met with the inclusion criteria. The informed consent has been obtained from their parents for study participation for minors under 16 years old.

Consent to participate

A complete assurance was given that all information would be kept confidential. The right was given to the patients not to participate and to discontinue participation in the study with consideration/without penalty. The Declaration of Helsinki’s ethical guidelines were followed in the study.

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

These authors contributed equally: Yuxi Liu and Honghong Xue.
==== Refs
References

1. Ding FM Cohort Study and Preliminary Study on Mechanism of Systemic Lupus Erythematosus with Early Onset Atherosclerosis 2016 Peking Union Medical College
Ding, F. M. Cohort Study and Preliminary Study on Mechanism of Systemic Lupus Erythematosus with Early Onset Atherosclerosis (Peking Union Medical College, 2016).
2. You Y Research progress of systemic lupus erythematosus in 2017 Dermatol. Venereol. 2018 40 02 176 177
You, Y. Research progress of systemic lupus erythematosus in 2017. Dermatol. Venereol. 40(02), 176–177 (2018).
3. Dong GF Ye RG Zhang X Chen WL Epidemiological study on concurrent infections of systemic lupus erythematosus Chin. J. Nosocomiol. 2004 07 39 42
Dong, G. F., Ye, R. G., Zhang, X. & Chen, W. L. Epidemiological study on concurrent infections of systemic lupus erythematosus. Chin. J. Nosocomiol. 07, 39–42 (2004).
4. Doward, L.C., Whalley. D., Dewar, A.L., McKenna, S.P., et al. The development of the SLE-QoL: A quality of life instrument specific to systemic lupus erythematosus. Poster presented at the 6th Annual Conference of the International Society for Quality of Life Research (ISOQOL); November 1999. Barcelona, Spain. Qual Life Res. (1999); 8(7):609.
5. Fan JF Shen Y Efficacy and evaluation of a new treatment method for systemic lupus erythematosus Chin. J. Pract. Pediatrics 2012 27 09 663
Fan, J. F. & Shen, Y. Efficacy and evaluation of a new treatment method for systemic lupus erythematosus. Chin. J. Pract. Pediatrics 27(09), 663 (2012).
6. Grootscholten C Ligtenberg G Derksen RH Health-related quality of life in patients with systemic lupus erythematosus: Development and validation of a lupus specific symptom checklist Qual. Life Res. 2003 12 6 635 644 10.1023/a:1025176407776 14516173
Grootscholten, C. et al. Health-related quality of life in patients with systemic lupus erythematosus: Development and validation of a lupus specific symptom checklist. Qual. Life Res. 12(6), 635–644. 10.1023/a:1025176407776 (2003).14516173 10.1023/a:1025176407776
7. Leong KP Kong KO Thong BY Development and preliminary validation of a systemic lupus erythematosus-specific quality of life instrument(SLEQOL) Rheumatology 2005 44 1267 76 10.1093/rheumatology/keh605 15797980
Leong, K. P. et al. Development and preliminary validation of a systemic lupus erythematosus-specific quality of life instrument(SLEQOL). Rheumatology 44, 1267–76. 10.1093/rheumatology/keh605 (2005).15797980 10.1093/rheumatology/keh605
8. McElhone K Abbott J Shelmerdine J Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus Arthritis Rheum. 2007 57 6 972 979 10.1002/art.22881 17665467
McElhone, K. et al. Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus. Arthritis Rheum. 57(6), 972–979. 10.1002/art.22881 (2007).17665467 10.1002/art.22881
9. Doward LC McKenna SP Whalley D The development of the L-QoL: A quality-of-life instrument specific to systemic lupus erythematosus Ann. Rheum. Dis. 2009 68 2 196 200 10.1136/ard.2007.086009 18385276
Doward, L. C. et al. The development of the L-QoL: A quality-of-life instrument specific to systemic lupus erythematosus. Ann. Rheum. Dis. 68(2), 196–200. 10.1136/ard.2007.086009 (2009).18385276 10.1136/ard.2007.086009
10. Wan C Tu X Messing S Development and validation of the general module of the system of quality of life instruments for chronic diseases and its comparison with SF-36 J. Pain Symptom Manag. 2011 42 93 104 10.1016/j.jpainsymman.2010.09.024
Wan, C. et al. Development and validation of the general module of the system of quality of life instruments for chronic diseases and its comparison with SF-36. J. Pain Symptom Manag. 42, 93–104 (2011).10.1016/j.jpainsymman.2010.09.024
11. Wan CH Li XM Yang Z Development and applications of the system of quality of life instruments for chronic diseases QLICD China Sci. Technol. Achiev. 2019 20 17 26 28
Wan, C. H. et al. Development and applications of the system of quality of life instruments for chronic diseases QLICD. China Sci. Technol. Achiev. 20(17), 26–28 (2019) (in Chinese).
12. Liu Y Zhang J Xue H Development and validation of the systemic lupus erythematous scale amongst the system of quality of life instruments for chronic diseases QLICD-SLE (V2.0) Health Qual. Life Outcomes 2023 21 1 128 10.1186/s12955-023-02205-y 38017437
Liu, Y. et al. Development and validation of the systemic lupus erythematous scale amongst the system of quality of life instruments for chronic diseases QLICD-SLE (V2.0). Health Qual. Life Outcomes 21(1), 128. 10.1186/s12955-023-02205-y (2023).38017437 10.1186/s12955-023-02205-y
13. Guyatt GH Walter S Norman G Measuring change over time: Assessing the usefulness of evaluative instruments J. Chronic Dis. 1987 40 2 171 178 10.1016/0021-9681(87)90069-5 3818871
Guyatt, G. H., Walter, S. & Norman, G. Measuring change over time: Assessing the usefulness of evaluative instruments. J. Chronic Dis. 40(2), 171–178. 10.1016/0021-9681(87)90069-5 (1987).3818871 10.1016/0021-9681(87)90069-5
14. Wyrwich K Bullinger M Aaronson N Estimating clinically significant differences in quality of life outcomes Qual. Life Res. 2005 14 2 285 95 10.1007/s11136-004-0705-2 15892420
Wyrwich, K. et al. Estimating clinically significant differences in quality of life outcomes. Qual. Life Res. 14(2), 285–95. 10.1007/s11136-004-0705-2 (2005).15892420 10.1007/s11136-004-0705-2
15. Dekker J de Boer M Ostelo R Minimal important change and difference in health outcome: An overview of approaches, concepts, and methods Osteoarthritis Cartilage. 2024 32 1 8 17 10.1016/j.joca.2023.09.002 37714259
Dekker, J., de Boer, M. & Ostelo, R. Minimal important change and difference in health outcome: An overview of approaches, concepts, and methods. Osteoarthritis Cartilage. 32(1), 8–17. 10.1016/j.joca.2023.09.002 (2024).37714259 10.1016/j.joca.2023.09.002
16. Jaeschke R Singer J Guyatt GH Measurement of health status. Ascertaining the minimal clinically important difference Control Clin. Trials 1989 10 4 407 415 10.1016/0197-2456(89)90005-6 2691207
Jaeschke, R., Singer, J. & Guyatt, G. H. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin. Trials 10(4), 407–415. 10.1016/0197-2456(89)90005-6 (1989).2691207 10.1016/0197-2456(89)90005-6
17. Osoba D Rodrigues G Myles J Zee B Pater J Interpreting the significance of changes in health-related quality-of-life scores J. Clin. Oncol. 1998 16 1 139 144 10.1200/JCO.1998.16.1.139 9440735
Osoba, D., Rodrigues, G., Myles, J., Zee, B. & Pater, J. Interpreting the significance of changes in health-related quality-of-life scores. J. Clin. Oncol. 16(1), 139–144. 10.1200/JCO.1998.16.1.139 (1998).9440735 10.1200/JCO.1998.16.1.139
18. Guyatt GH Osoba D Wu AW Methods to explain the clinical significance of health status measures Mayo Clin. Proc. 2002 77 4 371 383 10.4065/77.4.371 11936935
Guyatt, G. H. et al. Methods to explain the clinical significance of health status measures. Mayo Clin. Proc. 77(4), 371–383. 10.4065/77.4.371 (2002).11936935 10.4065/77.4.371
19. Chan LS Minimal clinically important difference (MCID)–adding meaning to statistical inference Am. J. Public Health. 2013 103 11 e24 e25 10.2105/AJPH.2013.301580 24028251
Chan, L. S. Minimal clinically important difference (MCID)–adding meaning to statistical inference. Am. J. Public Health. 103(11), e24–e25. 10.2105/AJPH.2013.301580 (2013).24028251 10.2105/AJPH.2013.301580
20. Coon CD Cook KF Moving from significance to real-world meaning: methods for interpreting change in clinical outcome assessment scores Qual. Life Res. 2018 27 1 33 40 10.1007/s11136-017-1616-3 28620874
Coon, C. D. & Cook, K. F. Moving from significance to real-world meaning: methods for interpreting change in clinical outcome assessment scores. Qual. Life Res. 27(1), 33–40. 10.1007/s11136-017-1616-3 (2018).28620874 10.1007/s11136-017-1616-3
21. Barrett B Brown R Mundt M Comparison of anchor-based and distributional approaches in estimating important difference in common cold Qual. Life Res. 2008 17 1 75 85 10.1007/s11136-007-9277-2 18027107
Barrett, B., Brown, R. & Mundt, M. Comparison of anchor-based and distributional approaches in estimating important difference in common cold. Qual. Life Res. 17(1), 75–85. 10.1007/s11136-007-9277-2 (2008).18027107 10.1007/s11136-007-9277-2
22. Revicki D Hays RD Cella D Sloan J Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes J. Clin. Epidemiol. 2008 61 2 102 109 10.1016/j.jclinepi.2007.03.012 18177782
Revicki, D., Hays, R. D., Cella, D. & Sloan, J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J. Clin. Epidemiol. 61(2), 102–109. 10.1016/j.jclinepi.2007.03.012 (2008).18177782 10.1016/j.jclinepi.2007.03.012
23. Angst F Aeschlimann A Angst J The minimal clinically important difference raised the significance of outcome effects above the statistical level, with methodological implications for future studies J. Clin. Epidemiol. 2017 82 128 136 10.1016/j.jclinepi.2016.11.016 27986610
Angst, F., Aeschlimann, A. & Angst, J. The minimal clinically important difference raised the significance of outcome effects above the statistical level, with methodological implications for future studies. J. Clin. Epidemiol. 82, 128–136. 10.1016/j.jclinepi.2016.11.016 (2017).27986610 10.1016/j.jclinepi.2016.11.016
24. de Vet HC Ostelo RW Terwee CB Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach Qual. Life Res. 2007 16 1 131 142 10.1007/s11136-006-9109-9 17033901
de Vet, H. C. et al. Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Qual. Life Res. 16(1), 131–142 (2007).17033901 10.1007/s11136-006-9109-9
25. Hanley JA Mcneil BJ The meaning and use of the area under a receiver operating characteristic (Roc) curve Radiology 1982 143 1 29 36 10.1148/radiology.143.1.7063747 7063747
Hanley, J. A. & Mcneil, B. J. The meaning and use of the area under a receiver operating characteristic (Roc) curve. Radiology 143(1), 29–36 (1982).7063747 10.1148/radiology.143.1.7063747
26. Chen WZ Pan XP Song XB Ni ZX Selection of the best working point in ROC curve China Health Statist. 2006 02 157 8
Chen, W. Z., Pan, X. P., Song, X. B. & Ni, Z. X. Selection of the best working point in ROC curve. China Health Statist. 02, 157–8 (2006).
27. Song HL He J Yu HT Li L Evaluation and comparison of two related diagnostic tests using the area under the ROC curve J. Second Military Med. Univ. 2006 05 562 563
Song, H. L., He, J., Yu, H. T. & Li, L. Evaluation and comparison of two related diagnostic tests using the area under the ROC curve. J. Second Military Med. Univ. 05, 562–563 (2006).
28. Wu JJ Lin C Sun L Minimal clinically important difference (MCID) for work productivity and activity impairment (WPAI) questionnaire in psoriasis patients J. Eur. Acad. Dermatol. Venereol. 2019 33 2 318 324 10.1111/jdv.15098 29846976
Wu, J. J. et al. Minimal clinically important difference (MCID) for work productivity and activity impairment (WPAI) questionnaire in psoriasis patients. J. Eur. Acad. Dermatol. Venereol. 33(2), 318–324. 10.1111/jdv.15098 (2019).29846976 10.1111/jdv.15098
29. Turner D Schünemann HJ Griffith LE Using the entire cohort in the receiver operating characteristic analysis maximizes precision of the minimal important difference J. Clin. Epidemiol. 2009 62 4 374 379 10.1016/j.jclinepi.2008.07.009 19013766
Turner, D. et al. Using the entire cohort in the receiver operating characteristic analysis maximizes precision of the minimal important difference. J. Clin. Epidemiol. 62(4), 374–379. 10.1016/j.jclinepi.2008.07.009 (2009).19013766 10.1016/j.jclinepi.2008.07.009
30. Wyrwich KW Norquist JM Lenderking WR Methods for interpreting change over time in patient-reported outcome measures Qual. Life Res. 2013 22 3 475 483 10.1007/s11136-012-0175-x 22528240
Wyrwich, K. W. et al. Methods for interpreting change over time in patient-reported outcome measures. Qual. Life Res. 22(3), 475–483 (2013).22528240 10.1007/s11136-012-0175-x
