
==== Front
Mult Scler J Exp Transl Clin
Mult Scler J Exp Transl Clin
MSO
spmso
Multiple Sclerosis Journal - Experimental, Translational and Clinical
2055-2173
SAGE Publications Sage UK: London, England

10.1177/20552173241272561
10.1177_20552173241272561
Review
Effectiveness of cognitive rehabilitation in comparison with routine rehabilitation methods in patients with multiple sclerosis: A systematic review and meta-analysis
Rayegani Seyed Mansoor
Physical Medicine and Rehabilitation Research Center, 556492 Shahid Beheshti University of Medical Sciences , Tehran, Iran
Heidari Saeed
Social Development and Health Promotion Research Center, 48464 Kermanshah University of Medical Sciences , Kermanshah, Iran
Seyed-Nezhad Maryam
National Center for Health Insurance Research, Tehran, Iran
Kiyani Narges
State Welfare Organization of Iran, Kermanshah, Iran
https://orcid.org/0000-0002-9190-3429
Moradi-Joo Mohammad
Social Determinants of Health Research Center, 154206 Yasuj University of Medical Sciences , Yasuj, Iran
Mohammad Moradi-Joo, Social Determinants of Health Research Center, Yasuj University of Medical Sciences, Yasuj, Iran moradijoo@gmail.com
12 9 2024
Jul-Sep 2024
10 3 205521732412725616 4 2023
17 7 2024
© The Author(s), 2024
2024
SAGE Publications Ltd unless otherwise noted. Manuscript content on this site is licensed under Creative Commons Licenses
https://creativecommons.org/licenses/by-nc/4.0/ This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
Introduction

Cognitive rehabilitation includes a set of programs to train the brain, which leads to the improvement of mental and neuro-psychological functions. This meta-analysis was conducted with the aim of investigating the effectiveness of cognitive rehabilitation in comparison with routine rehabilitation methods in patients with multiple sclerosis (MS).

Methods

The Cochrane Library, ProQuest, PubMed, PsycINFO, and Web of Science databases were searched from inception to August 2022. Google Scholar was used to find relevant sources and complete the search coverage. Two authors independently selected studies based on predefined inclusion criteria. Data analysis was performed using RevMan (version 5.3).

Results

Out of the 578 studies found, 20 studies were finally included in this review. The results of the meta-analysis on four outcomes (Paced Auditory Serial Addition Test (PASAT), Brief Visuospatial Memory Test (BVMT), MS Neuropsychological Screening Questionnaire (MSNQ), and Beck Depression Inventory (BDI)) indicated that the outcome was significant in favor of the cognitive rehabilitation group. However, for five outcomes (Controlled Oral Word Association Test (COWAT), California Verbal Learning Test (CVLT), Everyday Memory Questionnaire (EMQ), Symbol Digit Modalities Test (SDMT), and Expanded Disability Status Scale (EDSS)), the differences between the two groups were not significant.

Conclusion

The results of this meta-analysis showed that cognitive rehabilitation has an effect on improving the performance of patients with MS. However, further studies with more accurate methodologies are required to determine which of the outcomes cognitive rehabilitation has a greater effect on.

Multiple sclerosis
cognitive rehabilitation
effectiveness
systematic review
meta-analysis
typesetterts19
cover-dateJuly-September 2024
==== Body
pmcIntroduction

Multiple sclerosis (MS) is a chronic, immune-mediated, demyelinating disorder of the central nervous system (CNS). MS can cause a wide range of potential symptoms, including problems with vision, arm or leg movement, sensation or balance. Although the course is highly variable, many people develop irreversible disability and MS remains a major cause of neurological disability in young adults. 1

Cognitive rehabilitation includes a set of programs to train the brain, which leads to the improvement of a person's mental and neuro-psychological functions. As a result, personal progress is made in areas such as education, job and social relations. 2 Cognitive impairment is a common clinical feature of MS in the early and later stages of the disease,3,4 and its prevalence is between 43 and 70%.5,6 Studies have shown that MS negatively affects various aspects of cognitive function, including aspects related to attention, information processing efficiency, executive function, processing speed, new learning, and memory. 7 Cognitive dysfunction is closely related to functional status in MS. Rao et al. 6 found that people with MS who were cognitively impaired participated less in social and professional activities, were less employed, had more problems in doing routine household chores, and they were more vulnerable to mental illnesses than people with physical disabilities. Functional impairments also include difficulties with independent shopping, completing household chores, cooking, driving and using public transportation. 8 Such changes in the personal, professional and social lives of patients have a detrimental effect on their quality of life (QoL). For this reason, the development of therapeutic measures to alleviate such deficits should be a priority in MS research. 9

The aim of cognitive rehabilitation is to reduce cognitive deficits and improve patients’ awareness, the ability to consider their cognitive deficits in daily life activities and promote neurobiological changes. Historically, most of the interventions implemented for MS patients involved learning and memory-based interventions, but more recently, the focus has shifted to other domains such as executive function and attention, as these cognitive functions have the greatest impact. 9

Many interventional studies have evaluated the effectiveness of cognitive rehabilitation treatments in relation to cognitive deficits in MS, but the number of systematic review studies and meta-analysis were few in this field. Therefore, this meta-analysis was conducted with the aim of investigating the effectiveness of cognitive rehabilitation in comparison with routine rehabilitation methods in patients with MS.

Methods

This systematic review and meta-analysis studies are reported based on the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. 10

Search strategy

This review considered all relevant literature published in English from inception to August 2022. The following five databases were searched: Cochrane Library; ProQuest; PubMed; PsycINFO; and Web of Science. Google Scholar was used to find relevant sources and complete the search coverage. Two independent reviewers conducted the search based on the search strategy. This strategy was adapted for the different databases as required. Search terms related to “cognitive rehabilitation” and “multiple sclerosis” were entered into the title, abstract and keyword fields. The studies obtained from the electronic search and manual search were organized using EndNote software.

Study selection

Articles obtained from all databases were searched and entered into EndNote 20, and duplicates were removed. Two authors independently selected studies based on predefined inclusion criteria. Titles and abstracts were reviewed first, and irrelevant studies were excluded. Then, the authors screened the full text. Any disagreements were resolved by discussion among the two authors with the possibility to involve a third author as a consultant to make a final decision.

Eligibility criteria

All studies published in English that evaluated cognitive rehabilitation in patients with MS were included. Moreover, the excluded articles met the following criteria: 1. The study was not an intervention. 2. The minimum follow-up time was 2 weeks. 3. The study was not an empirical study. 4. The intervention was not targeting a cognitive domain. 5. The article was not in English. 6. The article included populations other than those with MS.

Data extraction and quality assessment

Data were extracted via Microsoft Forms into an Excel spreadsheet. The two reviewers used the same data extraction sheet to report the following aspects: study information (title, publication year and first author), country of the study population, study design, number of participants, patient demographics, follow-up period and main findings.

Study quality was assessed by two independent reviewers. The quality assessment of included studies was performed using the Cochrane quality assessment tool and RevMan 5.3 software. In this tool, five important types of bias (selection bias, performance bias, detection bias, attrition bias and reporting bias) that are likely to occur in clinical trial studies were investigated.

Statistical analysis

The Cochrane Collaboration's Review Manager Program (RevMan version 5.3, Cochrane collaboration) was used for data analysis. Mean differences (MDs) and corresponding 95% confidence intervals (CIs) were estimated by a fixed-effect meta-analysis. A random-effect meta-analysis was used if heterogeneity is more than 50%. The chi-square test for Q and the I2 quantity were used to test heterogeneity between studies. Significant results were considered if the P-value for the chi-square test was ≤0.1 and I2 ≥ 50%. 10

Results

Study selection and study characteristics

The PRISMA flowchart shows the identification, screening, eligibility and inclusion phases of the literature search (Figure 1). The search returned 643 studies. After removing duplicates, 578 studies remained. After screening of titles and abstracts, the full text of 89 studies was assessed for eligibility.

Figure 1. Flow diagram for the selection of studies for the systematic review and meta-analysis (PRISMA diagram).

In the 20 studies included in the meta-analysis, the number of participants ranged from 10 to 93, the follow-up times of the results ranged from 2 weeks to 1 year, and the average age of the participants ranged from 30 to 55 years. These studies were conducted between 2007 and 2020. Of these 20 studies, 4 studies were published in the United States, 7 studies in Italy, 3 studies in the United Kingdom, 2 studies in Germany, 1 study in Finland, 1 study in Switzerland, 1 study in Greece, and 1 study in Iran. Table 1 shows the main characteristics, and Table 2 shows the outcomes and main results of the 20 included studies.

Table 1. Main characteristics of included studies.

First Author	Year	Country	Mean Age ± SD	Number of Patients	Follow-up	Reference	
CR Group	No CR Group	CR Group	No CR Group	
Stuifbergen AK	2012	USA	47.9 ± 8.8	47.9 ± 8.8	34	27	5 months	11	
Stuifbergen AK	2018	USA	49.6 ± 8.0	49.6 ± 8.0	93	90	8 weeks	12	
Janssen A	2015	USA	49.43 ± 6.4	44.93 ± 8.8	14	14	8 weeks	13	
Vogt A	2009	Switzerland	43.20 ± 8.80	46.27 ± 10.53	15	15	4 weeks	14	
Cerasa A	2013	Italy	31.7 ± 9.2	33.7 ± 10.3	12	11	6 weeks	15	
Mäntynen A	2014	Finland	43.5 ± 8.7	44.1 ± 8.8	58	40	13 weeks	16	
Campbell J	2016	UK	46.21 ± 6.59	48.53 ± 9.63	17	18	6 weeks	17	
Impellizzeri F	2020	Italy	51.73 ± 10.145	51.33 ± 7613	15	15	8 weeks	18	
Mattioli F	2015	Italy	43	45	22	19	2 weeks	19	
Mattioli F	2016	Italy	44.88 ± 9.96	44.80 ± 8.69	15	17	6 months	20	
Fink F	2010	Germany	44.8 ± 8.2	44.8 ± 8.2	11	14	12 months	21	
Hildebrandt H	2007	Germany	42.4	36.5	17	25	6 weeks	22	
Messinis L	2017	Greece	46.03 ± 7.97	45.15 ± 9.65	32	26	10 weeks	23	
De Giglio L	2014	Italy	44.64 ± 7.63	42.99 ± 9.42	18	17	8 weeks	24	
Mattioli F	2010	Italy	44	42	10	10	9 weeks	25	
Mattioli F	2012	Italy	46.90 ± 10.24	45.46 ± 10.48	13	11	6 weeks	26	
Chiaravalloti ND	2005	USA	45.14 ± 13.78	46 ± 9.28	14	14	11 weeks	27	
Das Nair R	2012	UK	49.5 ± 9.0	42.9 ± 8.9	23	21	7 months	28	
Carr SE	2014	UK	55.8 ± 10.2	52.9 ± 11.8	21	21	8 months	29	
Shahpouri MM	2019	Iran	32.21	30.46	28	28	3 months	30	

Table 2. Outcomes and main results of included studies.

First Author	Outcomes	Main Results	
Stuifbergen AK 11	A: Performance Outcomes Controlled Oral Word Association Test (COWAT)

California Verbal Learning Test (CVLT)

Brief Visuospatial Memory Test (BVMT)

Judgment of Line Orientation Test (JLO)

Paced Auditory Serial Addition Test (PASAT)

Symbol Digit Modalities Test (SDMT)

Sorting Test from the Delis-Kaplan Executive Function System (DKEFS)

B: Self-Report Outcomes MS Neuropsychological Screening Questionnaire (MSNQ)

Control Subscale of the MS Self-Efficacy Scale (MSSE-Control)

Subscale of the Multifactorial Memory Questionnaire (MMQ)

	Both groups improved significantly (P < .05) over time on most measures in the MACFIMS battery as well as the measures of strategy use and neuropsychological competence in ADLs. There was a significant group × time interaction for scores on measures of verbal memory and the use of compensatory memory strategies.	
Stuifbergen AK 12	A: Cognitive Performance Outcomes Controlled Oral Word Association Test (COWAT)

California Verbal Learning Test (CVLT)

Brief Visuospatial Memory Test (BVMT)

Paced Auditory Serial Addition Test (PASAT)

Symbol Digit Modalities Test (SDMT)

B: IADL Performance Outcome Everyday Problems Test (EPT)

C: Self-Report Outcomes 17-item General Self-Efficacy Scale

10-item Center for Epidemiologic Studies Depression Scale (CES-D)

Subscale of the Multifactorial Memory Questionnaire (MMQ)

	Both groups improved significantly on all outcome measures. The intervention group outperformed the comparison group on all measures, and there were statistically significant differences on selected measures.	
Janssen A 13	A: Cognitive Variables Paced Auditory Serial Addition Test (PASAT)

Symbol Digit Modalities Test (SDMT)

Selective Reminding Test (SRT)

Word List Generation Task (WLGT)

Visual Memory 10/36

B: Clinical Variables Expanded Disability Status Scale (EDSS)

Beck Depression Inventory (BDI)

Wechsler Test of Adult Reading (WTAR)

Disease Duration (years)

Neuropsychological Assessment

	The results indicated an overall improvement in skill acquisition and evidence for the feasibility of the intervention, but a lack of broad transfer to tasks of cognitive functioning. Participants in the training group, however, did show improvements on a measure of spatial short-term memory.	
Vogt A 14	A: Working Memory & Short-Term Memory Corsi Blocks Backward & Borward

Digit Span Backward & Forward

2-Back, Numbers Correct & Omissions, Reaction Time

Paced Auditory Serial Addition Test (PASAT)

B: Mental Speed Faces Symbol Test (FST)

Symbol Digit Modalities Test (SDMT)

C: Questionnaires Fatigue Scale for Motor and Cognitive Functions (FSMC) (Fatigue)

Modified Fatigue Impact Scale (MFIS) (Fatigue)

Allgemeine Depressionsskala (ADS) (Depression)

Functional Assessment of MS (FAMS) (Quality of Life)

	In the outcome measures training for both intervention groups led to significantly improved fatigue symptoms, as well as working memory, and mental speed performances. Log files recorded during training showed a similar increase in levels of difficulty for both intervention groups as training progressed. No effects were found on short-term memory, quality of life or depression.	
Cerasa A 15	A: Neurocognitive Performances Selective Reminding Test (SRT)

Spatial Recall Test (SPART)

Word List Generation (WLG)

Symbol Digit Modalities Test (SDMT)

Paced Auditory Serial Addition Test (PASAT)

Trail Making Test (TMT)

State-Trait Anxiety Inventory (STAI)

Beck Depression Inventory (BDI)

B: Functional Scales Fatigue Severity Scale (FSS)

Expanded Disability Status Scale (EDSS)

	Significant effects were detected both at a phenotypic and at an intermediate phenotypic level. After CR, the experimental group, in comparison with the control group, showed specific enhanced performance in attention abilities as assessed by the Stroop task with an effect size of 0.88, which was associated with increased activity in the posterior cerebellar lobule and in the superior parietal lobule	
Mäntynen A 16	A: Cognitive Performance Outcomes Controlled Oral Word Association Test (COWAT)

Paced Auditory Serial Addition Test (PASAT)

Stroop (Colour Naming Time)

Trail Making Test

Buschke Selective Reminding Test (BSRT)

B: Self-Rating Questionnaires Mood Beck Depression Inventory (BDI)

Multiple Sclerosis Impact Scale (MSIS)

Multiple Sclerosis Neuropsychological Questionnaire (MSNQ)

The World Health Organization Quality of Life (WHOQOL)

Fatigue Scale for Motor and Cognitive Fatigue (FSMC)

	Neuropsychological rehabilitation including computer-based attention and working memory retraining, psychoeducation, strategy learning and psychological support did not improve cognitive performance but had a positive effect on perceived cognitive deficits. The intervention group perceived significantly fewer deficits than the control group both immediately after the intervention and at six months. The personal rehabilitation goals were also well achieved.	
Campbell J 17	A: Performance Outcomes Symbol Digit Modalities Test (SDMT)

California Verbal Learning Test (CVLT)

Brief Visuospatial Memory Test (BVMT)

B: Self-Report Outcomes Quality of Life: EuroQOL Five-Dimension Questionnaire (EQ-5D)

Quantitative Magnetization Transfer (QMT)

	The treatment group showed greater improvement in SDMT gain scores between baseline and time 2 compared to the control group (P = 0.005). The treatment group exhibited increased activation in the bilateral prefrontal cortex and right temporoparietal regions relative to control group at time 3 (P < 0.05 FWE corrected). No significant changes were observed in QMT	
Impellizzeri F 18	A: Neuropsychological Tests Word List Generation (WLG)

Paced Auditory Serial Addition Test (PASAT)

Symbol Digit Modalities Test (SDMT)

Spatial Recall Test (SPART)

Selective Reminding Test (SRT)

Delayed Recall of the 10/36 Spatial Recall Test (SPART)

B: Self-Rating Questionnaires Multiple Sclerosis Quality of Life (MSQOL)

Beck Depression Inventory (BDI)

Emotion Awareness Questionnaire (EAQ)

McClelland Motivational Factors (MF)

	Both the groups benefit from 8 weeks of CR. In particular, the EG got better results in cognitive function, with regard to selective reminding test long-term storage (P < .000), long-term retrieval (P = .007), and delayed recall of the 10/36 spatial recall test (P = .001), as compared with the CG. Moreover, the improvement in emotional status, motivation, mood and quality of life (with regard to the mental component; P < .000) was more evident in the EG.	
Mattioli F 19	A: Neuropsychological Tests Paced Auditory Serial Addition Test (PASAT)

Spatial Recall Test (SPART)

Selective Reminding Test (SRT)

Symbol Digit Modalities Test (SDMT)

Controlled Oral Word Association Test (COWAT)

Stroop

B: Self-Rating Questionnaires Multiple Sclerosis Quality of Life (MSQOL)

Fatigue Impact Scale (FIS)

	After 1 year, the mean number of pathological tests was significantly lower in the specific treatment group, compared to the aspecific group. Memory and attention/speeded information processing functions were mostly improved. Depression and quality of life were not different between groups at follow-up.	
Mattioli F 20	A: Neuropsychological Tests Paced Auditory Serial Addition Test (PASAT)

Spatial Recall Test (SPART)

Selective Reminding Test (SRT)

Symbol Digit Modalities Test (SDMT)

Controlled Oral Word Association Test (COWAT)

Stroop

B: Self-Rating Questionnaires Multiple Sclerosis Quality of Life (MSQOL)

Fatigue Impact Scale (FIS)

Expanded Disability Status Scale (EDSS)

Montgomery-Asberg Depression Rating Scale (MADRS)

	Results revealed that both at 1 and at 2 years follow-up, more patients in the aspecific group (18/19, 94% and 13/17, 76%, respectively) than in the specific group (11/22, 50% and 5/15, 33% respectively) resulted to be cognitively impaired. Furthermore, patients belonging to the specific group showed significantly less impaired tests compared with the aspecific group ones (p = 0.02) and a significant amelioration in the majority of tests. On the contrary patients in the aspecific group did not change. The specific group subjects also perceived a subjective improvement in their cognitive performance, while the aspecific group patients did not.	
Fink F 21	California Verbal Learning Test (CVLT)

	The treatment effect on verbal learning was still present at the 1-year follow-up. Baseline brain atrophy, quantified by the brain parenchymal fraction, was associated with treatment effects for one aspect of executive functioning.	
Hildebrandt H 22	A: Neuropsychological Investigation California Verbal Learning Test (CVLT)

Auditory Serial Addition Test (PASAT)

Object Alternation

B: Rating Scales Quality of Life: SF-12

Beck's Depression Score

Fatigue Severity Scale

C: Clinical Investigations Expanded Disability Status Scale (EDSS)

Multiple Sclerosis Functional Composite Score (MSFC)

	Training had no effect on neurological status, QoL or fatigue. However, the treatment group showed better verbal learning, long delay verbal memory performance, and working memory performance. The impact of treatment on long-delay verbal memory performance was independent of the extent of brain atrophy, whereas for other findings brain atrophy played a significant role.	
Messinis L 23	A: Performance Outcomes Selective Reminding Test (SRT)

Brief Visuospatial Memory Test (BVMT)

Greek Verbal Fluency Test (VFT)

Symbol Digit Modalities Test (SDMT)

Greek Trail Making Test (TMT)

Stroop Neuropsychological Screening Test(SNST)

	Only the IG showed significant improvements in verbal and visuospatial episodic memory, processing speed/attention, and executive functioning from pre- to post-assessment. Moreover, the improvement obtained on attention was retained over 6 months providing evidence of the long-term benefits of this intervention.	
De Giglio L 24	A: Cognitive Outcomes Stroop Test

Auditory Serial Addition Test (PASAT)

Symbol Digit Modalities Test (SDMT)

B: Fatigue Outcomes Modified Fatigue Impact Scale (MFIS)

C: Quality-of-Life Outcomes 54-Item MS Quality of Life Questionnaire (MSQoL-54)

	Fifty-two patients were screened for eligibility; 35 (mean [standard deviation] age of 43.9 [8.4] years, median EDSS score of 2.0, range = 2.0–6.0) were randomly assigned to the intervention group (n = 18) or wait-list control group (n = 17). ANCOVA analysis showed a significant effect of the DKBT on ST (F = 5.027; P = .034; F2 = 0.210), SDMT (F = 4.240; P = .049; F2 = 0.177), and on some subscales of the MSQOL-54. The PASAT and cognitive subscales of the MFIS also showed improvement, but this was just not significant (F = 4.104, P = .054, F2 = 0.171, and F = 4.226, P = .054, F2 = 0.237, respectively).	
Mattioli F 25	A: Neuropsychological Tests Paced Auditory Serial Addition Test (PASAT)

Selective Reminding Test (SRT)

Symbol Digit Modalities Test (SDMT)

Controlled Oral Word Association Test (COWAT)

Wisconsin Card Sorting Test (WCST)

Test of Everyday Attention (TEA)

B: Self-Rating Questionnaires Multiple Sclerosis Quality of Life (MSQOL)

Expanded Disability Status Scale (EDSS)

Montgomery-Asberg Depression Rating Scale (MADRS)

	After rehabilitation, only the SG significantly improved in tests of attention, information processing and executive functions (PASAT 3″ P = 0.023, PASAT 2″ P = 0.004, WCST-te P = 0.037), as well as in depression scores (MADRS P = 0.01). Neuropsychological improvement was unrelated to depression improvement in regression analysis.	
Mattioli F 26	A: Neuropsychological Tests Paced Auditory Serial Addition Test (PASAT)

Selective Reminding Test (SRT)

Symbol Digit Modalities Test (SDMT)

Controlled Oral Word Association Test (COWAT)

Wisconsin Card Sorting Test (WCST)

Test of Everyday Attention (TEA)

B: Self-Rating Questionnaires Multiple Sclerosis Quality of Life (MSQOL)

Montgomery-Asberg Depression Rating Scale (MADRS)

	Nine months of follow-up compared to baseline evaluation shows statistically significant improvements (P < 0.05) in attention, information processing and executive functions tests (PASAT3” COWA/S, WCST-pe), in depression and quality of life questionnaires in rehabilitated patients only. Reliable change index (RCI) and modified RCI confirmed the clinical significance of this improvement in rehabilitated patients.	
Chiaravalloti ND 27	A: Performance Outcomes Controlled Oral Word Association Test (COWAT)

Paced Auditory Serial Addition Test (PASAT)

Oral Trail Making Test (OTMT)

Hopkins Verbal Learning Test-Revised (HVLT)

Symbol Digit Modalities Test (SDMT)

Digit Span Forward & Backward

B: Self-Report Outcomes Beck Depression Inventory (BDI)

Memory Functioning Questionnaire (MFQ)

	MS participants with moderate/severe impairment in learning showed a significant improvement in learning abilities when compared to controls (t (19)_/3.32, PB/0.01), evident in 88% of participants in the experimental group. Little improvement was noted in MS participants with mild learning impairments. Significant self-reported improvements in memory were noted in MS participants who underwent treatment, but not in those who did not undergo treatment (t (26) _/2.55, PB/0.01).	
Das Nair R 28	Everyday Memory Questionnaire (EMQ)

Rivermead Behavioral Memory Test – Extended

General Health Questionnaire-12 (GHQ-12)

Extended Activities of Daily Living

Internal Memory Aids Questionnaire

External Memory Aids Questionnaire

Wimbledon Self-Report Scale

Mental Adjustment to Brain Injury

	There were 72 participants (mean age 47.7, SD 10.2 years; 32 men). There was no significant effect of treatment on the EMQ (P = 0.97).	
Carr SE 29	MS Impact Scale (MSIS)

General Health Questionnaire 28 (GHQ-28)

Everyday Memory Questionnaire (EMQ)

	Forty-eight participants were recruited. They were aged 34–72 years (mean 54.3, SD 11.0), and 33 (69%) were women. There were no significant differences between the two groups on the EMQ or MS Impact Scale (P > 0.05) at four or eight months after randomization. However, the intervention group reported significantly better mood than controls on the GHQ-28 at eight months (P = 0.04).	
Shahpouri MM 30	Everyday Memory Questionnaire (EMQ)

Prospective and Retrospective Memory Questionnaire (PRMQ)

Digit Span Memory

Beck Depression Inventory (BDI)

QOL-54 Questionnaire

	Memory, attention, QoL, and depression improved significantly following the intervention in cases (P < 0.05), while no significant change was observed among controls (P > 0.05). Comparison of cases and controls in the second evaluation showed a significant difference between cases and controls (P < 0.05).	
QoL: quality of life.

Risk of bias assessment

The results of the evaluation of the quality of the studies showed that, in general, all 20 included studies have an acceptable quality (Figure 2).

Figure 2. Risk of bias summary of studies included: low risk of bias, high risk of bias, and unclear risk).

Meta-analyses

Performance outcomes (cognitive function)

Auditory processing speed and flexibility

Paced Auditory Serial Addition Test (PASAT). This test is typically used to assess information processing and sustained and divided attention. In this task, subjects are presented with a number every 2, 3 or 4 s and they are asked to add the number they have heard now with the number they have heard before and say it out loud. Studies have shown that in addition to being challenging, this task is also stressful.

Primary data related to the outcome of PASAT were reported in 13 studies.11–16,18–20,24–27 The results of the meta-analysis of these studies with a sample size of 333 patients in the cognitive rehabilitation group and 300 patients in the control group indicated that the outcome was significantly in favor of the cognitive rehabilitation group (MD = 3.74, 95% CI: 2.02 to 5.47, P < 0.0001). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 0%, P = 0.72) (Figure 3).

Figure 3. Forest plot analysis of the PASAT.

Nonverbal learning and memory

Brief Visuospatial Memory Test (BVMT). The researchers used the BVMT, in which patients were asked to represent six abstract shapes in a 2 × 3 grid. The participants were given 10 s to learn the shapes and their positions. In addition, they were required to draw the shapes on a piece of paper using a pencil without a time limit. It should be noted that the test was repeated three times (T1, T2, T3). Each drawing was allocated a score of 0, 1, or 2 based on the accuracy and positioning criteria of the six shapes.

Primary data related to the outcome of BVMT were reported in 4 studies.11,12,17,23 The results of the meta-analysis of these studies with a sample size of 176 patients in the cognitive rehabilitation group and 161 patients in the control group indicated that the outcome was significantly in favor of the cognitive rehabilitation group (MD = 2.72, 95% CI: 0.62 to 4.81, P = 0.01). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 51%, P = 0.11) (Figure 4).

Figure 4. Forest plot analysis of the BVMT.

Verbal fluency

Controlled Oral Word Association Test (COWAT). The COWAT is an oral fluency test in which the participant is required to make verbal associations to different letters of the alphabet by saying all the words which they can think of beginning with a given letter. Three letters of progressively increasing associative difficulty are presented successively as stimuli. The difficulty level of each letter is defined in terms of the relative frequency of words beginning with that letter in each language, as found in standard dictionaries of the language.

Primary data related to the outcome of the COWAT were reported in 4 studies.11,12,16,27 The results of the meta-analysis of these studies with a sample size of 199 patients in the cognitive rehabilitation group and 171 patients in the control group indicated that the outcome between the two groups was not significant (MD = 1.53, 95% CI: −0.54 to 3.61, P = 0.15). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 0%, P = 0.85) (Figure 5).

Figure 5. Forest plot analysis of the COWAT.

Verbal learning and remembering

California Verbal Learning Test (CVLT). This test starts with learning the first list of 16 words from four semantic categories (List A) over five trials. Words from the same category are not presented consecutively. At the end of each trial, the subject is asked to recall the words freely. A new list of words (List B) is then learned and freely recalled in a single trial. This interfering list contains new words belonging to two semantic categories present in List A, while the others belong to two new categories. The test continues with a free recall and a cued recall of List A (with the names of the categories serving retrieval cues). Finally, after a 20-min delay, List A is again tested with a free recall task, a cued recall task, and finally a yes/no recognition task.

Primary data related to the outcome of the CVLT were reported in 5 studies.11,12,17,21,22 The results of the meta-analysis of these studies with a sample size of 172 patients in the cognitive rehabilitation group and 174 patients in the control group indicated that the outcome between the two groups was not significant (MD = 0.86, 95% CI: −0.06 to 1.79, P = 0.07). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 0%, P = 0.64) (Figure 6).

Figure 6. Forest plot analysis of the CVLT.

Scanning and visual tracking

Symbol Digit Modalities Test (SDMT). The SDMT is a screening instrument for the presence of brain damage. It requires individuals to identify nine different symbols corresponding to the numbers 1 through 9, and to practice writing the correct number under the corresponding symbol. Then they manually fill in the blank space under each symbol with the corresponding number.

Primary data related to the outcome of the SDMT were reported in 9 studies.11–15,17,23,24,27 The results of the meta-analysis of these studies with a sample size of 249 patients in the cognitive rehabilitation group and 232 patients in the control group indicated that the outcome between the two groups was significant in favor of the control group (MD = 2.99, 95% CI: 0.98 to 4.99, P = 0.004). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 0%, P = 0.65) (Figure 7).

Figure 7. Forest plot analysis of the SDMT.

Self-report outcomes

Everyday Memory Questionnaire (EMQ)

EMQ questionnaire is a 28-item questionnaire assessing general memory and attention aspects. Each item was scored from 0 to 5 according to the frequency of problems reported. High scores indicate more memory problems.

Primary data related to EMQ outcomes were reported in 3 studies.28–30 The results of the meta-analysis of these studies with a sample size of 72 patients in the cognitive rehabilitation group and 70 patients in the control group indicated that the outcome between the two groups was not significant (MD = 1.45, 95% CI: −0.84 to 3.74, P = 0.21). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 0%, P = 0.9) (Figure 8).

Figure 8. Forest plot analysis of the EMQ.

MS Neuropsychological Screening Questionnaire (MSNQ)

The MSNQ was used as a measure of neuropsychological competence with activities of daily living. Respondents rated how often they experienced each of the 15 items during the last three months. The items include common problems reported by persons with MS (e.g. being easily distracted, difficulty following conversations, and forgetting appointments).

Primary data related to the outcome of MSNQ were reported in 2 studies.11,16 The results of the meta-analysis of these studies with a sample size of 92 patients in the cognitive rehabilitation group and 67 patients in the control group indicated that the outcome was significant in favor of the cognitive rehabilitation group (MD = 3.94, 95% CI: 0.68 to 7.19, P = 0.02). The heterogeneity test did not show a significant difference in terms of heterogeneity (I2 = 0%, P = 0.6) (Figure 9).

Figure 9. Forest plot analysis of the MSNQ.

Beck Depression Inventory (BDI)

The BDI is a 21-item, self-report rating inventory that measures characteristic attitudes and symptoms of depression.

Primary data related to the outcome of BDI were reported in 6 studies.13,15,16,22,27,30 The results of the meta-analysis of these studies with a sample size of 143 patients in the cognitive rehabilitation group and 132 patients in the control group indicated that the outcome was significant in favor of the cognitive rehabilitation group (MD = −3.27, 95% CI: −6.97 to 0.43, P = 0.08). The heterogeneity test showed a significant difference in terms of heterogeneity (I2 = 79%, P = 0.0002) (Figure 10).

Figure 10. Forest plot analysis of the BDI.

Functional scales

Expanded Disability Status Scale (EDSS)

The EDSS is a way of measuring how much someone is affected by their MS. The EDSS has a range from 0 to 10. Scores are in half-unit steps, that is, 3, 3.5, 4, and so on. The greater the level of disability, the higher the score out of ten.

Primary data related to the outcome of the EDSS were reported in 3 studies.13,15,22 The results of the meta-analysis of these studies with a sample size of 43 patients in the cognitive rehabilitation group and 50 patients in the control group indicated that the outcome between the two groups was not significant (MD = 0.3, 95% CI: −0.39 to 1.00, P = 0.39). The heterogeneity test shows a significant difference in terms of heterogeneity (I2 = 0%, P = 0.65) (Figure 11).

Figure 11. Forest plot analysis of the EDSS

Discussion

Based on the inclusion and exclusion criteria, 20 studies were finally selected for meta-analysis from the 578 studies that were initially reviewed. Therefore, all RCT studies that compared the effectiveness of cognitive rehabilitation with a control group in MS patients were included in this meta-analysis.

After evaluating the quality and extracting the relevant data, meta-analysis was performed on 6 outcomes. The results of this meta-analysis showed significant effectiveness in PASAT, BVMT, MSNQ, and BDI outcomes. Although no statistically significant correlation was observed in the results of COWAT, CVLT, EMQ, SDMT, and EDSS, it seems that if the sample size is increased or the follow-up time is increased or the number of treatment sessions is increased, effective results can also be observed in these results.

The results of this meta-analysis have shown that cognitive rehabilitation has an effect on the cognitive functions of patients with MS. The outcomes related to the working memory of patients with MS were investigated and analyzed separately. The obtained results showed that there is a significant improvement in working memory by the cognitive rehabilitation program of working memory. In explaining this recovery, it can be said that the CNS always deals with the damaged circuit and the person's performance improves somewhat after the injury, which may occur as a result of changes in the nervous organization in response to the injury. A systematic review by Mhizha-Murira et al. 31 showed that the quality of reporting of cognitive rehabilitation for memory, attention and executive function for MS was poor across a wide range of study designs. Klein et al. 32 have investigated qualitative studies of patient perspectives for memory, attention and executive function problems in people with MS by conducting a meta-synthesis. This synthesis of qualitative studies indicates that people with MS who experience cognitive deficits benefit from cognitive rehabilitation programs. The results of other review studies showed that cognitive rehabilitation is generally effective in patients with MS. 33

The results of the meta-analysis showed that cognitive rehabilitation creates changes in working memory, which is probably a result of changes in synaptic functions and related brain areas, and due to the overlap of the areas involved in working memory and selective attention, the conclusion that cognitive rehabilitation of working memory causes improvement of selective attention is also confirmed. Because the involvement and recovery of a similar brain region can be observed in the results obtained from the meta-analysis of the outcome of selective attention, and of course, this issue will require further investigations.

One of the limitations of this meta-analysis was the lack of reporting of some statistical data in the included studies for analysis. One of the important statistical data for meta-analysis of continuous outcomes is the standard deviation. Due to the fact that the studies included in the meta-analysis of continuous outcomes reported mean outcomes without standard deviation, some studies were not included in the final analysis of the meta-analysis. If the standard deviation was reported in these studies, meta-analysis of the results will bring more accuracy and confidence. Despite the efforts made to contact the authors responsible for these studies, we did not obtain any results.

Another limitation of this meta-analysis was the short follow-up time of the results in the included studies for analysis. In the scope of our knowledge and based on the included studies, there was no evidence that investigated functional outcomes in long-term follow-up times (more than one year), and there is a gap in studies in this case. It seems that in order to make a more realistic decision and judge about the role of cognitive rehabilitation on the memory functions of a patient with MS, it is necessary to conduct quality studies with a follow-up time of more than one year.

Conclusion

The Results of this meta-analysis showed that cognitive rehabilitation has an effect on improving the performance of patients with MS. However, further studies with a more accurate methodology are required to determine which of the outcomes cognitive rehabilitation has a greater effect on. Since cognitive functions improve with the application of cognitive rehabilitation training, it is suggested to use interventions based on cognitive rehabilitation in addition to psychological interventions as an integrated, practical and supportive treatment approach along with drug therapy.

Acknowledgments

The authors would like to thank the following individuals who have contributed at various stages through the development of this project.

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethical approval: The study was approved by the local ethical committee (code: IR.SBMU.RETECH.REC.1401.408) and the Helsinki Declaration was respected across the study.

Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by the Physical Medicine and Rehabilitation Research Center at Shahid Beheshti University of Medical Sciences.

ORCID iD: Mohammad Moradi-Joo https://orcid.org/0000-0002-9190-3429
==== Refs
References

1 Brownlee WJ Hardy TA Fazekas F , et al. Diagnosis of multiple sclerosis: progress and challenges. Lancet 2017; 389 : 1336–1346.27889190
2 Owen AM Hampshire A Grahn JA , et al. Putting brain training to the test. Nature 2010; 465 : 775–778.20407435
3 Pelosi L Geesken J Holly M , et al. Working memory impairment in early multiple sclerosis. Evidence from an event-related potential study of patients with clinically isolated myelopathy. Brain 1997; 120 : 2039–2058.9397020
4 Piras MR Magnano I Canu EDG , et al. Longitudinal study of cognitive dysfunction in multiple sclerosis: neuropsychological, neuroradiological, and neurophysiological findings. J Neurol Neurosurg Psychiatry 2003; 74 : 878–885.12810771
5 Peyser JM Rao SM LaRocca NG , et al. Guidelines for neuropsychological research in multiple sclerosis. Arch Neurol 1990; 47 : 94–97.2403789
6 Rao SM Leo GJ Bernardin L , et al. Cognitive dysfunction in multiple sclerosis.: i. Frequency, patterns, and prediction. Neurology 1991; 41 : 685–691.2027484
7 Mitolo M Venneri A Wilkinson ID , et al. Cognitive rehabilitation in multiple sclerosis: a systematic review. J Neurol Sci 2015; 354 : 1–9.25998261
8 Staples D Lincoln NB . Intellectual impairment in multiple sclerosis and its relation to functional abilities. Rheumatology 1979; 18 : 153–160.
9 O’Brien AR Chiaravalloti N Goverover Y , et al. Evidenced-based cognitive rehabilitation for persons with multiple sclerosis: a review of the literature. Arch Phys Med Rehabil 2008; 89 : 761–769.18374010
10 Page MJ McKenzie JE Bossuyt PM , et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Syst Rev 2021; 10 : 1–11.33388080
11 Stuifbergen AK Becker H Perez F , et al. A randomized controlled trial of a cognitive rehabilitation intervention for persons with multiple sclerosis. Clin Rehabil 2012; 26 : 882–893.22301679
12 Stuifbergen AK Becker H Perez F , et al. Computer-assisted cognitive rehabilitation in persons with multiple sclerosis: results of a multi-site randomized controlled trial with six month follow-up. Disabil Health J 2018; 11 : 427–434.29477372
13 Janssen A Boster A Lee H , et al. The effects of video-game training on broad cognitive transfer in multiple sclerosis: a pilot randomized controlled trial. J Clin Exp Neuropsychol 2015; 37 : 285–302.25850024
14 Vogt A Kappos L Calabrese P , et al. Working memory training in patients with multiple sclerosis–comparison of two different training schedules. Restor Neurol Neurosci 2009; 27 : 225–235.19531877
15 Cerasa A Gioia MC Valentino P , et al. Computer-assisted cognitive rehabilitation of attention deficits for multiple sclerosis: a randomized trial with fMRI correlates. Neurorehabil Neural Repair 2013; 27 : 284–295.23192417
16 Mäntynen A Rosti-Otajärvi E Koivisto K , et al. Neuropsychological rehabilitation does not improve cognitive performance but reduces perceived cognitive deficits in patients with multiple sclerosis: a randomised, controlled, multi-centre trial. Mult Scler J 2014; 20 : 99–107.
17 Campbell J Langdon D Cercignani M , et al. A randomised controlled trial of efficacy of cognitive rehabilitation in multiple sclerosis: a cognitive, behavioural, and MRI study. Neural Plast 2016; 2016 : 1–9.
18 Impellizzeri F Leonardi S Latella D , et al. An integrative cognitive rehabilitation using neurologic music therapy in multiple sclerosis: A pilot study. Medicine (Baltimore) 2020; 99 : e18866.
19 Mattioli F Stampatori C Bellomi F , et al. A RCT comparing specific intensive cognitive training to aspecific psychological intervention in RRMS: the SMICT study. Front Neurol 2015; 5 : 278.25628596
20 Mattioli F Bellomi F Stampatori C , et al. Two years follow up of domain specific cognitive training in relapsing remitting multiple sclerosis: a randomized clinical trial. Front Behav Neurosci 2016; 10 : 28.26941630
21 Fink F Rischkau E Butt M , et al. Efficacy of an executive function intervention programme in MS: a placebo-controlled and pseudo-randomized trial. Mult Scler J 2010; 16 : 1148–1151.
22 Hildebrandt H Lanz M Hahn HK , et al. Cognitive training in MS: effects and relation to brain atrophy. Restor Neurol Neurosci 2007; 25 : 33–43.17473394
23 Messinis L Nasios G Kosmidis MH , et al. Efficacy of a computer-assisted cognitive rehabilitation intervention in relapsing-remitting multiple sclerosis patients: a multicenter randomized controlled trial. Behav Neurol 2017; 2017 : 5919841.29463950
24 De Giglio L De Luca F Prosperini L , et al. A low-cost cognitive rehabilitation with a commercial video game improves sustained attention and executive functions in multiple sclerosis: a pilot study. Neurorehabil Neural Repair 2015; 29 : 453–461.25398725
25 Mattioli F Stampatori C Zanotti D , et al. Efficacy and specificity of intensive cognitive rehabilitation of attention and executive functions in multiple sclerosis. J Neurol Sci 2010; 288 : 101–105.19825502
26 Mattioli F Stampatori C Scarpazza C , et al. Persistence of the effects of attention and executive functions intensive rehabilitation in relapsing remitting multiple sclerosis. Mult Scler Relat Disord 2012; 1 : 168–173.25877265
27 Chiaravalloti ND DeLuca J Moore NB , et al. Treating learning impairments improves memory performance in multiple sclerosis: a randomized clinical trial. Mult Scler J 2005; 11 : 58–68.
28 Nair D Lincoln NB . Evaluation of rehabilitation of memory in neurological disabilities (ReMiND): a randomized controlled trial. Clin Rehabil 2012; 26 : 894–903.22324056
29 Carr SE das Nair R Schwartz AF , et al. Group memory rehabilitation for people with multiple sclerosis: a feasibility randomized controlled trial. Clin Rehabil 2014; 28 : 552–561.24452705
30 Shahpouri MM Barekatain M Tavakoli M , et al. Evaluation of cognitive rehabilitation on the cognitive performance in multiple sclerosis: a randomized controlled trial. J Res Med Sci 2019; 24 : 110.31949461
31 Mhizha-Murira JR Drummond A Klein OA , et al. Reporting interventions in trials evaluating cognitive rehabilitation in people with multiple sclerosis: a systematic review. Clin Rehabil 2018; 32 : 243–254.28828902
32 Klein OA Drummond A Mhizha-Murira JR , et al. Effectiveness of cognitive rehabilitation for people with multiple sclerosis: a meta-synthesis of patient perspectives. Neuropsychol Rehabil 2019; 29 : 491–512.28457198
33 Brochet B . Cognitive rehabilitation in multiple sclerosis in the period from 2013 and 2021: a narrative review. Brain Sci 2021; 12 : 55.35053798
