
==== Front
BMC Neurol
BMC Neurol
BMC Neurology
1471-2377
BioMed Central London

3842
10.1186/s12883-024-03842-6
Study Protocol
Assessment of long-term psychosocial outcomes in N-methyl-D-aspartate receptor encephalitis – the SAPIENCE study protocol
Boeken Ole Jonas 1
Heine Josephine 1
Duda-Sikula Marta 2
Patricio Víctor 3
Picard Géraldine 4
Buttard Chloé 4
Benaiteau Marie 4
Mendes Álvaro 5
Howard Fuchsia 6
Easton Ava 78
Kurpas Donata 2
Honnorat Jérôme 4
Dalmau Josep 3
Finke Carsten carsten.finke@charite.de

1
1 https://ror.org/001w7jn25 grid.6363.0 0000 0001 2218 4662 Department of Neurology, Charité – Universitätsmedizin Berlin, Charité Campus Mitte, Charitéplatz 1, 10177 Berlin, Berlin, Germany
2 https://ror.org/01qpw1b93 grid.4495.c 0000 0001 1090 049X Department of Family and Pediatric Nursing, Faculty of Health Sciences, WrocławDepartment of Family Medicine, Wroclaw Medical University, Bartla 5 St., wyb. Ludwika, Pasteura1, Wroclaw, 51-618, 50-367 Poland
3 grid.428756.a 0000 0004 0412 0974 Fundacio de Clinic per a la Recerca Clinic Barcelona - Biomédica (FCRB) - Institut de Investigacions, Biomediques August Pi I Sunyer, c/Rosselló 149-153, Barcelona, Spain
4 https://ror.org/029brtt94 grid.7849.2 0000 0001 2150 7757 French reference center on paraneoplastic neurological diseases and autoimmune encephalitis, UMR MELIS Inserm, Université Claude Bernard Lyon1, Hôpital neurologique 59 Bd Pinel, Bron cedex, 69677, 1314 / CNRS 5284 France
5 https://ror.org/043pwc612 grid.5808.5 0000 0001 1503 7226 Instituto de Investigação e Inovação em Saúde, Universidade do Porto, Portugal, Rua Alfredo Allen, 8, 4200-180 Porto, Portugal
6 https://ror.org/03rmrcq20 grid.17091.3e 0000 0001 2288 9830 Faculty of Applied Sciences, The University of British Columbia, T201 – 211 Westbrook Mall, Vancouver, Canada
7 Encephalitis International, YO17 7DT Malton, UK
8 https://ror.org/04xs57h96 grid.10025.36 0000 0004 1936 8470 Department of Clinical Infection, Microbiology and Immunology, University of Liverpool, Liverpool, UK
6 9 2024
6 9 2024
2024
24 32223 7 2024
29 8 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by/4.0/ Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Background

N-methyl-D-aspartate-receptor (NMDAR) encephalitis is a rare neurological autoimmune disease with severe neuropsychiatric symptoms during the acute phase. Despite good functional neurological recovery, most patients continue to experience cognitive, psychiatric, psychological, and social impairments years after the acute phase. However, the precise nature and evolving patterns over time of these long-term consequences remain unclear, and their implications for the well-being and quality of life of predominantly young patients have yet to be thoroughly examined.

Methods

SAPIENCE is a European multi-center (n = 3) prospective observational cohort study studying the long-term cognitive, psychiatric, psychological, and social outcome in patients with NMDAR encephalitis. The study consists of three interconnected levels. Level 1 comprises a qualitative interview and focus groups with patients and their caregivers. Level 2 consists of a condensed form of the interview, standardized questionnaires, and a detailed neuropsychological examination of patients. Level 3 involves an online survey that will be open to patients world-wide and explores patient-reported outcomes (PROMs), and patient-reported experiences (PREMs) in association with clinical and cognitive outcomes. Levels 1 to 3 will progressively contribute developing of structured interviews, survey questions, and treatment guidelines by informing one another.

Discussion

SAPIENCE is an in-depth study of the long-term effects of NMDAR encephalitis and bridges the gap between standardized assessments and individual patient experiences, intending to improve patient care and to increase awareness of the psychosocial long-term consequences of the disease. Through collaboration of experts in clinical neurology and social and health psychology across Europe, SAPIENCE aims to create online assessment tools and formulate guidelines for patient-centered post-acute care that will help enhance the quality of life for patients and caregivers.

Keywords

NMDA receptor encephalitis
Health-related quality of life
Patient-reported outcome measures
Patient-reported experience measures
Cognitive outcomes
Post-acute interventions
Social & caregiver burden
Charité - Universitätsmedizin Berlin (3093)Open Access funding enabled and organized by Projekt DEAL.

issue-copyright-statement© BioMed Central Ltd., part of Springer Nature 2024
==== Body
pmcBackground

N-methyl-D-aspartate receptor (NMDAR) antibody-associated encephalitis is a rare autoimmune disorder affecting the central nervous system. It has an estimated annual incidence of 1.5 cases per million people [1] and a prevalence of 0.6 cases per 100,000 individuals [2], predominantly affecting young adults (median age = 21) [3]. During the acute phase of the disease, patients experience a range of neurological and psychiatric symptoms that can include psychosis, hallucinations, cognitive deficits, language impairment, seizures, movement disorders, autonomic instability, and disorders of consciousness [4]. Since its discovery in 2007 [5], a significant body of research has contributed to describe the clinical features of the acute phase [6–8], develop diagnostic criteria [9, 10], study neuroimaging correlates [11–15], and evaluate treatment outcomes [16–18] of the disease. In contrast, studies investigating the post-acute phase and the individual psychosocial long-term outcomes remain scarce.

Despite the severe acute disease phase, the functional neurological outcome as defined with the modified Rankin Scale (mRS) [6, 16] seems comparably favorable [19]. However, self-reports from patients in the post-acute phase indicate long-term deficits, including impaired memory functions [20, 21], reduced ability to concentrate on activities of daily living [20–22], increased fatigability [21, 23], sleep problems [24], and social withdrawal [21]. In addition to these subjective experiential reports, objective neuropsychological findings indicate long-term deficits in several cognitive areas including episodic and working memory, and executive, language and visuospatial functions in most patients .

Research conducted on small numbers of patients has revealed that persisting cognitive deficits in these individuals significantly contribute to adverse post-acute phase outcomes [20, 21, 25]. In accordance with this observation, a recent longitudinal investigation in 43 patients revealed that deficits in executive functions, episodic memory, and working memory persisted for a median of 4.3 years following the onset of symptoms, despite favorable neurological recovery (as indicated by a mRS scores of 0–1, denoting either no or only mild physical symptoms) [26]. Higher disease severity during the acute phase, longer duration of the acute stage, and delayed treatment were identified as predictors for impaired cognitive outcomes. Similarly, another recent prospective study showed that NMDAR encephalitis patients exhibit persisting cognitive and psychiatric deficits [27]. Cognitive outcomes were predicted by two acute-stage features, decreased consciousness and no improvement within the first four weeks of treatment.

Beyond the burden posed by cognitive impairments, recent research has provided initial insights into the long-term health-related quality of life outcomes for individuals with NMDAR encephalitis [28]. Psychosocial functioning among these patients was found to be lower compared to other patient groups with chronic illness and was associated with factors such as initial misdiagnosis and the low availability of follow-up psychiatric outpatient care, as revealed in a recent online survey [29]. Furthermore, lower quality of the transition from hospital care to outpatient care was linked to an increased burden on caregivers [30]. Telephone interviews conducted with 77 patients with autoimmune encephalitis revealed ongoing fatigue, short-term memory deficits, emotional instability, and concentration problems [31]. Indeed, fatigue as well as sleep disturbances are increasingly reported following NMDAR encephalitis [21, 24, 32, 33]. Recently, it was observed in a group of 22 patients that persisting neuropsychiatric symptoms were associated with reduced social and global quality of life [34]. Overall, neuropsychiatric sequelae can persist for years beyond the post-acute phase, impacting not only the patients’ lives and their capacity to return to work or education but also imposing a substantial burden on caregivers and close relatives [29, 30, 35].

However, data from previous studies on psychosocial function is limited due to small sample sizes, mixed samples of different autoimmune encephalitis syndromes and isolated analyses of potential determinants of quality of life [28, 36]. There is a lack of comprehensive, in-depth investigations into the long-term psychosocial impact of the disease, especially in larger patient cohorts, despite the relatively young age of the patients and the negative impact on their quality of life. It is therefore essential that such studies include the perspective of patients, relatives and caregivers [28]. Moreover, there are currently no diagnostic or treatment guidelines available for the post-acute phase of NMDAR encephalitis that could be informed by the results of these studies.

SAPIENCE (Social and psychological long-term impact of NMDA receptor encephalitis) represents the inaugural effort to connect standardized assessments with the unique experiences of individual patients with autoimmune encephalitis in the extended follow-up. Based on an interdisciplinary and interprofessional team and through the inclusion of patient and caregiver perspectives, SAPIENCE aims to create online assessment tools and to establish treatment guidelines tailored to patient-centered post-acute care that will help to improve the quality of life for both patients and caregivers.

Methods

Objectives

SAPIENCE addresses the cognitive, psychiatric, psychological, and social consequences of NMDAR encephalitis in large and multi-national cohorts at three study sites: Berlin (Germany), Barcelona (Spain) and Lyon (France). The project aims to improve the treatment of patients with NMDAR encephalitis by (1) providing a comprehensive assessment of long-term psychosocial outcomes, (2) describing the patient journey after the acute phase, and (3) examining how outcomes differ by patient, culture, and health care system. The desired outcome is to generate patient-centered guidelines for the post-acute care of individuals with this rare disease. We will also construct a framework to capture disease-related experiences and challenges and identify the factors that influence long-term subjective outcomes in these patients.

Design

Our approach employs a three-tiered study design, incorporating qualitative (level 1), mixed-methods (level 2), and quantitative (level 3) methodologies. The three-level study design enables the synthesis of the strengths of qualitative and quantitative methodologies [37].

Level 1: Qualitative semi-structured interviews & focus groups

Level 1 examines the personal challenges, symptoms, and access to medical care experienced by patients with NMDAR encephalitis and their caregivers. Here, five patients and their caregivers will be invited for individual semi-structured interviews about their personal experience with the disease and treatment at each study site. Furthermore, a focus group with a different set of patients and their caregivers (n = 10, i.e., five patients and their caregivers, for each site) will be conducted at each site (on-site or hybrid-online) to gain a deeper understanding of joint perspectives and experiences of the patient journey. Specifically, we employ a qualitative interpretive descriptive approach [38] that allows for the identification of patterns and themes representing subjective perspectives. Both parts include open-ended questions, follow a topical interview guide, and will be audio-recorded and supplemented with field notes. We will code the data based on verbatim transcripts to identify categories and apply concept mapping to visualize their relationships [39].

In addition to characterizing psychosocial outcomes in a large sample of NMDAR encephalitis patients, a primary objective of this project is to create structured interviews and questionnaires tailored for clinical use in the context of this disease. We will employ comprehensive qualitative methods to ensure that these tools accurately capture patients’ experiences and address their specific needs. These insights will play a significant role in study’s subsequent mixed-methods and quantitative phases, which encompass levels 2 and 3. Hence, the framework established during the interviews and focus groups at level 1 will be applied to generate a concise, on-site version of the semi-structured interview, to capture patient experiences in a broader and more diverse sample across all study sites.

Level 2: Mixed-methods approach – comprehensive cognitive and psychosocial assessments

In Level 2, qualitative methodologies are integrated with thorough quantitative cognitive evaluations and questionnaire assessments to provide a comprehensive, long-term profile of NMDAR encephalitis in N = 90 patients (i.e., 30 per site). Clinician-observed metrics (such as neuropsychological test outcomes and disability assessments) will be juxtaposed with patient-reported results (including quality of life, metacognition, and subjective evaluations of physical and psychosocial functioning) with the aim of pinpointing disparities and, in the end, uncovering gaps in healthcare. NMDAR encephalitis is a rare disease, meaning that the available pool of patients is limited. Consequently, we will implement an online administration for the neuropsychological test battery and questionnaires to achieve the desired recruitment targets.

The neuropsychological assessment will involve language-adapted tests, i.e. tests will be tailored each study site’s normalization and language requirements. These tests will be utilized to evaluate executive functions (i.e., verbal fluency [40] and working memory via digit span backward [41, 42]), long-term memory retention and retrieval (i.e., Rey-Auditory Verbal Learning Test or RAVLT [43]), short-term memory (i.e., digit span forward [41, 42]), and spatial navigation (i.e., the Virtual Environment Navigation Assessment or VIENNA ) [44]. These cognitive domains are often impaired in NMDAR encephalitis [26]. Verbal tests are conducted by videoconference which has proven reliable [45]. The spatial navigation test, VIENNA, is administered in a web-based format [44].

Subjective experiential reports will be gathered using the psychosocial patient-reported outcome measures (PROMS) Field, (PROMs) [46], patient-reported experience measures (PREMS) Field [47, 48], and meta memory [49, 50] .The selected PROMs record the domains of fatigue (Fatigue Severity Scale, FSS [51]), sleep (Pittsburgh Sleep Quality Index, PSQI [52]), self-assessment of memory performance (Multifactorial Memory Questionnaire, MMQ [49, 50]), depression (Beck Depression Inventory, BDI-II [53], anxiety (Hospital Anxiety and Depression Scale, HADS [54]), and patients’ quality of life (5-Level EQ-5D, EQ-5D-5 L [55]). These factors have been shown to significantly influence patients’ post-acute state of health and overall global health [26, 27, 36, 56].

PREMS assess patients’ encounters and requirements throughout their care journey [48, 57]. In particular, our research will evaluate how patients perceive interactions with healthcare providers, the consistency of their treatment, the shared decision-making processes, the participation of their caregivers, and the physical and emotional support they receive during their treatment. This patient perspective will be investigated using a survey tool developed based on the qualitative analysis of Level 1 semi-structured interviews. This approach addresses the need for standardized multilingual PREMs available for all study site languages (i.e., French, German, and Catalan/Spanish) that would require translations and validations at local sites. Since PREMs are typically language-specific and culturally embedded, reflecting different healthcare systems [48, 58], our survey aims to provide a bias-free assessment by directly considering the diverse backgrounds of our patients.

Finally, we will assess the role of the following potential outcome predictors: (i) disease duration/severity (mRS, Clinical Assessment Scale (CASE [59])); (ii) intensive care treatment; (iii) difficulties during treatment (e.g., delayed diagnosis, relapse); (iv) availability and duration of rehabilitation; (v) pre-existing comorbidities; and (vi) socioeconomic background.

Level 3: Online network-level assessment of quality of life and healthcare experiences

Level 3, an online study, will invite the participation of patients worldwide and allow assessment of the impact of different healthcare systems and cultural factors on outcomes. Thus, this study level is designed to be independent of site-specific factors and suitable for a broad range of patients with NMDAR encephalitis. For instance, the study will consider that access to specialists and availability of treatment options differ between countries.

Cognitive assessments will center on self-reported measures, including the MMQ [49] and VIENNA [44], for analysis of spatial navigation, a function highly dependent on the integrity of the hippocampus – a brain structure with increased vulnerability in NMDAR encephalitis. While psychosocial evaluations will rely on PROM questionnaires, PREMs will be assessed based on Level 2 short interview analysis. Thus, insights from the short-form interviews will guide the formulation of survey questions targeting pre-disease situations, disease progression, and patient experiences (e.g., interactions with healthcare professionals, treatment-related experiences, the flow of information).

The objectives of level 3 are to expand the assessment across various healthcare systems, cultural contexts, and diverse populations, and establish an online evaluation tool for pertinent outcome measures for future research because standardized interviews or surveys specifically for autoimmune encephalitis are currently unavailable. These patient-centered survey questions will be developed based on the insights gained from levels 1 and 2. They can be applied to broad and international patient populations, making them readily accessible for clinical and research purposes. Finally, the results from studies at levels 2 and 3 will be used to develop international guidelines for long-term care.

Setting

SAPIENCE aims to characterize the long-term cognitive and psychosocial consequences of NMDAR encephalitis in an international collaboration across four European study sites. Additionally, research groups at the University of British Columbia (Canada) and the University of Porto in Portugal will contribute their expertise in qualitative research as SAPIENCE collaborators.

A central component of SAPIENCE is the close collaboration with patient advocacy groups (PAOs), including Encephalitis International (UK), Autoimmune Encephalitis Alliance (USA), Autoimmunenzephalitis Selbsthilfegruppe (Germany), and the Anti-NMDA-Rezeptor- Enzephalitis Forum (Germany). These PAOs are involved in several critical aspects of the study, including co-designing the study, defining relevant outcome measures, helping create informational materials, recruiting participants, interpreting study results, and formulating long-term care guidelines to enhance rehabilitation and life quality.

Recruitment and eligibility criteria

Participants will be recruited from non-overlapping cohorts throughout Germany for the study site Berlin, throughout France for participation in Lyon, and throughout Spain for the study site Barcelona (nationwide recruitment). The German Network for Research on Autoimmune Encephalitis (GENERATE) will facilitate recruitment in Germany. For the Level 3 online study, patients will be invited globally to participate in this cross-sectional online analysis through study sites in Berlin, Barcelona and Lyon, as well as through participating PAOs from Germany, the UK, the USA and Canada with their global reach. Inclusion criteria for participation in the study are a confirmed diagnosis of NMDAR encephalitis [9], being over the age of 17 years, and demonstrating proficiency in one of the project languages (German, French, Spanish, Catalan, English). Exclusion criteria entail the presence of preexisting neurological disorders and the inability to provide informed consent.

Hypotheses

The main hypothesis is that NMDAR encephalitis is associated with a long-lasting and clinically relevant impact on patient’s cognitive, psychiatric, psychological, and social well-being (H1). Cognitive deficits such as memory impairment and deficits of executive functions are persistent in many patients and impact the return to work/school and independence in daily activities (H1.2). Fatigue, sleep quality, affective symptoms, and cognitive complaints are major determinants of the subjective long-term outcome of NMDAR encephalitis (H1.3). Post-acute symptom severity and quality of life are related to characteristics of the acute disease course (e.g., treatment delay, need for intensive care unit stay), access to post-acute care, caregiver support, and personal coping strategies (H1.4). Structured interviews developed in this study will inform the development of patient-centered guidelines for long-term care and rehabilitation strategies (H1.5).

Sample size

The sample size of N = 30 for the semi-structured interviews and focus groups in Level 1 is based on current recommendations for investigating of clinically relevant participant characteristics and the derivation of conceptual categories [60]. The sample size of n = 90 for Level 2 was calculated to detect medium effect sizes in correlation analyses (power 80%, significance level 5%, correlation coefficients of > = 0.23; R package pwr [61]). Calculation of the sample size for the online study (Level 3) was based on an estimated prevalence of 50% of patients with impaired health-related quality of life and assuming an estimated population size of N = 500 in Germany (as an example), a confidence level of 1- α = 0.95, and a margin of error of e = 5%. The sample size is calculated to be n = 218 based on the formula n=[(z2p(1-p))/e2]/[1+(z2p(1-p))/e2*N]. Considering an estimated 30% missing data during the survey, we plan for an N = 300 for the online survey.

Statistical analyses

Statistical analyses encompass a multifaceted approach. Firstly, cognitive deficits will be analyzed using test-specific norm values and patient-reported outcomes measures will be evaluated utilizing established normative data. Furthermore, correlation analyses will be used to explore the relationships between cognitive deficits and clinical parameters, including symptom severity and duration of hospitalization. In addition, correlation analyses with patient-reported outcomes, encompassing quality of life, affective symptomatology, physical impairment, and self-assessed memory function will be studied. Lastly, regression analyses are performed to identify predictors of quality of life.

Discussion

SAPIENCE is a prospective, interdisciplinary, multi-center study to investigate the long-term cognitive, psychiatric, psychological, and social repercussions faced by patients with NMDAR encephalitis. The psychological and social consequences of NMDAR encephalitis have significant impacts on patients’ well-being - yet they remain inadequately understood, frequently undetected, and untreated. SAPIENCE aims to bring about a substantial shift in the care of individuals with NMDAR encephalitis by (1) delivering a comprehensive assessment of long-term psychosocial effects associated with the condition, (2) delineating the patient’s experience during the post-acute phase, and (3) investigating the variability of outcomes among patients, considering cultural and healthcare system differences. The aim if SAPIENCE is to create patient-focused treatment recommendations that can be adopted globally by medical practitioners and healthcare providers. As a result, we anticipate substantial progress in understanding the disease, improved health outcomes for both patients and caregivers, enhanced assessment tools such as novel disease-specific interviews and surveys, and potential economic benefits such as reduced healthcare expenses.

SAPIENCE will need to address the challenges inherent to the international multi-center design of the study in a rare disease. The international multi-center approach that relies on a close interdisciplinary collaboration between clinical teams, Social Sciences and Humanities (SSH)-experts and patient advocacy organizations requires a robust project governance. This includes defining responsibilities, stakeholder communication, risk management, ethical compliance, data protection, and continuous project status monitoring. Furthermore, reliable and standardized data acquisition and analysis processes must be established and harmonized across study sites. This will entail the development of standard operating procedures and manuals for the semi-structured interviews and neuropsychological tests, training of the experimenters involved in data acquisition at each study site using online seminars, and regular peer-to-peer and supervision meetings led by team members with relevant qualitative and neuropsychological expertise.

In this three-level study design, we will use existing infrastructure and patient registries to enrol and evaluate patients across three research sites. Data collection on-site for levels 1 and 2 is scheduled to take place at three locations: Charité - Universitätsmedizin Berlin, the French Reference Center on Paraneoplastic Neurological Diseases and Autoimmune Encephalitis in Lyon, and the Fundació de Recerca Clínic Barcelona. Given the rarity of the disease, a significant challenge will be the recruitment of a sufficiently large sample of patients with NMDAR encephalitis. For Level 1, this pertains to the recruitment of patient and caregiver dyads while for Levels 2 & 3 this relates to sample size goals of n = 90 and n = 300, respectively. To improve recruitment, the SAPIENCE team will closely collaborate with patient advocacy organizations and leverage existing infrastructure such as the GENERATE network. To allow for robust cross-site analyses, SAPIENCE will use only standardized neuropsychological tests and questionnaires available in the languages of the three project sites and with available normative data.

Critical aspects for the Level 3 (online study) include (i) the establishment of data storage and data protection procedures that meet the requirements and regulations of all participating countries; and (ii) the creation of a suitable informed consent process that adheres to the legal and ethical standards of all participating countries. In addition, potential biases inherent to online studies must be considered and mitigated. Such biases include the possibility of participants submitting duplicate responses, individuals responding inattentively, and the possible bias of preferentially recruiting technology-savvy responders. To address these biases, we have devised several measures. To counteract duplicate responses, participants will be required to generate a unique, non-identifiable code that remains consistent. This code will identify and remove duplicate entries from our dataset. To address inattentive responding, we will employ various techniques. Survey tools will incorporate time-bias scoring to identify and flag participants who rush through the survey. Additionally, attention-check items and questions will be strategically placed throughout the study to ensure that participants are actively engaged and provide thoughtful responses. For participants needing more time to be comfortable with online questionnaires, we will offer a pen-and-paper version as an alternative. The data collected via this method will then be manually entered into our system study team member.

In conclusion, SAPIENCE will be an interdisciplinary and international study aiming to improve the long-term the cognitive, psychiatric, psychological, and social outcomes of patients with NMDAR encephalitis by combining objective and subjective measures and integrating the perspectives of healthcare providers, patients, and caregivers resulting in patient-centered post-acute care treatment guidelines.

Abbreviations

EQ-5D-5L 5-Level EQ-5D

BDI-II Beck’s Depression Inventory

CASE Clinical Assessment Scale

FSS Fatigue Severity Scale

GENERATE German Network for Research on Autoimmune Encephalitis

HADS Hospital Anxiety and Depression Scale

mRS modified Ranking Scale

MMQ Multifactorial Memory Questionnaire

NMDAR N-methyl-D-aspartate receptor

PAOS Patient Advocacy Organizations

PREMS Patient-Reported Experience Measures

PROMS Patient-Reported Outcome Measures

PSQI Pittsburgh Sleep Quality Index

RAVLT Rey-Auditory Verbal Learning Test

SAPIENCE Social and psychological long-term impact of NMDA receptor encephalitis

VIENNA Virtual Environment Navigation Assessment

Acknowledgements

Not applicable.

Author contributions

O.J.B., J. Heine, M.D.-S., V.P., G.P., C.B., M.B., A.M., F.H., A.E., D.K., J. Honnorat, J.D., C.F. were significantly involved in the conception and design of this study. O.J.B and J. Heine drafted the manuscript, with all other authors contributing to its critical review and approving the final submitted version. All authors agree to be personally accountable for their own contributions and to ensure that any questions related to the accuracy or integrity of any part of the work, even those in which they were not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Funding

This work was supported by the European Joint Programme on Rare Diseases (EJPRD; EJPRD21-40 SAPIENCE).

For the German site, funding was provided by the German Federal Ministry of Education and Research (BMBF) with grant numbers 01GM210 (SAPIENCE) and 01GM1908D (CONNECT-GENERATE), as well as by the German Research Foundation (DFG) with grant numbers 327654276 (SFB 1315), 504745852 (Clinical Research Unit KFO 5023 ‘BecauseY’), FI 2309/1–1 (Heisenberg Program), and FI 2309/2 − 1. For the Spanish site, funding was provided by the Instituto de Salud Carlos III (ISCIII) and the European Union (NextGenerationEU - Recovery and Resilience Facility), grant number AC21 2/00053. The Polish part of the project is financed by the National Center for Research and Development under the European Joint Programme. The French partner of the project SAPIENCE is financed by the Agence Nationale de la Recherche (ANR-21-RAR4-0002).

Open Access funding enabled and organized by Projekt DEAL.

Data availability

No datasets were generated or analysed during the current study.

Declarations

Ethics approval and consent to participate

The leading ethics committee overseeing this study is the Ethics Board of the European Joint Programme on Rare Diseases Joint Transnational Call 2021 (EJP RD JTC2021). The study has received conditional ethics clearance from EJP RD JTC2021 for all Levels, contingent on the development of global procedures for informed consent in the online study (Level 3). The SAPIENCE project has successfully undergone independent peer-review and was selected for funding in the EJP RD JTC2021 call.

Levels 1 and 2 of SAPIENCE have been granted ethical approval at all study sites (Ethikkommission der Charité – Universitätsmedizin Berlin (EA2/138/23, 13.07.2023); Comité Ético de Investigación Clínica del Hospital Clínic de Barcelona; Comité de Protection des Personnes EST III (2023-A01446-39; NCT05954468)).

Approvals for Level 3 are currently underway in Berlin and Lyon, with ethical approval already granted for the Spanish site.

The study is being conducted under the Declaration of Helsinki and Good Clinical Practice guidelines, which include the protection of data and patient privacy. All participants are required to provide written informed consent before participating.

Consent for publication

Informed consent is obtained from participants at each study site prior to recruitment, and the inability to provide informed consent is regarded as an exclusion criterion. Consent must adhere to data protection laws, such as GDPR, and encompass a mandatory subsection specifically addressing consent for publication.

Competing interests

The authors declare no competing interests.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Kurpas Donata, Honnorat Jérôme, Dalmau Josep and Finke Carsten equally contributing last authors.
==== Refs
References

1. Dalmau J Armangué T Planagumà J Radosevic M Mannara F Leypoldt F An update on anti-NMDA receptor encephalitis for neurologists and psychiatrists: mechanisms and models Lancet Neurol 2019 18 1045 57 10.1016/S1474-4422(19)30244-3 31326280
Dalmau J, Armangué T, Planagumà J, Radosevic M, Mannara F, Leypoldt F, et al. An update on anti-NMDA receptor encephalitis for neurologists and psychiatrists: mechanisms and models. Lancet Neurol. 2019;18:1045–57.31326280 10.1016/S1474-4422(19)30244-3
2. Dubey D Pittock SJ Kelly CR McKeon A Lopez-Chiriboga AS Lennon VA Autoimmune encephalitis epidemiology and a comparison to infectious encephalitis: autoimmune encephalitis Ann Neurol 2018 83 166 77 10.1002/ana.25131 29293273
Dubey D, Pittock SJ, Kelly CR, McKeon A, Lopez-Chiriboga AS, Lennon VA, et al. Autoimmune encephalitis epidemiology and a comparison to infectious encephalitis: autoimmune encephalitis. Ann Neurol. 2018;83:166–77.29293273 10.1002/ana.25131
3. Tanguturi YC Cundiff AW Fuchs C Anti-N-Methyl d-Aspartate receptor encephalitis and Electroconvulsive Therapy Child Adolesc Psychiatr Clin N Am 2019 28 79 89 10.1016/j.chc.2018.07.005 30389078
Tanguturi YC, Cundiff AW, Fuchs C. Anti-N-Methyl d-Aspartate receptor encephalitis and Electroconvulsive Therapy. Child Adolesc Psychiatr Clin N Am. 2019;28:79–89.30389078 10.1016/j.chc.2018.07.005
4. Schubert J Brämer D Huttner HB Gerner ST Fuhrer H Melzer N Management and prognostic markers in patients with autoimmune encephalitis requiring ICU treatment Neurol Neuroimmunol Neuroinflamm 2019 6 e514 10.1212/NXI.0000000000000514 30568992
Schubert J, Brämer D, Huttner HB, Gerner ST, Fuhrer H, Melzer N, et al. Management and prognostic markers in patients with autoimmune encephalitis requiring ICU treatment. Neurol Neuroimmunol Neuroinflamm. 2019;6:e514.30568992 10.1212/NXI.0000000000000514
5. Dalmau J, Tüzün E, Wu H, Masjuan J, Rossi JE, Voloschin A et al. Paraneoplastic Anti–N-methyl-D-aspartate receptor Encephalitis Associated with Ovarian Teratoma. 2008.
6. Dalmau J Gleichman AJ Hughes EG Rossi JE Peng X Lai M Anti-NMDA-receptor encephalitis: case series and analysis of the effects of antibodies Lancet Neurol 2008 7 1091 8 10.1016/S1474-4422(08)70224-2 18851928
Dalmau J, Gleichman AJ, Hughes EG, Rossi JE, Peng X, Lai M, et al. Anti-NMDA-receptor encephalitis: case series and analysis of the effects of antibodies. Lancet Neurol. 2008;7:1091–8.18851928 10.1016/S1474-4422(08)70224-2
7. Balu R McCracken L Lancaster E Graus F Dalmau J Titulaer MJ A score that predicts 1-year functional status in patients with anti-NMDA receptor encephalitis Neurology 2019 92 e244 52 10.1212/WNL.0000000000006783 30578370
Balu R, McCracken L, Lancaster E, Graus F, Dalmau J, Titulaer MJ. A score that predicts 1-year functional status in patients with anti-NMDA receptor encephalitis. Neurology. 2019;92:e244–52.30578370 10.1212/WNL.0000000000006783
8. Bartels F Krohn S Nikolaus M Johannsen J Wickström R Schimmel M Clinical and magnetic resonance imaging outcome predictors in Pediatric Anti–N-Methyl‐D‐Aspartate receptor encephalitis Ann Neurol 2020 88 148 59 10.1002/ana.25754 32314416
Bartels F, Krohn S, Nikolaus M, Johannsen J, Wickström R, Schimmel M, et al. Clinical and magnetic resonance imaging outcome predictors in Pediatric Anti–N-Methyl‐D‐Aspartate receptor encephalitis. Ann Neurol. 2020;88:148–59.32314416 10.1002/ana.25754
9. Graus F Titulaer MJ Balu R Benseler S Bien CG Cellucci T A clinical approach to diagnosis of autoimmune encephalitis Lancet Neurol 2016 15 391 404 10.1016/S1474-4422(15)00401-9 26906964
Graus F, Titulaer MJ, Balu R, Benseler S, Bien CG, Cellucci T, et al. A clinical approach to diagnosis of autoimmune encephalitis. Lancet Neurol. 2016;15:391–404.26906964 10.1016/S1474-4422(15)00401-9
10. Nguyen L Wang C Anti-NMDA receptor autoimmune encephalitis: diagnosis and management strategies IJGM 2023 16 7 21 10.2147/IJGM.S397429
Nguyen L, Wang C. Anti-NMDA receptor autoimmune encephalitis: diagnosis and management strategies. IJGM. 2023;16:7–21.10.2147/IJGM.S397429
11. Phillips OR Joshi SH Narr KL Shattuck DW Singh M Di Paola M Superficial white matter damage in anti-NMDA receptor encephalitis J Neurol Neurosurg Psychiatry 2018 89 518 25 10.1136/jnnp-2017-316822 29101253
Phillips OR, Joshi SH, Narr KL, Shattuck DW, Singh M, Di Paola M, et al. Superficial white matter damage in anti-NMDA receptor encephalitis. J Neurol Neurosurg Psychiatry. 2018;89:518–25.29101253 10.1136/jnnp-2017-316822
12. Heine J Prüss H Bartsch T Ploner CJ Paul F Finke C Imaging of autoimmune encephalitis – relevance for clinical practice and hippocampal function Neuroscience 2015 309 68 83 10.1016/j.neuroscience.2015.05.037 26012492
Heine J, Prüss H, Bartsch T, Ploner CJ, Paul F, Finke C. Imaging of autoimmune encephalitis – relevance for clinical practice and hippocampal function. Neuroscience. 2015;309:68–83.26012492 10.1016/j.neuroscience.2015.05.037
13. Peer M Prüss H Ben-Dayan I Paul F Arzy S Finke C Functional connectivity of large-scale brain networks in patients with anti-NMDA receptor encephalitis: an observational study Lancet Psychiatry 2017 4 768 74 10.1016/S2215-0366(17)30330-9 28882707
Peer M, Prüss H, Ben-Dayan I, Paul F, Arzy S, Finke C. Functional connectivity of large-scale brain networks in patients with anti-NMDA receptor encephalitis: an observational study. Lancet Psychiatry. 2017;4:768–74.28882707 10.1016/S2215-0366(17)30330-9
14. Finke C Kopp UA Pajkert A Behrens JR Leypoldt F Wuerfel JT Structural hippocampal damage following Anti-N-Methyl-D-Aspartate receptor encephalitis Biol Psychiatry 2016 79 727 34 10.1016/j.biopsych.2015.02.024 25866294
Finke C, Kopp UA, Pajkert A, Behrens JR, Leypoldt F, Wuerfel JT, et al. Structural hippocampal damage following Anti-N-Methyl-D-Aspartate receptor encephalitis. Biol Psychiatry. 2016;79:727–34.25866294 10.1016/j.biopsych.2015.02.024
15. Brier MR Day GS Snyder AZ Tanenbaum AB Ances BM N-methyl-D-aspartate receptor encephalitis mediates loss of intrinsic activity measured by functional MRI J Neurol 2016 263 1083 91 10.1007/s00415-016-8083-6 27025853
Brier MR, Day GS, Snyder AZ, Tanenbaum AB, Ances BM. N-methyl-D-aspartate receptor encephalitis mediates loss of intrinsic activity measured by functional MRI. J Neurol. 2016;263:1083–91.27025853 10.1007/s00415-016-8083-6
16. Titulaer MJ McCracken L Gabilondo I Armangué T Glaser C Iizuka T Treatment and prognostic factors for long-term outcome in patients with anti-NMDA receptor encephalitis: an observational cohort study Lancet Neurol 2013 12 157 65 10.1016/S1474-4422(12)70310-1 23290630
Titulaer MJ, McCracken L, Gabilondo I, Armangué T, Glaser C, Iizuka T, et al. Treatment and prognostic factors for long-term outcome in patients with anti-NMDA receptor encephalitis: an observational cohort study. Lancet Neurol. 2013;12:157–65.23290630 10.1016/S1474-4422(12)70310-1
17. Heine J Ly L-T Lieker I Slowinski T Finke C Prüss H Immunoadsorption or plasma exchange in the treatment of autoimmune encephalitis: a pilot study J Neurol 2016 263 2395 402 10.1007/s00415-016-8277-y 27604620
Heine J, Ly L-T, Lieker I, Slowinski T, Finke C, Prüss H, et al. Immunoadsorption or plasma exchange in the treatment of autoimmune encephalitis: a pilot study. J Neurol. 2016;263:2395–402.27604620 10.1007/s00415-016-8277-y
18. Dalmau J Lancaster E Martinez-Hernandez E Rosenfeld MR Balice-Gordon R Clinical experience and laboratory investigations in patients with anti-NMDAR encephalitis Lancet Neurol 2011 10 63 74 10.1016/S1474-4422(10)70253-2 21163445
Dalmau J, Lancaster E, Martinez-Hernandez E, Rosenfeld MR, Balice-Gordon R. Clinical experience and laboratory investigations in patients with anti-NMDAR encephalitis. Lancet Neurol. 2011;10:63–74.21163445 10.1016/S1474-4422(10)70253-2
19. Huang Q Xie Y Hu Z Tang X Anti-N-methyl-D-aspartate receptor encephalitis: a review of pathogenic mechanisms, treatment, prognosis Brain Res 2020 1727 146549 10.1016/j.brainres.2019.146549 31726044
Huang Q, Xie Y, Hu Z, Tang X. Anti-N-methyl-D-aspartate receptor encephalitis: a review of pathogenic mechanisms, treatment, prognosis. Brain Res. 2020;1727:146549.31726044 10.1016/j.brainres.2019.146549
20. Finke C Kopp UA Prüss H Dalmau J Wandinger K-P Ploner CJ Cognitive deficits following anti-NMDA receptor encephalitis J Neurol Neurosurg Psychiatry 2012 83 195 8 10.1136/jnnp-2011-300411 21933952
Finke C, Kopp UA, Prüss H, Dalmau J, Wandinger K-P, Ploner CJ. Cognitive deficits following anti-NMDA receptor encephalitis. J Neurol Neurosurg Psychiatry. 2012;83:195–8.21933952 10.1136/jnnp-2011-300411
21. McKeon GL Scott JG Spooner DM Ryan AE Blum S Gillis D Cognitive and social functioning deficits after Anti-N-Methyl-D-Aspartate receptor encephalitis: an exploratory Case Series J Int Neuropsychol Soc 2016 22 828 38 10.1017/S1355617716000679 27546201
McKeon GL, Scott JG, Spooner DM, Ryan AE, Blum S, Gillis D, et al. Cognitive and social functioning deficits after Anti-N-Methyl-D-Aspartate receptor encephalitis: an exploratory Case Series. J Int Neuropsychol Soc. 2016;22:828–38.27546201 10.1017/S1355617716000679
22. Bach LJ Long term rehabilitation management and outcome of anti-NMDA receptor encephalitis: case reports NRE 2014 35 863 75 10.3233/NRE-141176
Bach LJ. Long term rehabilitation management and outcome of anti-NMDA receptor encephalitis: case reports. NRE. 2014;35:863–75.10.3233/NRE-141176
23. Tarantino S Averna R Ruscitto C Ursitti F Ferilli MAN Moavero R Neuropsychological Sequelae, Quality of Life and Adaptive Behavior in Children and adolescents with Anti-NMDAR Encephalitis: a narrative review Brain Sci 2021 11 1387 10.3390/brainsci11111387 34827386
Tarantino S, Averna R, Ruscitto C, Ursitti F, Ferilli MAN, Moavero R, et al. Neuropsychological Sequelae, Quality of Life and Adaptive Behavior in Children and adolescents with Anti-NMDAR Encephalitis: a narrative review. Brain Sci. 2021;11:1387.34827386 10.3390/brainsci11111387
24. Ariño H Muñoz-Lopetegi A Martinez-Hernandez E Armangue T Rosa-Justicia M Escudero D Sleep disorders in anti-NMDAR encephalitis Neurology 2020 95 e671 84 10.1212/WNL.0000000000009987 32576635
Ariño H, Muñoz-Lopetegi A, Martinez-Hernandez E, Armangue T, Rosa-Justicia M, Escudero D, et al. Sleep disorders in anti-NMDAR encephalitis. Neurology. 2020;95:e671–84.32576635 10.1212/WNL.0000000000009987
25. Finke C Kopp UA Scheel M Pech L-M Soemmer C Schlichting J Functional and structural brain changes in anti-N-methyl-D-aspartate receptor encephalitis Ann Neurol 2013 74 284 96 10.1002/ana.23932 23686722
Finke C, Kopp UA, Scheel M, Pech L-M, Soemmer C, Schlichting J, et al. Functional and structural brain changes in anti-N-methyl-D-aspartate receptor encephalitis. Ann Neurol. 2013;74:284–96.23686722 10.1002/ana.23932
26. Heine J Kopp UA Klag J Ploner CJ Prüss H Finke C Long-term cognitive outcome in Anti–N‐Methyl‐D‐Aspartate receptor encephalitis Ann Neurol 2021 90 949 61 10.1002/ana.26241 34595771
Heine J, Kopp UA, Klag J, Ploner CJ, Prüss H, Finke C. Long-term cognitive outcome in Anti–N‐Methyl‐D‐Aspartate receptor encephalitis. Ann Neurol. 2021;90:949–61.34595771 10.1002/ana.26241
27. Guasp M Rosa-Justicia M Muñoz-Lopetegi A Martínez-Hernández E Armangué T Sugranyes G Clinical characterisation of patients in the post-acute stage of anti-NMDA receptor encephalitis: a prospective cohort study and comparison with patients with schizophrenia spectrum disorders Lancet Neurol 2022 21 899 910 10.1016/S1474-4422(22)00299-X 36115362
Guasp M, Rosa-Justicia M, Muñoz-Lopetegi A, Martínez-Hernández E, Armangué T, Sugranyes G, et al. Clinical characterisation of patients in the post-acute stage of anti-NMDA receptor encephalitis: a prospective cohort study and comparison with patients with schizophrenia spectrum disorders. Lancet Neurol. 2022;21:899–910.36115362 10.1016/S1474-4422(22)00299-X
28. Finke C The patient perspective in Encephalitis Research Neurol Neuroimmunol Neuroinflamm 2024 11 e200189 10.1212/NXI.0000000000200189 38086067
Finke C. The patient perspective in Encephalitis Research. Neurol Neuroimmunol Neuroinflamm. 2024;11:e200189.38086067 10.1212/NXI.0000000000200189
29. Blum RA Tomlinson AR Jetté N Kwon C-S Easton A Yeshokumar AK Assessment of long-term psychosocial outcomes in anti-NMDA receptor encephalitis Epilepsy Behav 2020 108 107088 10.1016/j.yebeh.2020.107088 32375094
Blum RA, Tomlinson AR, Jetté N, Kwon C-S, Easton A, Yeshokumar AK. Assessment of long-term psychosocial outcomes in anti-NMDA receptor encephalitis. Epilepsy Behav. 2020;108:107088.32375094 10.1016/j.yebeh.2020.107088
30. Tomlinson AR Blum RA Jetté N Kwon C-S Easton A Yeshokumar AK Assessment of care transitions and caregiver burden in anti-NMDA receptor encephalitis Epilepsy Behav 2020 108 107066 10.1016/j.yebeh.2020.107066 32375097
Tomlinson AR, Blum RA, Jetté N, Kwon C-S, Easton A, Yeshokumar AK. Assessment of care transitions and caregiver burden in anti-NMDA receptor encephalitis. Epilepsy Behav. 2020;108:107066.32375097 10.1016/j.yebeh.2020.107066
31. Yeshokumar AK Gordon-Lipkin E Arenivas A Cohen J Venkatesan A Saylor D Neurobehavioral outcomes in autoimmune encephalitis J Neuroimmunol 2017 312 8 14 10.1016/j.jneuroim.2017.08.010 28889962
Yeshokumar AK, Gordon-Lipkin E, Arenivas A, Cohen J, Venkatesan A, Saylor D, et al. Neurobehavioral outcomes in autoimmune encephalitis. J Neuroimmunol. 2017;312:8–14.28889962 10.1016/j.jneuroim.2017.08.010
32. De Bruijn MAAM Aarsen FK Van Oosterhout MP Van Der Knoop MM Catsman-Berrevoets CE Schreurs MWJ Long-term neuropsychological outcome following pediatric anti-NMDAR encephalitis Neurology 2018 90 e1997 2005 10.1212/WNL.0000000000005605 29703768
De Bruijn MAAM, Aarsen FK, Van Oosterhout MP, Van Der Knoop MM, Catsman-Berrevoets CE, Schreurs MWJ, et al. Long-term neuropsychological outcome following pediatric anti-NMDAR encephalitis. Neurology. 2018;90:e1997–2005.29703768 10.1212/WNL.0000000000005605
33. Blattner MS De Bruin GS Bucelli RC Day GS Sleep disturbances are common in patients with autoimmune encephalitis J Neurol 2019 266 1007 15 10.1007/s00415-019-09230-2 30741377
Blattner MS, De Bruin GS, Bucelli RC, Day GS. Sleep disturbances are common in patients with autoimmune encephalitis. J Neurol. 2019;266:1007–15.30741377 10.1007/s00415-019-09230-2
34. Hirose S Hara M Yokota Y Nakajima H Long-term effects of anti-N-methyl-d-aspartate receptor encephalitis on quality of life Front Neurol 2023 14 1170961 10.3389/fneur.2023.1170961 37273709
Hirose S, Hara M, Yokota Y, Nakajima H. Long-term effects of anti-N-methyl-d-aspartate receptor encephalitis on quality of life. Front Neurol. 2023;14:1170961.37273709 10.3389/fneur.2023.1170961
35. Hirose S Hara M Kamei S Dalmau J Nakajima H Characteristics of clinical relapses and patient-oriented long-term outcomes of patients with anti-N-methyl-d-aspartate receptor encephalitis J Neurol 2022 269 2486 92 10.1007/s00415-021-10828-8 34613453
Hirose S, Hara M, Kamei S, Dalmau J, Nakajima H. Characteristics of clinical relapses and patient-oriented long-term outcomes of patients with anti-N-methyl-d-aspartate receptor encephalitis. J Neurol. 2022;269:2486–92.34613453 10.1007/s00415-021-10828-8
36. Brenner J Olijslagers SHC Crijnen YS De Vries JM Mandarakas MR Titulaer MJ Clinical outcome assessments in Encephalitis: a systematic review Neurol Neuroimmunol Neuroinflamm 2024 11 e200168 10.1212/NXI.0000000000200168 38086078
Brenner J, Olijslagers SHC, Crijnen YS, De Vries JM, Mandarakas MR, Titulaer MJ. Clinical outcome assessments in Encephalitis: a systematic review. Neurol Neuroimmunol Neuroinflamm. 2024;11:e200168.38086078 10.1212/NXI.0000000000200168
37. Tariq S Woodman J Using mixed methods in health research JRSM Short Rep 2013 4 204253331347919 10.1177/2042533313479197
Tariq S, Woodman J. Using mixed methods in health research. JRSM Short Rep. 2013;4:204253331347919.10.1177/2042533313479197
38. Thompson Burdine J Thorne S Sandhu G Interpretive description: a flexible qualitative methodology for medical education research Med Educ 2021 55 336 43 10.1111/medu.14380 32967042
Thompson Burdine J, Thorne S, Sandhu G. Interpretive description: a flexible qualitative methodology for medical education research. Med Educ. 2021;55:336–43.32967042 10.1111/medu.14380
39. Kinchin IM Streatfield D Hay DB Using Concept Mapping to enhance the research interview Int J Qualitative Methods 2010 9 52 68 10.1177/160940691000900106
Kinchin IM, Streatfield D, Hay DB. Using Concept Mapping to enhance the research interview. Int J Qualitative Methods. 2010;9:52–68.10.1177/160940691000900106
40. Harth S, Müller S, Aschenbrenner S, Tucha O, Lange K. Regensburger Wortflüssigkeitstest (RWT). J Neuropsychol 15:315–21.
41. Wechsler D Wechsler Adult Intelligence Scale 2008 4 London, UK Pearson
Wechsler D. Wechsler Adult Intelligence Scale. 4th ed. London, UK: Pearson; 2008.
42. Wechsler D WMS-III Administration and Scoring Manual 1997 San Antonio, TX The Psychological Corporation. Harcourt Brace & Co
Wechsler D. WMS-III Administration and Scoring Manual. San Antonio, TX: The Psychological Corporation. Harcourt Brace & Co; 1997.
43. Schmidt M. Rey Auditory Verbal Learning Test: a handbook. Western Psychological Services; 1996.
44. Rekers S Finke C Translating spatial navigation evaluation from experimental to clinical settings: the virtual environments navigation assessment (VIENNA) Behav Res 2023 56 2033 48 10.3758/s13428-023-02134-0
Rekers S, Finke C. Translating spatial navigation evaluation from experimental to clinical settings: the virtual environments navigation assessment (VIENNA). Behav Res. 2023;56:2033–48.10.3758/s13428-023-02134-0
45. Brearly TW, Shura RD, Martindale SL, Lazowski RA, Luxton DD, Shenal BV et al. Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis. Neuropsychol Rev. 2017;27:174–86.
46. Cella D, Riley W, Stone AA, Rothrock N, Reeve BB, Yount S, et al. The patient reported outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks. J Clin Epidemiol. 2005-2008;63:1179–94.
47. Fujisawa R, Klazinga N. Measuring patient experiences (PREMS): Progress made by the OECD and its member countries between 2006 and 2016. OECD Health Working Papers. 2017;102.
48. Kingsley C Patel S Patient-reported outcome measures and patient-reported experience measures BJA Educ 2017 17 137 44 10.1093/bjaed/mkw060
Kingsley C, Patel S. Patient-reported outcome measures and patient-reported experience measures. BJA Educ. 2017;17:137–44.10.1093/bjaed/mkw060
49. Troyer AK Rich JB Psychometric properties of a New Metamemory Questionnaire for older adults Journals Gerontol Ser B: Psychol Sci Social Sci 2002 57 P19 27 10.1093/geronb/57.1.P19
Troyer AK, Rich JB. Psychometric properties of a New Metamemory Questionnaire for older adults. Journals Gerontol Ser B: Psychol Sci Social Sci. 2002;57:P19–27.10.1093/geronb/57.1.P19
50. Rekers S, Heine J, Thöne-Otto A, Finke C. Neuropsychiatric symptoms and metamemory across the lifespan—Psychometric properties of the German Multifactorial Memory Questionnaire (MMQ). preprint. PsyArXiv; 2024.
51. Krupp LB LaRocca NG Muir-Nash J Steinberg AD The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus Arch Neurol 1989 46 1121 3 10.1001/archneur.1989.00520460115022 2803071
Krupp LB, LaRocca NG, Muir-Nash J, Steinberg AD. The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus. Arch Neurol. 1989;46:1121–3.2803071 10.1001/archneur.1989.00520460115022
52. Buysse DJ Reynolds CF Monk TH Berman SR Kupfer DJ The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research Psychiatry Res 1989 28 193 213 10.1016/0165-1781(89)90047-4 2748771
Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res. 1989;28:193–213.2748771 10.1016/0165-1781(89)90047-4
53. Beck AT, Steer RA, Brown G. Beck Depression Inventory -II (BDI-II). APA PsycTests; 1996.
54. Zigmond AS Snaith RP The Hospital anxiety and Depression Scale Acta Psychiatr Scand 1983 67 361 70 10.1111/j.1600-0447.1983.tb09716.x 6880820
Zigmond AS, Snaith RP. The Hospital anxiety and Depression Scale. Acta Psychiatr Scand. 1983;67:361–70.6880820 10.1111/j.1600-0447.1983.tb09716.x
55. Herdman M Gudex C Kind P Bonsel G Badia X Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L) Qual Life Res 2011 20 1727 36 10.1007/s11136-011-9903-x 21479777
Herdman M, Gudex C, Kind P, Bonsel G, Badia X. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.21479777 10.1007/s11136-011-9903-x
56. Diaz-Arias LA Yeshokumar AK Glassberg B Sumowski JF Easton A Probasco JC Fatigue in survivors of Autoimmune Encephalitis Neurol Neuroimmunol Neuroinflamm 2021 8 e1064 10.1212/NXI.0000000000001064 34389660
Diaz-Arias LA, Yeshokumar AK, Glassberg B, Sumowski JF, Easton A, Probasco JC, et al. Fatigue in survivors of Autoimmune Encephalitis. Neurol Neuroimmunol Neuroinflamm. 2021;8:e1064.34389660 10.1212/NXI.0000000000001064
57. Bull C Byrnes J Hettiarachchi R Downes M A systematic review of the validity and reliability of patient-reported experience measures Health Serv Res 2019 54 1023 35 10.1111/1475-6773.13187 31218671
Bull C, Byrnes J, Hettiarachchi R, Downes M. A systematic review of the validity and reliability of patient-reported experience measures. Health Serv Res. 2019;54:1023–35.31218671 10.1111/1475-6773.13187
58. Czypionka T, Achleitner S. Patient reported outcome and experience measures. Health Syst Watch. 2018;3.
59. Zhang Y Tu E Yao C Liu J Lei Q Lu W Validation of the Clinical Assessment Scale in Autoimmune Encephalitis in Chinese patients Front Immunol 2021 12 796965 10.3389/fimmu.2021.796965 34975905
Zhang Y, Tu E, Yao C, Liu J, Lei Q, Lu W. Validation of the Clinical Assessment Scale in Autoimmune Encephalitis in Chinese patients. Front Immunol. 2021;12:796965.34975905 10.3389/fimmu.2021.796965
60. Dworkin SL Sample size policy for qualitative studies using In-Depth interviews Arch Sex Behav 2012 41 1319 20 10.1007/s10508-012-0016-6 22968493
Dworkin SL. Sample size policy for qualitative studies using In-Depth interviews. Arch Sex Behav. 2012;41:1319–20.22968493 10.1007/s10508-012-0016-6
61. Champely S. pwr: Basic functions for power analysis. 2017.
