
==== Front
PLoS Negl Trop Dis
PLoS Negl Trop Dis
plos
PLOS Neglected Tropical Diseases
1935-2727
1935-2735
Public Library of Science San Francisco, CA USA

39236075
10.1371/journal.pntd.0012442
PNTD-D-24-00551
Research Article
Medicine and Health Sciences
Medical Conditions
Infectious Diseases
Bacterial Diseases
Brucellosis
Medicine and Health Sciences
Medical Conditions
Tropical Diseases
Neglected Tropical Diseases
Brucellosis
Medicine and Health Sciences
Medical Conditions
Infectious Diseases
Zoonoses
Brucellosis
Medicine and Health Sciences
Diagnostic Medicine
Serodiagnosis
Medicine and Health Sciences
Pathology and Laboratory Medicine
Serology
Serodiagnosis
Biology and Life Sciences
Organisms
Bacteria
Brucella
Biology and Life Sciences
Microbiology
Medical Microbiology
Microbial Pathogens
Bacterial Pathogens
Brucella
Medicine and Health Sciences
Pathology and Laboratory Medicine
Pathogens
Microbial Pathogens
Bacterial Pathogens
Brucella
Medicine and Health Sciences
Pathology and Laboratory Medicine
Serology
Medicine and Health Sciences
Diagnostic Medicine
Physical Sciences
Mathematics
Applied Mathematics
Algorithms
Research and Analysis Methods
Simulation and Modeling
Algorithms
Research and Analysis Methods
Immunologic Techniques
Immunoassays
Enzyme-Linked Immunoassays
Medicine and Health Sciences
Public and Occupational Health
Global Health
Diagnosis of brucellosis: Combining tests to improve performance
Diagnosis of brucellosis: Combining tests to improve performance
Loubet Paul Data curation Formal analysis Investigation Validation Writing – original draft 1
Magnan Chloé Data curation Formal analysis Investigation Validation Writing – original draft 2
Salipante Florian Formal analysis Methodology Software Writing – review & editing 3
Pastre Théo Data curation Investigation Software Writing – review & editing 2
Keriel Anne Data curation Investigation Writing – review & editing 4
O’Callaghan David Funding acquisition Investigation Supervision Visualization Writing – review & editing 4
Sotto Albert Formal analysis Project administration Supervision Visualization Writing – review & editing 1
https://orcid.org/0000-0002-9484-0304
Lavigne Jean-Philippe Conceptualization Formal analysis Funding acquisition Investigation Methodology Project administration Validation Visualization Writing – original draft 2 *
1 Virulence Bactérienne et Infections Chroniques, INSERM U1047, Univ Montpellier, Service des Maladies Infectieuses et Tropicales, Centre National de Reference des brucelloses, CHU Nîmes, Nîmes, France
2 Virulence Bactérienne et Infections Chroniques, INSERM U1047, Univ Montpellier, Service de Microbiologie et Hygiène Hospitalière, Centre National de Reference des brucelloses, CHU Nîmes, Nîmes, France
3 Department of Biostatistics, Epidemiology, Public Health and Innovation in Methodology (BESPIM), CHU Nîmes, Univ Montpellier, Nîmes, France
4 Virulence Bactérienne et Infections Chroniques, INSERM U1047, Univ Montpellier, Centre National de Reference des brucelloses, Nîmes, France
Vinetz Joseph M. Editor
Yale University School of Medicine, UNITED STATES OF AMERICA
The authors have declared that no competing interests exist.

* E-mail: jean.philippe.lavigne@chu-nimes.fr
5 9 2024
9 2024
18 9 e001244216 4 2024
7 8 2024
© 2024 Loubet et al
2024
Loubet et al
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Introduction

Brucellosis, a zoonotic infectious disease caused by bacteria of the genus Brucella, remains a significant global health concern in many parts of the world. Traditional diagnostic methods, including serological tests, suffer from limitations, including low sensibility and high false-positive rates, emphasizing the need for improved diagnostic strategies. In this study, we aimed to optimize diagnostic accuracy by reevaluating serological tests and exploring novel diagnostic algorithms.

Methods

A retrospective observational study was conducted using sera collected between June 2012 and June 2023 at the French National Reference Center for Brucella. Various serological tests, including Rose Bengal plate test (RBT), standard agglutination test (SAT), Brucellacapt, and ELISA for IgM and IgG, were performed. Different diagnostic algorithms were evaluated, combining RBT with SAT, Brucellacapt, and ELISA to enhance the performance of diagnostic tests.

Results

Among 3587 sera analyzed, 148 were confirmed cases of human brucellosis. Individual serological tests exhibited good sensitivity and specificity but lacked diagnostic accuracy. However, combining RBT with SAT or Brucellacapt significantly improved diagnostic performance, with reduced false positives. The most promising results were observed when an algorithm was built combining RBT, Brucellacapt, and ELISA for IgM and IgG (a score value of 0.5 with 90.5% for sensitivity, 99.7% for specificity, 92.4% for PPV, and 99.6% for NPV).

Conclusions

Serological tests remain crucial for brucellosis diagnosis, but their limitations necessitate innovative diagnostic approaches. Combining multiple serological tests in diagnostic algorithms shows promise in improving diagnostic accuracy. Efforts to refine diagnostic, strengthen surveillance, and raise awareness are essential for effective brucellosis control, particularly in resource-limited settings.

Author summary

Brucellosis is a zoonotic infectious disease caused by bacteria of the genus Brucella. This disease remains a significant global health concern in many parts of the world. Traditional diagnostic methods include serological tests. However, these tests have major limitations due to their low sensibility and high false-positive rates. This poses a significant challenge in clinical practice, emphasizing the necessity for careful interpretation of test results and the development of more specific diagnostic tools. In this study, we assess the utility of traditional and easily accessible serological tests. Instead of using them individually, we decided to integrate the results of these multiple testing methods. We highlight the value of combining serological results into an algorithm to enhance the diagnosis of brucellosis and achieve greater overall accuracy in diagnosis. Efforts to streamline diagnostic, bolster surveillance, and increase awareness are essential for controlling brucellosis, particularly in resource-limited settings with a high disease burden.

The author(s) received no specific funding for this work. PLOS Publication Stagevor-update-to-uncorrected-proof
Publication Update2024-09-17
Data AvailabilityThe authors confirm that all data underlying the findings are fully available without restriction. All relevant data are within the paper and its Supporting Information files.
Data Availability

The authors confirm that all data underlying the findings are fully available without restriction. All relevant data are within the paper and its Supporting Information files.
==== Body
pmcIntroduction

Brucellosis, a zoonotic infectious disease caused by bacteria of the genus Brucella, remains a significant global health concern, particularly in regions where agriculture and animal husbandry are prevalent. Despite decades of research and control efforts, brucellosis continues to pose challenges due to its diverse clinical manifestations, high prevalence in certain populations (1.6–2.1 million new human cases annually), and potential for chronicity if left untreated [1–4].

Brucella is a facultative intracellular Gram-negative coccobacillus [5]. Among this genus, four species are responsible for human brucellosis: B. melitensis (sheep and goats), B. suis (domestic pigs), B. abortus (cattle), and B. canis (dogs) [1,4]. Humans can become infected by consuming contaminated food, mainly raw milk and dairy products, or by direct contact with infected animals or their bodily fluids, including through the aerosolization of contaminated samples in laboratories [4,6,7].

Brucellosis is a significant human health concern in many parts of the world, especially in Mediterranean countries, the Middle East, South and Central Asia, and Central and South America [6,8]. While some countries, such as France, are officially disease-free, cases still occur in individuals returning from endemic regions. The clinical presentation of brucellosis varies widely, ranging from acute febrile illness with nonspecific symptoms to chronic debilitating conditions affecting multiple organ systems [9]. This variability underscores the importance of accurate and timely diagnosis to facilitate appropriate treatment and prevent complications and relapse [10]. Definitive diagnosis of Brucella infection relies on bacterial isolation, but culture sensitivity decreases as the disease progresses (i.e., during subacute and chronic phases) [8].

Traditional diagnostic methods for brucellosis include culture, serology, and molecular techniques [7,11]. The identification of human cases of brucellosis heavily depends on microbiological analysis, given the variability and lack of specificity of the associated symptoms of this disease [5]. While these approaches have been instrumental in identifying Brucella species and confirming infection, they often suffer from limitations such as low sensitivity, cross-reactivity with other pathogens, and the need for specialized laboratory facilities [7]. Due to their simplicity, cost-effectiveness, and high negative predictive value (NPV), serological tests remain the primary diagnostic tools in endemic areas with limited resources and in countries where the prevalence is low (and considered as a neglected disease) [11]. However, their results require interpretation that is often difficult and frequently inconclusive [12]. The 2006 WHO guidelines recommended the use of the Rose Bengal plate test (RBT) as a sensitive rapid screening test, with confirmation by other more specific tests such as standard agglutination test (SAT), ELISA, or microagglutination tests [13]. The RBT is a card agglutination test that detects both agglutinating and non-agglutinating antibodies, providing positive/negative results [11]. Studies have shown that using serum dilutions in positive qualitative RBT results can improve the test’s specificity [14,15]. However, this test can yield false positive results, the presence of Brucella antibodies in individuals who do not have an active infection. Several factors contribute to false positives, including issues with hemolyzed serum, cross-reactivity with antibodies produced against other pathogens, prior exposure to Brucella or related organisms, and non specific binding of antibodies. In areas where brucellosis is rare, the positive predictive value (PPV) of serological tests may be compromised due to the low likelihood of true positives relative to false positives. This can lead to unnecessary treatment, increased healthcare costs, and patient anxiety. Furthermore, the sensitivity and specificity of serological tests may vary depending on factors such as the stage of infection, the immune status of the patient, and the strain of Brucella involved. False positives can also occur if tests are not performed or interpreted correctly, highlighting the importance of proper training and quality control measures in laboratory settings [11].

Strategies to reduce false positives include using dilution-based cut-offs for positivity, combining multiple tests to improve diagnostic accuracy, and incorporating clinical algorithms that integrate serological modalities. Moreover, commercialization of the serological kit for SAT, validated for human diagnostics, has recently been discontinued, making it necessary to identify new serological diagnostic solutions.

Ultimately, improved diagnostic tools and strategies are essential for effective disease management, surveillance, and control, thereby reducing the burden of brucellosis on human and animal populations worldwide.

In this study, our objectives were to (i) reevaluate the utility of RBT dilution for diagnosing of human brucellosis and (ii) assess the performance of diagnostic algorithms combining RBT and more specific tests.

Methods

Ethics statement

This study was conducted in accordance with the Declaration of Helsinki and had been reviewed and approved by the “Institutional Review Board” Ethics Committee of Nîmes University Hospital under the following number: 2024.03.05.

Patients and human sera

This retrospective observational study was conducted in accordance with the Declaration of Helsinki and French law [16,17]. Sera sent to the French National Reference Center for Brucella (Department of Microbiology, Nîmes University Hospital, Nîmes, France) between June 2012 and June 2023 were included in the analyses. The local ethics committee (Institutional Review Board of Nîmes University Hospital; registration number n°2024.03.05) approved their use in this research. Before inclusion, patients were informed of the study and their rights to oppose the use of their serology results. A verbal consent was obtained from the different patients.

Patients were classified based on the expertise of the National Reference Center: i) confirmed human brucellosis if they exhibited epidemiological and clinical findings and the positivity of blood/tissue culture or had negative cultures but serological tests positive (SAT titer ≥ 1/160; RBT positive; IgG/IgM >11 UI; Brucellacapt≥ 1/160); ii) negative in other situations (no epidemiological and clinical findings, no cultures and negative serological tests).

Serological tests

All samples from a given patient were processed simultaneously and frozen at -20°C.

For the titrated RBT, 30 μL of non-diluted serum was mixed with an equal volume of a suspension in an acidic medium (pH 3.65 ±0.05) and buffered commercial Brucella abortus antigen stained with Rose Bengal (BioMérieux, Marcy l’Etoile, France) [15]. The solution was previously equilibrated at room temperature and shaken to resuspend any bacterial sediment. The mixture was rocked at room temperature for 4 min according to the manufacturer’s recommendations. Any visible agglutination and/or a typical rim were considered positive. Positive sera were titrated by serial twofold dilutions in physiological saline (1/2 to 1/256 dilutions), with 30 μL of dilutions being tested in the same manner as pure serum.

The Wright standard tube agglutination (STA) was performed using a commercial B. abortus antigen (issued from killed B. abortus 119–3 strain) and saline as the diluent (50 μL per well) in tube format (Brucella-WRIGHT, Bio-Rad, Marnes-la-Coquette, France) following the manufacturer’s instructions. A large dilution panel (1/20 to 1/10240) of dilutions was tested to avoid negative results due to a prozone phenomenon. The SAT reactions were read after a 24-h incubation at 37°C. The highest serum dilution showing >50% agglutination was considered the agglutinating titer [12]. A titer of 160 is currently considered the positivity threshold in non-endemic areas [11].

The Brucellacapt (Vircell, Granada, Spain) test employs an immunocapture agglutination technique to detect all classes of antibodies specific to Brucella species in serum samples. Brucellacapt tests were performed according to the manufacturer’s instructions. Serum dilutions varying between 1/80 to 1/5120 were performed in strips of microtiter wells coated with anti-human immunoglobulins. Diluted patient serum and antigen were added to the wells, and the strips were incubated for 24-h at 37°C. Positive reactions show agglutination over the bottom of the well, while negative reactions are indicated by a pellet at the center of the bottom of the well. A cut-off titer of >1/160 is currently used [18–20].

ELISAs for IgM and IgG antibodies were performed on each serum sample using a commercial kit (Vircell). The testing procedure followed the manufacturer’s instructions. The test is performed in 96-well microtiter plates that are precoated with Brucella antigen. Titers over 11 U for IgG and IgM were considered positive.

Statistical analyses

Patients with an "undetermined" diagnosis (< 2 positive serological tests and without any clear epidemiological or clinical data confirming brucellosis) and those with missing values for two of the five tests performed were excluded from the analyses. Diagnostic performances of the different tests and predictive models under evaluation were assessed using sensitivity, specificity, NPV, and PPV. The Area under the ROC curve (AUC) was also reported.

All statistical analyses were conducted using R statistical software version 4.2.0. It should be noted that both quantitative and qualitative variables (the test results) are included in the model. RBT, SAT, and Brucellacapt values represent the dilution levels at which the results become positive. This information was considered a quantitative variable in the model after transforming negative results (samples that never became positive regardless of dilution) to a value of 2. Pure serum was considered as 1, a ½ dilution as 0.5, and so on. IgM and IgG ELISA tests were qualitative variables taking only positive/negative values. The best thresholds were selected to maximize the PPV while maintaining good sensitivity (close to 85% or greater).

Three algorithmic propositions were tried to enhance the diagnosis of brucellosis. The first proposition relies solely on the diluted RBT to improve specificity. The second proposition combines the diluted RBT and SAT or Brucellacapt results. A logistic regression model was employed to integrate these variables and enhance diagnostic performance. The third proposition incorporates four serological tests (RBT, Brucellacapt and IgM and IgG ELISA), also utilizing logistic regression. The formulas for the different models are provided in the article; the indicator function, denoted as 1{x = a}, yields a value of 1 if the condition within the braces is true (x = a here) and 0 otherwise.

For each score, a ROC curve was generated, and optimal thresholds were selected based on optimized sensitivity and specificity. Diagnostic performances, including AUC, sensitivity, specificity, PPV, and NPV, were presented along with their confidence intervals (95%CI). Given that predictive models were constructed, the data were partitioned into a training set (2/3) and a test set (1/3) while maintaining a balance in disease status. Performances were computed in the test set, but final models (leading to the provided formulas) were derived using the entire dataset. Performance metrics for the entire dataset were also provided and demonstrated similarity to those of the test set.

Results

Sera analyzed

Among the 3674 sera received at the French National Reference Center for brucellosis during the study period, 13 were excluded due to missing at least two of the test results (due to insufficient serum quantity), and 74 were excluded due to an undetermined status of the serology. Among the remaining 3587 sera definitively included, 148 were considered as confirmed human brucellosis cases, and 3439 were negative (Fig 1).

10.1371/journal.pntd.0012442.g001 Fig 1 Flowchart of the study.

*Evaluation was exclusively performed on 2105 sera due to the discontinuation of the kit’s commercialization.

Performance of serological tests

The performance of the five serological tests used in this study is presented in Table 1. Overall, these tests exhibited excellent specificities (94.4% to 99.3%) and good sensitivities (72.4% to 97.3%). However, the poor PPVs observed (42.6% to 84%) indicated that the different serological tests needed to be more suitable for drawing clear conclusions on the diagnosis.

10.1371/journal.pntd.0012442.t001 Table 1 Performance of serological tests used to diagnose brucellosis in an area of low prevalence.

	Sensitivity % (95%CI)	Specificity % (95%CI)	VPP % (95%CI)	NPP % (95%CI)	
RBT (threshold: pur)	97.3 (93.2–00.3)	94.4 (93.5–95.1)	42.6 (37.3–48.1)	99.9 (99.7–100)	
SAT (threshold 1/160)*	86.0 (79.2–91.2)	94.9 (93.8–95.8)	55.2 (48.4–61.8)	98.9 (98.4–99.3)	
Brucellacapt (threshold 1/160)	82.4 (75.3–88.2)	99.3 (99.0–99.6)	84.1 (77.2–89.7)	99.2 (98.9–99.5)	
IgM ELISA (threshold > 11U)	73.8 (65.8–80.7)	99.2 (98.9–99.5)	80.5 (72.7–86.8)	98.9 (98.5–99.2)	
IgG ELISA (threshold > 11U)	72.4 (64.4–79.5)	99.2 (98.8–99.4)	78.4 (70.4–85.0)	98.8 (98.4–99.2)	
*Evaluation was exclusively performed on 2105 sera due to the discontinuation of the kit’s commercialization.

Among the serological tests, the SAT is considered as the first screening test. However, as we have seen, it is no longer commercially available in Europe. Interestingly, in countries with low brucellosis prevalence, it is recommended to use a threshold of 1/160 to define test positivity. However, in our series conducted on 2105 sera (due to the discontinuation of SAT commercialization), the test performed better at a titer of 1/80 (sensitivity 95.1%; specificity 90.9%) compared to a titer of 1/160 (sensitivity 86.0%; specificity 94.9%).

Performance of diluted RBT

When performed on pure serum, the sensitivity of RBT was 97.3% [93.2%, 99.3%], whereas the PPV was only 42.6% [37.3%, 48.1%]. When we defined a limit titer > ¼, we observed better performance with 85.1% (95%CI [78.4%, 90.4%]) for sensitivity, 99.3% [99.0%, 99.6%] for specificity, 84.0% [77.1%, 89.5%] for PPV, and 99.4% [99.0%, 99.6%] for NPV (Table 2). However, 22 positives were not detected using this limit, but the number of false positives was reduced from 194 to 24.

10.1371/journal.pntd.0012442.t002 Table 2 The performance of the diluted Rose Bengal test (RBT) was used to diagnose brucellosis.

Dilution threshold (Positive if)	Sensitivity (%)	Specificity (%)	PPV (%)	NPV (%)	
Pure serum	97.3%	94.4%	42.6%	99.9%	
>1/2	94.6%	97.2%	59.6%	99.8%	
>1/4	85.1%	99.3%	84.0%	99.4%	
>1/8	67.6%	99.8%	94.3%	98.6%	
>1/16	43.9%	99.9%	97.0%	97.6%	
*PPV, positive predictive value; NPV, negative predictive value

Performance of diagnostic algorithm combining RBT and SAT

Firstly, we combined the two main serological tests, RBT and SAT results, to determine the best diagnostic algorithm for diagnosing brucellosis. We established the following formula where RBT and SAT corresponded to the positive dilution titer for a given patient: ScoreRBT+SAT=exp(1.936−4.614×RBT−1.451×SAT)(1+exp(1.936−4.614×RBT−1.451×SAT))*

* RBT and SAT are the dilutions from which the test becomes positive. A negative result takes the value 2.

Using a threshold of 0.5, the average performances in 10-fold cross-validation were 84% (Standard Deviation (SD):12%) for sensitivity, 99% (SD: 1%) for specificity, and an AUC = 0.99 (SD: 0.02).

On the whole data set, the performances are 85.3% [78.4%, 90.7%] for sensitivity, 99.1% [98.6%, 99.5%] for specificity, 87.1% [80.4%, 92.2%] for PPV, and 98.9% [98.4%, 99.3%] for NPV. The AUC of the association of these two tests was 0.989 [0.98,0.997] (Table 3). In this model, 16 sera were false positive (on the 1962 negative sera). Due to the cessation of SAT commercialization, this score was established only on 2105 sera.

10.1371/journal.pntd.0012442.t003 Table 3 Comparison of the performance of different diagnostic algorithms using various combinations of serological test results to diagnose brucellosis.

	Threshold (positive if)	Sensitivity %	Specificity %	PPV %	NPV %	No. of false positives	No. of positives diagnosed/No. total of positives	
Diluted RBT	0.25	85.1	99.3	84.0	99.4	24	126/148	
RBT + SAT*	0.5	85.3	99.1	87.1	98.9	18	122/143	
RBT + Brucellacapt	0.5	83.1	99.5	88.5	99.3	16	123/148	
RBT + Brucellacapt + ELISA IgM and IgG	0.5	90.5	99.7	92.4	99.6	11	134/148	
*Evaluation was exclusively performed on 2105 sera due to the discontinuation of the kit’s commercialization

On the test set, the performances are 87.2% [74.3%, 95.2%] for sensitivity, 98.8% [97.7%, 99.5%] for specificity, 83.7% [70.3%, 92.7%] for PPV, and 98.8% [97.7%, 99.5%] for NPV. The AUC of the association of these two tests was 0.991 [0.984, 0.998].

Performance of diagnostic algorithm combining RBT and Brucellacapt

We then evaluated the association between diluted RBT and Brucellacapt, establishing the following formula: Score=exp(0.1615−3.8422×RBT+2.6457×1(Brucellacapt=positive))(1+exp(0.1615−3.8422×RBT+2.6457×1(Brucellacapt=positive))

* RBT and Brucellacapt are the dilutions from which the test becomes positive. A negative result takes the value 2.

Using a threshold of 0.5, the average performances in 10-fold cross-validation were 83% (SD:13%) for sensitivity, 100% [SD: 1%] for specificity, and an AUC = 0.98 (SD: 0.03).

On the whole data set, the performances are 83.1% [76.1%, 88.8%] for sensitivity, 99.5% [99.2%, 99.7%] for specificity, 88.5% [82%, 93.3%] for PPV, and 99.3% [98.9%, 99.5%] for NPV. The AUC of the association of these two tests was 0.986 [0.974,0.998]. In this model, 43 were false positives (out of 3439 negative sera).

On the test set, the performances are 83.7% [70.3%, 92.7%] for sensitivity, 99.2% [98.5%, 99.6%] for specificity, 82% [68.6%, 91.4%] for PPV, and 99.3% [98.6%, 99.7%] for NPV. The AUC of the association of these two tests was 0.995 [0.991, 0.999].

Performance of diagnostic algorithm combining all serological tests

Finally, we combined all serological results to evaluate a diagnostic algorithm using the following formula: y=0.8754−2.9266×RBT−1.7714×1{IgG=negative}+1.0885×1{IgG=positive}−0.5704×1{IgM=negative}+0.5149×1{IgM=positive}+2.2159×1{Brucellacapt=Positive}*

Score=exp(y)(1+exp(y))

* In this formula, the symbol “1” followed by brackets on index referred to the indicator function. The indicator function takes the value 1 if the condition specified into braces is fulfilled and 0 otherwise. RBT corresponds to the dilution from which the test becomes positive. A negative result takes the value 2.

The average performances in 10-fold cross-validation were 89% (SD: 9%) for sensitivity, 100% (SD: 1%) for specificity, and an AUC = 0.99 (SD: 0.03).

On the whole data set, the performances are 90.5% [84.6%, 94.7%] for sensitivity, 99.7% [99.4%, 99.8%] for specificity, 92.4% [86.8%, 96.2%] for PPV, and 99.6% [99.3%, 99.8%] for NPV. The AUC of the association of these two tests was 0.997 [0.995,0.999]. In this model, 11 were false positives (out of 3439 negative sera).

On the test set, the performances are 95.9% [86%, 99.5%] for sensitivity, 99.2% [98.5%, 99.6%] for specificity, 99.2% [98.5%, 99.6%] for PPV, and 99.8% [99.4%, 100%] for NPV. The AUC of the association of these two tests was 0.997 [0.994, 0.999].

Discussion

Brucellosis poses significant diagnostic challenges, complicating public health efforts due to the broad extent of individuals’ contact with infected animals or their products. The nonspecific symptoms associated with brucellosis, such as fever and joint pain, often lead to misdiagnosis or underdiagnosis [11]. Healthcare providers may overlook or misinterpret the disease, delaying appropriate treatment. Moreover, diagnostic inaccuracies are prevalent in regions with limited access to advanced diagnostic tools and healthcare infrastructure, resulting in underestimated disease burden and inadequate public health responses. Paradoxically, diagnostic difficulties can lead to the overestimation of brucellosis cases in regions reliant on less specific diagnostic methods [7,21]. Therefore, there is an urgent need to improve diagnostic methods.

Serological tests, although lacking sensibility and sometimes yielding challenging results in individuals repeatedly exposed to Brucella organisms, remain a cornerstone in diagnosis, particularly in resource-limited countries [11,22]. They are also important tools in countries where brucellosis has been eradicated and the disease has been ‘forgotten’. Evaluating the serodiagnosis tests for brucellosis is complex due to the absence of a single gold standard test against which all other laboratory assays can be measured. Combining existing and cost-effective tests presents an interesting early diagnosis and treatment solution. In this study, we examined the diagnostic potential of five tests for detecting exposure to Brucella: the RBT, SAT, Brucellacapt, and ELISA tests for IgM and IgG. RBT, known for its widespread use as a screening test, often yields a weak PPV due to the often low prevalence of brucellosis and its high sensitivity, particularly as serum dilutions are not usually tested. To address this, our study aimed to optimize test performance while maintaining sensitivity and reducing false positives by establishing dilution-based cut-offs for positivity. We explored various scenarios, from individual test considerations to combinations aimed at enhancing performance.

Utilizing dilutions in RBT gave a significant improvement in diagnostic accuracy, highlighting the importance of this approach in refining testing protocols as previously reported [14,15]. By diluting serum samples, nonspecific reactions can be reduced, enhancing test specificity, leading to more reliable results, and ultimately improving diagnostic accuracy. Furthermore, our investigation into combining tests underscores the potential for enhancing diagnostic capabilities in the detection of anti-Brucella antibodies. Integrating multiple testing methods allows us to use the strengths of each, potentially achieving greater overall accuracy in diagnosis. This integrated approach represents a promising avenue in clinical management, demonstrating the potential benefits of a comprehensive testing strategy. The effectiveness of combining RBT with SAT has already been established, particularly where these tests are the primary diagnostic options available [11]. This underscores the importance of maximizing diagnostic capabilities with the resources at hand. However, due to the discontinuation of SAT commercialization in Europe, it was essential to establish a new strategy to enhance diagnostic accuracy and improve patient care. Finally, combining RBT and Brucellacapt with ELISA IgM and IgG shows a very promising performance, drastically limiting false positives and suggesting the potential for enhanced diagnostic accuracy with a multi-test approach. To our knowledge, this approach is original and has never been reported. However, further investigation is warranted to determine the reliability of this combined algorithm. Specifically, evaluating the algorithm’s performance beyond just the AUC is crucial, as other metrics such as sensitivity, specificity, and PPV provide a more comprehensive assessment of diagnostic accuracy.

Despite their numerous drawbacks [23] such as low sensibility and the difficulty in interpreting results [12,21]), serological tests remain an indispensable diagnostic tool for human brucellosis. Traditionally, the principle was to use a screening test to evoke the diagnosis, followed by a confirmatory test [24]. Here we show that combining tests can improve performance and represents a promising avenue for enhancing diagnostic capabilities in brucellosis detection. By integrating multiple testing methods and combining the strengths of each, such as the sensitivity of one test and the specificity of another, we can achieve greater overall accuracy in diagnosis. This approach demonstrates the potential benefits of a comprehensive and integrated testing approach in managing brucellosis. Research efforts focused on improving the performance of serological tests and developing novel diagnostic techniques are also underway.

The authors thank the Nîmes University Hospital for its structural, human, and financial support through the award obtained by our team during the internal call for tenders ‘Thématiques phares’. We also thank Sarah Kabani for her editing assistance.

10.1371/journal.pntd.0012442.r001
Decision Letter 0
Vinetz Joseph M. Section Editor
© 2024 Joseph M. Vinetz
2024
Joseph M. Vinetz
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Submission Version0
18 May 2024

Dear Dr. Lavigne,

Thank you very much for submitting your manuscript "Diagnosis of brucellosis: combining tests to improve performance" for consideration at PLOS Neglected Tropical Diseases. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. The reviewers appreciated the attention to an important topic. Based on the reviews, we are likely to accept this manuscript for publication, providing that you modify the manuscript according to the review recommendations.

Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Joseph M. Vinetz

Section Editor

PLOS Neglected Tropical Diseases

Joseph Vinetz

Section Editor

PLOS Neglected Tropical Diseases

***********************

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: The authors have applied Rose Bengal plate test (RBT), Wright standard tube agglutination (STA), Brucellacapt® (Vircell, Granada, Spain) test, and/or ELISA for IgM and IgG antibodies to determine whether the combination of these tests will improve the clinical diagnosis of brucellosis. They have included 3,587 serum samples in the test. The authors have performed RBT, RBT+SAT, RBT+Brucellacapt®, or RBT + Brucellacapt® + ELISA IgM and IgG tests with statistical analysis. There are no concerns about ethical or regulatory requirements.

--------------------

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: The authors have applied all these techniques and found that 148 serum samples are positive, white 3,439 serum samples are negative. The results, including the figures and Tables are well presented.

--------------------

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: This is a straightforward seroloigcal study. The authors have concluded that the combination of multiple serological tests of brucellosis may improve diagnostic accuracy, which may help effective brucellosis control, particularly in resource-limited settings.

--------------------

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: A minor modification is needed. Please see the enclosed revised manuscript.

--------------------

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: The manuscript didn't show any novel test. However, the proposed test may help to improve the serologic test to improve the diagnosis of brucellosis.

--------------------

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

References

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article's retracted status in the References list and also include a citation and full reference for the retraction notice.

Attachment Submitted filename: PNTD-D-24-00551_reviewer1.pdf

10.1371/journal.pntd.0012442.r002
Author response to Decision Letter 0
Submission Version1
27 May 2024

Attachment Submitted filename: CoverLetter27052024.docx

10.1371/journal.pntd.0012442.r003
Decision Letter 1
Vinetz Joseph M. Section Editor
© 2024 Joseph M. Vinetz
2024
Joseph M. Vinetz
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Submission Version1
3 Jun 2024

Dear Dr. Lavigne:

Thank you very much for submitting your manuscript "Diagnosis of brucellosis: combining tests to improve performance" (PNTD-D-24-00551R1) for review by PLOS Neglected Tropical Diseases.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. Based on the reviews, we regret that we will not be pursuing this manuscript for publication at PLOS Neglected Tropical Diseases.

This is primarily a review and this topic has been very much addressed already. This ms does not advance the field.

The reviews are attached below this email, and we hope you will find them helpful if you decide to revise the manuscript for submission elsewhere.

While we cannot consider your manuscript further for publication in PLOS Neglected Tropical Diseases, we would like to offer you the option to transfer your submission, with reviews, to PLOS Global Public Health https://www.editorialmanager.com/PGPH/

If you DO wish to transfer your submission, please click this link:

<DeepLinkData><DeepLinkTypeID>27</DeepLinkTypeID><peopleID>149726</peopleID><userSecurityID>ed463a46-7cfc-4daf-8502-24ce222a9620</userSecurityID><documentID>33474</documentID><revision>1</revision><manuscriptNumber>PNTD-D-24-00551</manuscriptNumber><docSecurityID>af32d043-7d85-4c7f-85a8-0ed555ed5407</docSecurityID></DeepLinkData>

If you do NOT wish to transfer your submission, please click this link to decline:

<DeepLinkData><DeepLinkTypeID>28</DeepLinkTypeID><peopleID>149726</peopleID><userSecurityID>ed463a46-7cfc-4daf-8502-24ce222a9620</userSecurityID><documentID>33474</documentID><revision>1</revision><manuscriptNumber>PNTD-D-24-00551</manuscriptNumber><docSecurityID>af32d043-7d85-4c7f-85a8-0ed555ed5407</docSecurityID></DeepLinkData>

Please note, all PLOS journals are editorially independent and vary in submission requirements.

Should you choose to transfer, your manuscript files, along with the reviewers' comments and their identities will be transferred automatically, and you will receive a confirmation email within 24 hours. Once transferred, your submission will be returned to you so you can check over your record before completing the submission. You may be asked to provide additional information, such as a response to the reviewers' comments. If you have any questions, please contact the editorial office of PLOS Global Public Health https://www.editorialmanager.com/PGPH/

We are sorry that the news is not more positive on this occasion, and we hope you will consider PLOS Neglected Tropical Diseases for future submissions. Thank you for your support of PLOS and of open-access publishing.

Sincerely,

Joseph M. Vinetz

Section Editor

PLOS Neglected Tropical Diseases

Joseph Vinetz

Section Editor

PLOS Neglected Tropical Diseases

Shaden Kamhawi

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

orcid.org/0000-0003-4304-636X

Paul Brindley

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

orcid.org/0000-0003-1765-0002

***********************

10.1371/journal.pntd.0012442.r004
Author response to Decision Letter 1
Submission Version2
31 Jul 2024

Attachment Submitted filename: CoverLetter31072024.docx

10.1371/journal.pntd.0012442.r005
Decision Letter 2
Vinetz Joseph M. Section Editor
© 2024 Joseph M. Vinetz
2024
Joseph M. Vinetz
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Submission Version2
7 Aug 2024

Dear Dr. Lavigne,

We are pleased to inform you that your manuscript 'Diagnosis of brucellosis: combining tests to improve performance' has been provisionally accepted for publication in PLOS Neglected Tropical Diseases.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Joseph M. Vinetz

Section Editor

PLOS Neglected Tropical Diseases

Joseph Vinetz

Section Editor

PLOS Neglected Tropical Diseases

***********************************************************

10.1371/journal.pntd.0012442.r006
Acceptance letter
Vinetz Joseph M. Section Editor
© 2024 Joseph M. Vinetz
2024
Joseph M. Vinetz
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
30 Aug 2024

Dear Dr. Lavigne,

We are delighted to inform you that your manuscript, "Diagnosis of brucellosis: combining tests to improve performance," has been formally accepted for publication in PLOS Neglected Tropical Diseases.

We have now passed your article onto the PLOS Production Department who will complete the rest of the publication process. All authors will receive a confirmation email upon publication.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any scientific or type-setting errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Note: Proofs for Front Matter articles (Editorial, Viewpoint, Symposium, Review, etc...) are generated on a different schedule and may not be made available as quickly.

Soon after your final files are uploaded, the early version of your manuscript will be published online unless you opted out of this process. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Shaden Kamhawi

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Paul Brindley

co-Editor-in-Chief

PLOS Neglected Tropical Diseases
==== Refs
References

1 Pappas G , Papadimitriou P , Akritidis N , Christou L , Tsianos EV . The new global map of human brucellosis. Lancet Infect Dis. 2006;6 (2 ):1–24. doi: 10.1016/S1473-3099(06)70382-6 16377523
2 Brucellosis. WHO; 2020 [Accessed on 8 Dec 2023]. Available from: https://www.who.int/news-room/fact-sheets/detail/brucellosis
3 Centers for Disease Control and Prevention. CDC estimates human Brucella infections could be four times higher than previously thought. Food Safety; 2023. Available from: https://www.food-safety.com/articles/8817-cdc-estimates-human-brucella-infections-could-be-four-times-higher-than-previously-thought.
4 Laine CG , Johnson VE , Scott HM , Arenas-Gamboa AM . Global estimate of human brucellosis incidence. Emerg Infect Dis. 2023;29 (9 ):1789–1797. doi: 10.3201/eid2909.230052 37610167
5 Whatmore AM , Koylass MS , Muchowski J , Edwards-Smallbone J , Gopaul KK , Perrett LL . Extended multilocus sequence analysis to describe the global population structure of the genus Brucella: phylogeography and relationship to biovars. Front Microbiol. 2016;7 :2049. doi: 10.3389/fmicb.2016.02049 28066370
6 Bennett NJ . Brucellosis. Medscape; 2021 [Accessed on 25 March 2024]. Available from: https://emedicine.medscape.com/article/213430-overview?form=fpf
7 Qureshi KA , Parvez A , Fahmy NA , Abdel Hady BH , Kumar S , Ganguly A , et al . Brucellosis: epidemiology, pathogenesis, diagnosis and treatment-a comprehensive review. Ann Med. 2023;55 (2 ):2295398. doi: 10.1080/07853890.2023.2295398 38165919
8 Franco MP , Mulder M , Gilman RH , Smits HL . Human brucellosis. The Lancet Infectious Diseases 2007;7 (12 ):775–86. doi: 10.1016/S1473-3099(07)70286-4 18045560
9 Young EJ . An overview of human brucellosis. Clin Infect Dis. 1995;21 (2 ):283–289; quiz 290. doi: 10.1093/clinids/21.2.283 8562733
10 Ariza J , Corredoira J , Pallares R , Viladrich PF , Rufi G , Pujol M , et al . Characteristics of and risk factors for relapse of brucellosis in humans. Clin Infect Dis. 1995;20 (5 ):1241–1249. doi: 10.1093/clinids/20.5.1241 7620005
11 Yagupsky P , Morata P , Colmenero JD . Laboratory diagnosis of human brucellosis. Clin Microbiol Rev. 2020;33 (1 ):e00073–199. doi: 10.1128/CMR.00073-19 31722888
12 Al Dahouk S , Nöckler K . Implications of laboratory diagnosis on brucellosis therapy. Expert Rev Anti-Infect Ther. 2011;9 (7 ):833–845. doi: 10.1586/eri.11.55 21810055
13 Corbel MJ , Food and Agriculture Organization of the United Nations, World Health Organization, World Organisation for Animal Health. Brucellosis in humans and animals. 2006 [Accessed on 25 March 2024]. Available from: https://apps.who.int/iris/handle/10665/43597
14 Ruiz-Mesa JD , Sánchez-Gonzalez J , Reguera JM , Martín L , Lopez-Palmero S , Colmenero JD . Rose Bengal test: diagnostic yield and use for the rapid diagnosis of human brucellosis in emergency departments in endemic areas. Clin Microbiol Infect. 2005;11 (3 ):221–225. doi: 10.1111/j.1469-0691.2004.01063.x 15715720
15 Díaz R , Casanova A , Ariza J , Moriyón I . The Rose Bengal Test in Human Brucellosis: A Neglected Test for the Diagnosis of a Neglected Disease. PLoS Negl Trop Dis. 2011;5 (4 ):e950. doi: 10.1371/journal.pntd.0000950 21526218
16 World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310 (20 ):2191–2194. doi: 10.1001/jama.2013.281053 24141714
17 Toulouse E , Granier S , Nicolas-Robin A , Bahans C , Milman A , Andrieu VR , et al . The French clinical research in the European Community regulation era. Anaesth Crit Care Pain Med. 2023;42 (2 ):101192. doi: 10.1016/j.accpm.2022.101192 36572104
18 Orduna A , Almaraz A , Prado A , Gutierrez MP , Garcia-Pascual A , Dueñas A , et al . Evaluation of an immunocapture-agglutination test (Brucellacapt) for serodiagnosis of human brucellosis. J Clin Microbiol. 2000;38 (11 ):4000–4005. doi: 10.1128/JCM.38.11.4000-4005.2000 11060059
19 Casao MA , Navarro E , Solera J . Evaluation of Brucellacapt for the diagnosis of human brucellosis. J Infect. 2004;49 (2 ):102–8. doi: 10.1016/j.jinf.2004.03.004 15236916
20 Casanova A , Ariza J , Rubio M , Masuet C , Diaz R . BrucellaCapt versus classical tests in the serological diagnosis and management of human brucellosis. Clin Vaccine Immunol. 2009;16 (6 ):844–51. doi: 10.1128/CVI.00348-08 19369480
21 Di Bonaventura G , Angeletti S , Ianni A , Petitti T , Gherardi G . Microbiological Laboratory Diagnosis of Human Brucellosis: An Overview. Pathogens. 2021;10 (12 ):1623. doi: 10.3390/pathogens10121623 34959578
22 Xu N , Qu C , Sai L , Wen S , Yang L , Wang S , et al . Evaluating the efficacy of serological testing of clinical specimens collected from patients with suspected brucellosis. PLoS Negl Trop Dis. 2023;17 (2 ):e0011131. doi: 10.1371/journal.pntd.0011131 36802393
23 Eldin C , Parola P , Raoult D . Limitations of diagnostic tests for bacterial infections. Med Mal Infect. 2018;49 (2 ):98–101 doi: 10.1016/j.medmal.2018.12.004 30686500
24 Suo B , He J , Wu C , Wang D . Comparison of Different Laboratory Methods for Clinical Detection of Brucella Infection. Bull Exp Biol Med. 2021;172 (2 ):223–227. doi: 10.1007/s10517-021-05367-1 34853970
