
==== Front
PLoS One
PLoS One
plos
PLOS ONE
1932-6203
Public Library of Science San Francisco, CA USA

10.1371/journal.pone.0308970
PONE-D-24-13313
Research Article
Research and Analysis Methods
Immunologic Techniques
Immunoassays
Immunofluorescence
Physical Sciences
Mathematics
Applied Mathematics
Algorithms
Research and Analysis Methods
Simulation and Modeling
Algorithms
Biology and Life Sciences
Cell Biology
Cytometry
Biology and Life Sciences
Agriculture
Crop Science
Crops
Computer and Information Sciences
Software Engineering
Computer Software
Engineering and Technology
Software Engineering
Computer Software
Research and analysis methods
Specimen preparation and treatment
Staining
Nuclear staining
DAPI staining
Medicine and Health Sciences
Surgical and Invasive Medical Procedures
Biopsy
Research and Analysis Methods
Specimen Preparation and Treatment
Staining
Membrane Staining
PUPAID: A R + ImageJ pipeline for thorough and semi-automated processing and analysis of multi-channel immunofluorescence data
PUPAID pipeline for analysis of multi-channel immunofluorescence data
https://orcid.org/0000-0002-9713-1132
Régnier Paul Conceptualization Data curation Formal analysis Investigation Methodology Resources Software Validation Visualization Writing – original draft Writing – review & editing 1 2 *
Montardi Camille Formal analysis Investigation 3
Maciejewski-Duval Anna Data curation Formal analysis Investigation Methodology Project administration Resources Supervision 1 2
Marques Cindy Resources Writing – original draft 1 2 4 5
Saadoun David Project administration Supervision Writing – original draft 1 2 4 5
1 Immunology-Immunopathology-Immunotherapy (i3) Laboratory, INSERM UMR-S 959, Sorbonne Université, Paris, France
2 Biotherapy Unit (CIC-BTi), Inflammation-Immunopathology-Biotherapy Department (DHU i2B), Groupe Hospitalier Pitié-Salpêtrière, Assistance Publique-Hôpitaux de Paris (AP-HP), Paris, France
3 Département de Médecine Interne, Hôpital Ambroise Paré, Assistance Publique-Hôpitaux de Paris (AP-HP), Université Paris Saclay, Boulogne-Billancourt, France
4 Département de Médecine Interne et Immunologie Clinique, Groupe Hospitalier Pitié-Salpêtrière, Assistance Publique-Hôpitaux de Paris (AP-HP), Sorbonne Université, Paris, France
5 Centre National de Référence Maladies Autoimmunes Systémiques Rares, Centre National de Référence Maladies Autoinflammatoires et Amylose Inflammatoire, Inflammation-Immunopathology-Biotherapy Department (DMU 3iD), Groupe Hospitalier Pitié-Salpêtrière, Assistance Publique-Hôpitaux de Paris (AP-HP), Sorbonne Université, Paris, France
Pesce Luca Editor
Università di Pisa: Universita degli Studi di Pisa, ITALY
Competing Interests: The authors have declared that no competing interests exist.

* E-mail: paul.regnier@aphp.fr, paul.regnier@sorbonne-universite.fr
19 9 2024
2024
19 9 e03089706 5 2024
2 8 2024
© 2024 Régnier et al
2024
Régnier et al
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

PUPAID is a workflow written in R + ImageJ languages which is dedicated to the semi-automated processing and analysis of multi-channel immunofluorescence data. The workflow is designed to extract fluorescence signals within automatically-segmented cells, defined here as Areas of Interest (AOI), on whole multi-layer slides (or eventually cropped sections of them), defined here as Regions of Interest (ROI), in a simple and understandable yet thorough manner. The included (but facultative) R Shiny-based interactive application makes PUPAID also suitable for scientists who are not fluent with R programming. Furthermore, we show that PUPAID identifies significantly more cells, especially in high-density regions, as compared to already published state-of-the-art methods such as StarDist or Cellpose. For extended possibilities and downstream compatibility, single cell information is exported as FCS files (the standardized file format for single cell-based cytometry data) in order to be openable using any third-party cytometry analysis software or any analysis workflow which takes FCS files as input.

The author(s) received no specific funding for this work. Data AvailabilityPUPAID code is fully available as a GPLv3-licensed R package accessible from a dedicated GitHub repository (https://github.com/PaulRegnier/PUPAID). However, due to its own size, the example dataset is not directly included within PUPAID package. Instead, it is fully accessible from the Data Station Life Sciences repository hosted by the Data Archiving and Networked Services (DANS) via the following URL: https://doi.org/10.17026/LS/7XQFAT. Noteworthily, a complete tutorial which features and describes the full step-by-step code applied on the example dataset is also available at https://paul-regnier.fr/tutoriel-pupaid/. To help users to better apprehend PUPAID, we also provide a YouTube video which shows the full course of the workflow applied on the example dataset: https://youtu.be/58Tm54OVP-g.
Data Availability

PUPAID code is fully available as a GPLv3-licensed R package accessible from a dedicated GitHub repository (https://github.com/PaulRegnier/PUPAID). However, due to its own size, the example dataset is not directly included within PUPAID package. Instead, it is fully accessible from the Data Station Life Sciences repository hosted by the Data Archiving and Networked Services (DANS) via the following URL: https://doi.org/10.17026/LS/7XQFAT. Noteworthily, a complete tutorial which features and describes the full step-by-step code applied on the example dataset is also available at https://paul-regnier.fr/tutoriel-pupaid/. To help users to better apprehend PUPAID, we also provide a YouTube video which shows the full course of the workflow applied on the example dataset: https://youtu.be/58Tm54OVP-g.
==== Body
pmcIntroduction

Since the discoveries of optical microscopy during in the late-16th century by Hans and Zacharias Janssen and the fluorescence phenomenon by Sir John Frederick William Herschel in the mid-19th century [1], scientists made considerable improvements in the fluorescence microscopy field. In parallel, the emergence and development of electronic devices capable of acquiring with more and more sensitivity fluorescence signals as well as processing them strongly contributed to the astonishing expansion of the fluorescence microscopy and imaging fields [2–11]. Nowadays, the immunofluorescence technique is commonly and broadly used in a variety of research topics, and notably in biology, immunology and oncology. During the last decade, it gained even more potential, as new multiplexing immunofluorescence techniques allowing to stain up to 100 markers simultaneously were massively developed [12–15].

Unfortunately, these gradual but major improvements also came with an important drawback incarnated by the exponential increase of the complexity of the generated images and datasets, especially regarding the number of acquired markers, the images resolution but also the size of the analyzed cohorts [12, 14, 15]. Among the different software intended to decorticate this impressive amount of data, commercially available ones rank among the most powerful analysis tools (such as InForm from Akoya Biosciences, HALO from Indica Labs or Visiopharm from the eponym brand). On the contrary, open-source and free counterparts (such as ImageJ, QuPath, CellProfiler or Napari), which are technically able to offer equivalent analyses, frequently come with a steeper learning curve and the “highly recommended-to-almost mandatory” need to use macros or scripts (and thus programming) in order to switch from manual sample-by-sample image treatments and analyses to efficient and automatized high-throughput pipelines and workflows capable to handle more samples and datasets with a higher complexity [12, 16–20].

Noteworthily, the previous paragraph becomes less and less true, thanks to the appearance of a plethora of new analysis methods [12, 16, 17, 20–22], including high-level deep-learning- and neural network-based tools, such as CellSighter [23] and CellSpotter [24] which allow to segment cells, extract fluorescence information as well as cluster and classify cells according to their phenotypes and to a priori known references. Additionally, the vast majority of the available methods only seems to propose a given kind of analysis and almost never include the appropriate pre-processing steps for the raw images. Moreover, as time goes by, such innovative analysis methods require from users a continuously growing bioinformatic background, for instance related to the generation, tuning and use of models. Apart from the difficulty this can represent for the majority of scientists who are not fluent in programming, the training and tuning of models is often very time-consuming as well as computing intensive, thus making these steps restricted to GPUs and/or to high-end computing nodes.

Here, we propose a R package named PUPAID (Pipeline for Unleashed Processing and Analysis of Immunofluorescence Data) which is a complete processing and analysis workflow designed for sequential same-slide multiplex immunofluorescence data: through either its command line- or interactive R Shiny application-based modes, it is intended to transform image-embedded data to single cell-based information in a manner that is as unsupervised as possible with limited human intervention. What first sets PUPAID apart is its significantly better performance for cell segmentation and retrieval as compared to other already published cell segmentation methods like StarDist [25, 26] and Cellpose [27], notably in tissue areas with high cell confluence. With its most balanced σ parameters, PUPAID is overall (all measured metrics averaged) 32.11% and 40.8% more efficient than StarDist and Cellpose, respectively, to identify cells in highly-infiltrated regions, whereas it is 10.51% less efficient than StarDist but 16.09% more efficient than Cellpose in lowly-infiltrated regions. Second, the extracted information, such as cell coordinates, shape descriptors and fluorescence levels, are ultimately integrated in the form of all-in-one FCS files, which are thus ready to be analyzed through already adapted and experienced tools and software. Consequently, researchers are still free to analyze their results in the way they want to. We believe that PUPAID will help to standardize and improve both quality and speed of analyses which use multiplex immunofluorescence datasets and thus greatly ease the subsequent results production and interpretation by researchers and scientists.

Material and methods

Example dataset for learning and test purposes

For learning and test purposes, PUPAID includes a dataset composed of 17 tiles (TIFF format) which contain demultiplexed signals of an 8-plex immunofluorescence experiment performed using Opal technology from Akoya Biosciences, following their standard staining protocol. The staining was performed on a 5μm thick slide coming from FFPE-embedded salivary gland biopsy taken from a patient with Sjögren’s syndrome and subsequently acquired with a Vectra Polaris scanner. The patient involved in the test dataset indeed gave informed consent for biopsies and associated clinical research. The staining panel (primarily designed to target and study the whole B and T cells compartments as well as several other features) was constructed as following: DAPI, anti-IL-21 (revealed with Opal 480), anti-CD21 (revealed with Opal 520), anti-TNFα (revealed with Opal 540), anti-CD4 (revealed with Opal 570), anti-IFNγ (revealed with Opal 620), anti-CD27 (revealed with Opal 650) and anti-CD20 (revealed with Opal 690). After acquisition, each of the generated tiles was demultiplexed using the InForm tool coming with the Vectra Polaris acquisition software. Due to its size, the example dataset is not directly included within PUPAID R package. Instead, it is fully accessible from the Data Station Life Sciences repository hosted by the Data Archiving and Networked Services (DANS) via the following URL: https://doi.org/10.17026/LS/7XQFAT. Of note, the test dataset does not allow to fairly generate biologically relevant results alone, as it represents only 1 acquisition from 1 patient, without any control tissue. It is rather intended to present the possibilities of PUPAID and show how to use it.

Benchmarking of the different cell segmentation approaches

Several sections of this manuscript describe, quantify and evaluate the efficiency of different cell segmentation methods. This could either involve the comparison of PUPAID method performance with or without the use of local contrast enhancement (CLAHE) algorithm before cell segmentation or the comparison of the manual cell segmentation to PUPAID, StarDist and Cellpose methods. Regardless of the objective, we applied each corresponding method independently on 10 distinct crops of dimensions 200x200 pixels coming from the example dataset described above in the Example dataset for learning and test purposes subsection of the Material and methods section: 5 coming from high-density (HD) regions and 5 coming from low-density (LD) regions. From the subsequent cell segmentation results, we extracted the respective binary masks using ImageJ. Then, we used the ImageJ plugin MiC (accessible here: https://github.com/MultimodalImagingCenter/MiC) to compute intermediate metrics such as true positives (TP), false positives (FP) and false negatives (FN) indices, as well as 4 different final metrics (Precision, defined as TPTP+FP, Recall/sensitivity defined as TPTP+FN, Jaccard defined as TPTP+FP+FN and F-measure defined as 2TP2TP+FP+FN) for each Intersection over Union (IoU) threshold ranging between 0 and 1 with a step of 0.05. This standard benchmarking method allows to generate curves (with the x-axis showing the different IoU thresholds and the y-axis showing any metric of interest) that we can thoroughly compare between the methods/parameters used. Of note, we used the dedicated StarDist ImageJ plugin and the Python implementation with GUI of Cellpose in their latest versions and with their respective default parameters. For StarDist, the Versatile (fluorescent nuclei) model was used, and for Cellpose V2, the mean cell diameter was automatically determined and used within the nuclei model. Regarding PUPAID method, the initial sigmaLow value used for the related Difference of Gaussians (DoG) analyses was defined as 2.13, which is resulting from the r=σ2log(255)−1 relation with an estimated mean cell radius (r) of 7.5μm, as measured with ImageJ. We then computed our different sigmaHigh values as the sigmaLow value multiplied by different factors: 1.1, 1.2, 1.4, 1.5, 2, 5 and 10, which composed the different sets of σ ratios further described in this manuscript.

Results and discussion

Installation and dependencies

PUPAID relies on the following R packages in order to be installed and perform its routine normally: devtools, foreach, flowCore, data.table, Biobase, methods, writexl, shiny and shinyFiles, which are all accessible via either CRAN or Bioconductor repositories. These should normally be automatically downloaded during installation, except for the devtools package which must be manually installed with the following command: install.packages("devtools") then loaded with the following one: library(“devtools”). After installation and loading of the devtools package, users only have to run the following command to install PUPAID: devtools::install_github("PaulRegnier/PUPAID"). When the installation is finished, PUPAID can be loaded with the following command: library("PUPAID").

PUPAID also relies on the presence of the ImageJ software (or its improved version, Fiji), which can be respectively downloaded on the following websites: https://imagej.net/ij/download.html and https://imagej.net/software/fiji/downloads.

General overview of PUPAID

PUPAID is designed as a tool to directly pre-process, process and analyze image files coming from sequential same-slide multiplex immunofluorescence experiments. It basically takes as input TIFF images of ROI that can be as large as the file format allows. At the moment of the publication of this manuscript, we did not implement methods to process immunofluorescence multiplexes generated with adjacent slides, although this could be implemented in the future if users show interest in such feature. The first objective of PUPAID is to process the fluorescence signals using background subtraction coupled to flatfield correction using the rolling ball algorithm [28] and by locally enhancing the contrast using CLAHE algorithm [29]. The second objective is to determine cell contouring using the well-known Difference of Gaussians (DoG) method [30–33], which is classically applied on intranuclear (using for instance 4′,6-diamidino-2-phenylindole, DAPI) or cell membrane staining (using for instance CellBrite Cytoplasmic Membrane Dyes from Biotium or CellMask Plasma Membrane Stains from ThermoFisher Scientific). Afterwards, the fluorescence of each remaining channel is computed for each segmented cell and exported in TSV- and XLSX-formatted tables, as well as other information such as the spatial coordinates of each cell and several descriptors of their shape (area, circularity, roundness and solidity). In parallel, the processed images are exported for each channel (either individually or in a single stack). Finally, PUPAID merges the exported TSV tables into a single FCS file per analyzed ROI. These FCS files are then ready to be opened and analyzed through any third-party cytometry analysis software, such as FlowJo (BD Life Sciences), Kaluza (Beckman Coulter), FCS Express (De Novo Software), BD FACSDiva (BD Biosciences), CytExpert (Beckman Coulter) and so on, or even by dedicated analysis pipelines like PICAFlow [34], cytofkit [35] or CyTOF [36] R packages. The Fig 1 shows the detailed workflow as performed by PUPAID. Of note, apart from its standard command line-based implementation, PUPAID can also be fully used via an integrated R Shiny interactive application, which allows users who are not very familiar with programming to use PUPAID in an easier, more graphical and practical manner. Of note, a YouTube video showing the full course of the workflow is available to help future users to better apprehend PUPAID: https://youtu.be/58Tm54OVP-g.

10.1371/journal.pone.0308970.g001 Fig 1 Overview of PUPAID workflow.

PUPAID is able to process raw immunofluorescence data, extract cell-based information and convert them into TSV- and XLSX-formatted tables as well as into cytometry FCS files for easy and thorough analysis.

Pre-processing of raw data

According to the raw data type, different pre-processing steps may be needed before the actual analysis part. If the acquired data is in a non-tile-based format, such as CZI (Zeiss), one should first open these with third-party software–like ZEN from Zeiss, or open-source ones such as QuPath (Windows and MacOS platforms), Fiji (all platforms) or czifile (Python-based)–in order to extract the desired ROI (as many as needed) in TIFF format (eventually LZW-compressed whenever possible to minimize disk usage). If the acquired data is rather in a tile-based format, such as IM3 (Akoya Biosciences), one should convert them to TIFF before using PUPAID. In the precise case of IM3 format, the demultiplexing feature included in the InForm analysis software from Akoya Biosciences already converts the tiles from IM3 to TIFF format during demultiplexing. Please note that this first step is indeed dependent on the acquisition platform used and may vary accordingly. In summary, PUPAID requires as input TIFF-formatted multi-channel images, either for a full ROI or for a batch of tiles. Importantly, PUPAID is able, without any human intervention, to automatically reorder and stitch a batch of tiles to regenerate one or several full ROI (depending on the contiguity of the provided tiles). PUPAID also proposes to generate black tiles (that is to say devoid of any fluorescence signal) which will eventually be used to reconstitute rectangular ROI with missing tiles. Noteworthily, at the moment, these features were only tested with tiles coming from demultiplexed IM3 raw data acquired using a Vectra Polaris scanner from Akoya Biosciences. That said, PUPAID could still be updated in the future to take other file formats as input if needed.

Processing of ROI

In order to process the signals contained in each desired ROI, PUPAID separates each channel from the global stack and asks the user to manually give them a name for further identification. This renaming step is essential to correctly choose which channel should be used for the subsequent DoG algorithm application and which ones will be measured within the segmented cells. Usually, as DAPI is very commonly used in multi-channel immunofluorescence experiments for nuclei staining, this will likely represent the best possible choice. Nevertheless, this DoG method may also be used on other signals like cell membrane staining with dyes such as CellBrite Cytoplasmic Membrane Dyes from Biotium or CellMask Plasma Membrane Stains from ThermoFisher Scientific for instance. Please note that at the moment, PUPAID has only been tested with DAPI, but could eventually be updated to better integrate the treatment of other staining. After the selection of the desired channel, PUPAID will process it by subtracting the background and correcting for uneven illumination using the rolling ball algorithm [28] then by locally enhancing the contrast using CLAHE algorithm [29], and finally by applying the DoG algorithm for cell segmentation. By default, the CLAHE algorithm we implemented uses 30 pixels-sized blocks, 256 histogram bins, a maximum slope of 3 and uses the fast implementation of the filter. In all cases, users still have the possibility to edit these values if the default parameters do not produce satisfying enough results.

When the cell segmentation is finished, the user is asked to add a supplemental AOI in the dedicated mask within an area of the ROI which is devoid of any real fluorescence signal. This reference AOI will be used to compute the Corrected Total Cell Fluorescence (CTCF) for each channel of each segmented cell (see Table 1 for the mathematical definition of CTCF). Afterwards, the remaining channels are also processed (including background subtraction and local contrast enhancing), and the fluorescence signals within each previously determined segmented cell as well as other information such as their spatial coordinates and several estimators of their shape (area, circularity, roundness and solidity, see Table 1) are computed and exported in TSV- and XLSX-formatted tables. In parallel, processed images of each channel (either one per channel or embedded within a single stack per ROI) are also exported as LZW-compressed TIFF images.

10.1371/journal.pone.0308970.t001 Table 1 Metrics used or produced by PUPAID.

This table summarizes all the metrics which are used or produced through PUPAID workflow, as well as their full names, formulas and short descriptions. All metrics except CTCF are directly computed and exported using the Measure feature in ImageJ. CTCF for each parameter are computed afterwards via R during the generation of the merged FCS file using the formula presented in the table.

Metric	Description	
Cell	Unique identification number of an identified cell.	
Label	Fluorescence parameter for which the associated measures were made.	
Area	Area of an identified cell.	
Mean	Average gray value for the fluorescence parameter specified by Label within an identified cell. For an identified cell, this is the sum of the gray values of all the pixels divided by the number of pixels.	
X	X-axis location of the centroid of an identified cell. For an identified cell, the centroid is defined as the center point, which is the average of the X coordinates of all the pixels.	
Y	Y-axis location of the centroid of an identified cell. For an identified cell, the centroid is defined as the center point, which is the average of the Y coordinates of all the pixels.	
Circ.	Short for Circularity. Defined as 4πxAreaPerimeter2. Considered as a shape descriptor of an identified cell. A circularity value of 1 indicates a perfect circle. As the value approaches 0, it indicates an increasingly elongated polygon.	
IntDen	Short for Integrated Density. For an identified cell, defined as Area × Mean for the fluorescence parameter specified by Label.	
RawIntDen	Short for Raw Integrated Density. For an identified cell, defined as the sum of the values of the pixels for the fluorescence parameter specified by Label.	
AR	Short for Aspect Ratio. Defined as Majoraxisminoraxis. Considered as a shape descriptor of an identified cell.	
Round	Short for Roundness. Defined as 4xAreaπx(Majoraxis)2. Considered as a shape descriptor of an identified cell.	
Solidity	Defined as AreaConvexarea. Considered as a shape descriptor of an identified cell.	
CTCF	Short for Corrected Total Cell Fluorescence. Defined as IntDen–(Area × Mean fluorescence of background). Represents the fluorescence level of a cell for the marker specified by Label once the background is subtracted.	

Assessment of the CLAHE algorithm usefulness before PUPAID-mediated cell segmentation

First, we were interested to evaluate the usefulness of CLAHE algorithm before cell segmentation performed through PUPAID. To this end, we applied the methodology described in the Benchmarking of the different cell segmentation approaches subsection of the Material and methods section independently on each of the 10 crops previously described in the same subsection. The position of these crops on the example slide are shown in the Fig 2A. Red boxes indicate highly-infiltrated regions and yellow boxes indicate lowly-infiltrated regions. At first sight, the percentage of detected objects (relative to the ones obtained with manual segmentation) does not seem to decrease a lot in the condition where CLAHE was not used (blue) as compared to the full PUPAID protocol (black), although some statistically significant but slight decreases can be observed for LD regions (Fig 2B). On the contrary, when we look at 4 different metrics to compare the generated masks, we notice that PUPAID without CLAHE (dashed lines) globally leads to decreased Precision, Recall/sensitivity, Jaccard and F-measure as compared to their relative control including the CLAHE step (plain lines), both for HD (Fig 2C) and LD regions (Fig 2D), regardless of the σ ratio used. We also observe that at a fixed Intersection over Union (IoU) threshold of 0.4, these differences effectively reach significance (with less important values when CLAHE is not used), notably for the last 3 metrics between the 1:1.1 and 1:2 σ ratios (Fig 2E). In other words, even if it does not seem to have a great impact on the overall percentage of detected objects, the use of the CLAHE algorithm after background correction seems essential for PUPAID to increase the efficiency and the quality of the upcoming cell segmentation, and notably regarding the improved Recall/sensitivity, Jaccard and F-measure metrics as compared to the PUPAID version without CLAHE. In our opinion, this step should be performed on all images which are analyzed through PUPAID, as it allows to more precisely recover and identify cells within the images as compared to the version of the workflow where the CLAHE step is lacking.

10.1371/journal.pone.0308970.g002 Fig 2 Local contrast enhancing using CLAHE algorithm is necessary for optimized cell segmentation by PUPAID.

(A) Stitched image from the test dataset which is overlaid with the 10 200x200 pixels crops we generated to evaluate PUPAID’s performance. 5 of them are located in high-density regions (red squares) and the remaining 5 are located in low-density regions (yellow squares). Then, we applied on these crops the methodology described in the Benchmarking of the different cell segmentation approaches subsection of the Material and Methods section of the manuscript. (B) Percentage of detected objects for each depicted method in HD (left) and LD (right) regions as compared to the manual cell segmentation which represents 100% of the cells. (C-D) Graphs showing the Intersection over Union (IoU) thresholds vs. the 4 quality metrics (Precision, Recall/sensitivity, Jaccard and F-measure) generated by the MiC ImageJ plugin for the depicted methods in HD (C) and LD (D) regions. (E) Same data as previously shown in (C-D) except that this subfigure focuses on an IoU threshold of 0.4 for HD (top) and LD (bottom) regions. Groups were compared using Student’s t-test and p-values were reported as follows: *: p-value < 0.05, **: p-value < 0.01, ***: p-value < 0.001 and ****: p-value < 0.0001. Data are represented as mean±SEM.

Benchmarking of either PUPAID-, manual- or other state-of-the-art methods-generated cell segmentation

Afterwards, we wanted to investigate how PUPAID performed as compared to other cell segmentation methods and how its performance can be optimized. The main goals of this benchmarking are 1) to assess how PUPAID performs in terms of cell segmentation as compared to either manual or other state-of-the-art methods (herein StarDist or Cellpose), and 2) to determine the best pair(s) of σ values, representing the intensity of image blurring during the DoG algorithm, which in fine lead to the best cell segmentation with PUPAID in the tissue of interest. These σ parameters are crucial in this process and should be determined with great care. Using the previously mentioned 200x200 pixels crops exposed in Fig 2A as well as the methodology described in the Benchmarking of the different cell segmentation approaches subsection of the Material and methods section, we compared PUPAID performance with different σ pairs against manual segmentation made by eye, but also against StarDist and Cellpose already published methods. A representative cell segmentation example for 1 HD and 1 LD regions of the original image coming from the test dataset, as well as the obtained masks, is shown in Fig 3A.

10.1371/journal.pone.0308970.g003 Fig 3 Benchmarking of either PUPAID-, manual- or other state-of-the-art methods-generated cell segmentation.

(A) Original greyscale images and associated cell segmentation masks generated with the depicted methods from 1 representative high-density (HD) and 1 representative low-density (LD) crop coming from the test dataset. We extracted 10 distinct crops of dimensions 200x200 pixels from the test dataset: 5 coming from HD regions and 5 coming from LD, as respectively shown by the red and yellow squares in the Fig 3A. Then, we applied on these crops the methodology described in the Benchmarking of the different cell segmentation approaches subsection of the Material and methods section. (B) Percentage of detected objects for each depicted method in HD (top) and LD (bottom) regions as compared to the manual cell segmentation which represents 100% of the cells. (C) Graphs showing the Intersection over Union (IoU) thresholds vs. the 4 quality metrics (Precision, Recall/sensitivity, Jaccard and F-measure) generated by the MiC ImageJ plugin (accessible here: https://github.com/MultimodalImagingCenter/MiC) for the depicted methods in HD (left) and LD (right) regions. (D) Same data as previously shown in (C) except that this subfigure focuses on an IoU threshold of 0.4 for HD (left) and LD (right) regions. Groups were compared using Student’s t-test and p-values were reported as follows: *: p-value < 0.05, **: p-value < 0.01, ***: p-value < 0.001 and ****: p-value < 0.0001. Data are represented as mean±SEM.

At first sight (as seen in Fig 3A), we observe that PUPAID seems to perform better than StarDist, especially in the HD region, and roughly comparably to Cellpose. In the LD region, all methods seem to give similar results. To precisely quantify these first observations, we primarily measured the percentage of detected objects (Fig 3B) achieved for each method as compared to the reference (equal to 100% for manual cell segmentation), which clearly show that for HD regions, PUPAID method with σ ratios ranging between 1:1.1 and 1:2 leads to a marked and significant increase of the percentage of detected objects as compared to StarDist or Cellpose. For LD regions, only σ ratios ranging between 1:1.1 and 1:1.6 lead to non-significantly different percentages of detected objects as compared to StarDist (while Cellpose always performs worse than StarDist or PUPAID). We also notice that the σ ratios of 1:5 and 1:10 lead to poor results, which are comparable to both StarDist and Cellpose for HD regions, and comparable to Cellpose only for LD regions.

Then, we generated the curves presented in Fig 3C (left column for HD and right column for LD) which represent the variation of each quality metric (y-axis) over IoU thresholds (x-axis). For HD, we observe that PUPAID globally leads to decreased Precision values as compared to StarDist. Remarkably, we notice that PUPAID (for the σ ratios comprised between 1:1.1 and 1:2) systematically leads to an important increase of the Recall/sensitivity, Jaccard and F-measure metrics as compared to StarDist or Cellpose. For LD regions, it appears that the Precision is overall slightly decreased with PUPAID as compared to StarDist or Cellpose. Similarly, the 1:5 and 1:10 σ ratios for PUPAID performed very poorly regarding the Recall/sensitivity, Jaccard and F-measure metrics, reaching a level comparable to Cellpose. On the other hand, the values for these 3 last metrics are much closer to the ones obtained with StarDist when the other σ ratios (between 1:1.1 and 1:2) for PUPAID are used. More precisely, the 1:2 σ ratio performs globally less well than the 1:1.1, 1:1.2, 1:1.4 and 1:1.6 σ ratios, suggesting that these 4 last ones could represent the optimal σ values range for cell segmentation using DoG method on this precise tissue. On the contrary, these 4 metrics allow to determine that 1:5 and 1:10 σ ratios for PUPAID are the ones which clearly show the worst performance as compared to other methods/parameters (and notably Cellpose) and that they are indeed not optimal for DoG-based cell segmentation, at least in the context of the tested tissue.

The previous observations are further confirmed if we focus on an IoU threshold of 0.4 (Fig 3D). Indeed, we clearly see for HD regions that σ ratios comprised between 1:1.1 and 1:2 lead to significantly lower Precision values as compared to StarDist, but to similar ones as compared to Cellpose. Of note, the decrease in the Precision metric is not very important in terms of magnitude, with for instance a ≈11% decrease between StarDist (mean±SEM of 0.8894±0.0184) and PUPAID with a σ ratio of 1:1.6 (mean±SEM of 0.7910±0.03144). Strikingly, the same σ ratios range for PUPAID lead to significantly increased Recall/sensitivity, Jaccard and F-measure values as compared to both StarDist and Cellpose. For LD regions, we observe the same decrease of the Precision value for PUPAID as compared to StarDist. Of note, the other metrics are also affected and significantly decrease when PUPAID is used as compared to StarDist, regardless of the σ ratio used. These decreases are again rather limited, with for instance a ≈10%, ≈12%, ≈18% and ≈11% decrease between StarDist and PUPAID with a σ ratio of 1:1.6 for Precision, Recall/sensitivity, Jaccard and F-measure, respectively. Overall, in LD regions, it appears that PUPAID globally performs in a comparable manner to Cellpose regarding Precision but better than it regarding the other metrics. These results also suggest that optimal σ ratios for PUPAID cell segmentation range somewhere between 1:1.1 and 1:2, at least in the context of the tested tissue.

Overall, it appears that PUPAID performs similarly or even slightly better than Cellpose in LD regions (and comparably or slightly less well than StarDist), but seems to outperform these two methods in HD regions: despite a significant but limited decrease in the Precision metric, PUPAID leads to significantly higher Recall/sensitivity, Jaccard and F-measure metrics as well as percentages of detected objects as compared to StarDist or Cellpose. Additionally, we propose to consider the 1:1.4 σ ratio as the most balanced for cell segmentation using PUPAID, at least in this example dataset. The Table 2 summarizes the average results obtained for each measurement (the percentage of detected objects as well as the 4 previously mentioned metrics) using the 1:1.4 σ ratio and an IoU threshold of 0.4.

10.1371/journal.pone.0308970.t002 Table 2 Summary of the efficacies of the compared cell segmentation methods.

The table presents the mean values independently for each measurement, which include the percentage of detected objects and the Precision, Recall/sensitivity, Jaccard and F-measure metrics generated by the MiC ImageJ plugin. The presented values were computed with an IoU threshold of 0.4 and with the 1:1.4 σ ratio for PUPAID. The efficacy of a given method is reported as a percentage between 0 and 1 which is relative to the manual cell segmentation.

	Region	Efficacy of StarDist	Efficacy of Cellpose	Efficacy of PUPAID	% of evolution from StarDist to PUPAID	% of evolution from Cellpose to PUPAID	
% of detected objects	HD	0.3375	0.4223	0.6395	+89.48%	+51.43%	
LD	0.8292	0.6506	0.8088	-2.46%	+24.32%	
Precision	HD	0.8894	0.7192	0.7616	-14.37%	+5.9%	
LD	0.9656	0.8738	0.8482	-12.16%	-2.93%	
Recall/sensitivity	HD	0.3150	0.3118	0.5476	+73.84%	+75.63%	
LD	0.8376	0.5826	0.7568	-9.65%	+29.9%	
Jaccard	HD	0.3036	0.2784	0.4664	+53.62%	+67.53%	
LD	0.8142	0.5436	0.6718	-17.49%	+23.58%	
F-measure	HD	0.4636	0.4350	0.6354	+37.06%	+46.07%	
LD	0.8956	0.6964	0.7998	-10.7%	+14.85%	
Average efficacy	HD	0.4618	0.4333	0.6101	+32.11%	+40.8%	
LD	0.8684	0.6694	0.7771	-10.51%	+16.09%	

Integration of multiple TSV files to all-in-one FCS file

At the very end of the workflow, PUPAID offers the possibility to convert the previously exported TSV files to new XSLX files which are compatible with Microsoft Excel as well as to transform the exported TSV tables into a single FCS file. These TSV/XSLX files contain a lot of metrics about each of the segmented cells, which are all described in the Table 1. The subsequent FCS file transformation allows to make the visualization and final analysis process easier by letting users open these files with any cytometry analysis software of their choice, like FlowJo (BD Life Sciences), Kaluza (Beckman Coulter), FCS Express (De Novo Software), BD FACSDiva (BD Biosciences) or CytExpert (Beckman Coulter) for instance. As shown in the Fig 4, users can gate on cells of interest using either their shape descriptors (area, circularity, roundness and solidity), their actual spatial coordinates within the tissue or their phenotype and even combine all these approaches to mimic real cytometry analyses through personalized gating strategies. Importantly, the FCS-based results integration also allows users to analyze these files through dedicated bioinformatic analysis pipelines, such as PICAFlow [34], cytofkit [35] and CyTOF [36] R-based approaches, for instance. To illustrate, the top-left plot shows a gate which only selects the cells which express DAPI the most and present the highest areas. The cells which are very small or express DAPI very lowly are probably artifacts or poorly segmented cells and need to be discarded. The top-right plot shows the cell content of the gate displayed in the top-left plot. Here, we are looking at a shape descriptor (the circularity) and mainly decide to discard the cells which are almost perfectly round (circularity close to 1), which is unlikely to happen in real life. Then, the bottom plots show 2 different ways to analyze the remaining cells. The bottom-left plot shows how they express CD20 and CD4, which is very helpful to immediately distinguish B lymphocytes (CD20+ CD4-) and CD4+ T lymphocytes (CD20- CD4+). The bottom-right plot rather shows the X/Y coordinates corresponding to each segmented cell, which allows to analyze the tissue in a spatial manner, for instance here by gating on cell clusters defined in anatomic pathology as a “focus” in the salivary gland. One could for instance compare these highly infiltrated areas with other ones in order to evaluate the phenotype of the infiltrating cells and/or their specificity.

10.1371/journal.pone.0308970.g004 Fig 4 Gating strategy-based analytic approach on the produced FCS files.

The final goal of PUPAID is to produce FCS files which can be conveniently opened and analyzed in conventional flow/mass cytometry software such as BD FACSDiva (BD Biosciences), FlowJo (BD Life Sciences), CytExpert (Beckman Coulter), CyTOF (Fluidigm), Kaluza (Beckman Coulter), or FCSExpress (De Novo Software) or through dedicated R-written all-in-one analysis pipelines such as PICAFlow [34], cytofkit [35] or CyTOF [36]. Each plot can represent a given dimension of the data generated during PUPAID processing and analysis, and each dimension represents an aspect of each cell that was segmented during the analysis, such as areas, X/Y coordinates, shape descriptors or fluorescence markers. Red circles indicate examples of gates that can be drawn in order to extract the cells of interest.

Application of PUPAID to already published studies

To date, PUPAID workflow was already successfully applied in 2 published studies. First, we used this workflow in a work published last year in the Circulation Research journal, aiming to better study the pathophysiology of Giant Cell Arteritis (GCA), one of the most common large vessel vasculitis in humans [37]. Using several complementary experimental techniques, we demonstrated that CTLA-4 transcript and protein were significantly and specifically upregulated both in blood and aorta of GCA patients as compared to healthy donors (HD). Of note, we performed, in the Fig 3 of the paper, 4-plex and 8-plex immunofluorescence experiments on GCA aorta and used PUPAID to process and analyze the generated raw data. We demonstrated 1) that infiltrating regulatory T cells (Tregs, characterized as CD4+ FoxP3+ cells) are less abundant in GCA vs. HD, 2) that CTLA-4 was upregulated in CD4+ T cells (and more importantly in Tregs) from GCA compared to their HD counterparts, and 3) that infiltrating Tregs are much less activated/suppressive in GCA as compared to HD. Importantly, these results were indeed confirmed by other approaches, such as transcriptomics and flow cytometry.

We also successfully used PUPAID in another study, also published last year in the Arthritis and Rheumatology journal, which involved this time skin biopsies coming either from controls or patients suffering from Behçet’s disease (BD) [38]. As presented in the Fig 2 of the paper, we evidenced a marked recruitment of neutrophils (CD66b+ cells) as well as their increased expression of PDE4 protein in BD patients as compared to controls. We confirmed these results with other techniques such as transcriptomics and flow cytometry. This work helped to highlight that neutrophils are central in the pathophysiology of BD and that they are overactivated and overexpress PDE4 in this disease. Our results also imply that PDE4 could therefore represent a potential new target for immune intervention in BD.

Finally, we also applied PUPAID in another dataset, which consisted of salivary gland biopsies coming from patients suffering from Sjögren’s syndrome. Briefly, this disease is associated with an elevated risk (10–15 times more) to develop lymphoma. Using different subgroups of Sjögren patients, we identified cell populations among B and T cells compartments which are increasing through the lymphoproliferation and are massively expanded in the Sjögren patients who developed lymphoma. We confirmed these results and went further with other techniques such as flow cytometry and single cell RNA sequencing. Of note, at the time of the submission of PUPAID’s manuscript, this work on Sjögren’s syndrome is still under finalization.

Other model-based cell segmentation methods

Although we were not able to test them herein, it is important to mention that during the last years, new promising tools appeared, such as CellSighter [23] and CellSpotter [24], which can prove very useful to segment and identify cells on high-throughput immunofluorescence datasets. Nowadays, such new methods are essentially constructed as deep-learning- or neural networks-based methods, which therefore makes them model-based and consequently require users to manage the notion of model construction using training and annotated data. Such approaches, even if potentially powerful and very precise, are time-consuming regarding the generation and annotation of the training data, and often require the access to GPUs and/or to high-end computing clusters in order to perform the model construction in a reasonable amount of time. Plus, such model generation makes the mastering of programming almost mandatory. To overcome these issues, the use of generic or already-trained models (if available, which is not always the case) could potentially ensue the generation of suboptimal results because the model was not fine-tuned for the target dataset. This could favor the creation of artefactual signals potentially leading to erroneous biological conclusions. Furthermore, even these new methods continue to rely on DoG-based or derived algorithms for cell segmentation, like it is the case for CellSpotter, which essentially uses an approach comparable to PUPAID, except that the used thresholding algorithm is not the same (ISODATA [39] for PUPAID and Otsu [40] for CellSpotter). This is why we believe that the use of optimized versions of simple but already well-proven and robust methods such as the DoG algorithm for cell segmentation probably still represents the best choice for the analysis of multiplex immunofluorescence data. That said, these new approaches are indeed very helpful and promising, in the sense that they rather focus their workflows towards clustering and classification of identified cells using a combination of their respective phenotypes and already known reference ones, which is a very interesting and biologically pertinent feature that is not proposed by PUPAID at the moment.

Potential impact of PUPAID on the clinical and medical fields

Thanks to its performance, especially in high-density regions, we believe that PUPAID could prove useful in the clinical and medical fields. For instance, kidney biopsies are frequently taken from patients in a variety of contexts, such as anti-neutrophil cytoplasmic antibody (ANCA)-associated vasculitis, anti-glomerular basement membrane disease (Goodpasture syndrome) or systemic lupus erythematosus [41–50]. Immunofluorescence-based assays targeting several markers such as immunoglobulins (IgG, IgA, IgM), complement proteins (C1q, C3) or other antigens such as myeloperoxidase (MPO), proteinase-3 (PR3) or fibrin/fibrinogen are already used for diagnostics and/or to better separate patients into different medical sub-entities. Importantly, the emergence of high-throughput techniques such as imaging mass cytometry led to a drastic improvement of the phenotyping process with up to 50 simultaneous targets instead of barely 10 [51]. Noteworthily, this first cited set of markers is also of interest in skin biopsies taken in other (but sometimes close) contexts like cutaneous vasculitis, pemphigoid and pemphigus diseases, systemic lupus erythematosus as well as other dermatoses and connective tissue disorders [52–60]. Another interesting example is incarnated by the inflammatory bowel diseases field which uses immunofluorescence since decades to study intestinal biopsies, initially with anti-IgG only and now with more than 30-plex panels via imaging mass cytometry [61, 62]. All of these contexts, as well as others not presented here (notably in the whole oncology field), could potentially profit from automated and more resilient analyses methods of multiplex immunofluorescence data in tissues like the one we expose herein with PUPAID. The broader use of multiplex immunofluorescence panels or any other high-throughput techniques in medicine and/or research, coupled to thorough and automated analysis methods could therefore dramatically improve the understanding of the diseases’ pathophysiology, accelerate the discovery of biomarkers, and also help to further refine the classification of patients (which can still be tricky at the moment).

Conclusions

To summarize, PUPAID is a R package which helps to automatize and systematize the processing and analysis of sequential same-slide multiplex immunofluorescence experiments. Its final objective is to bring to immunofluorescence-based datasets a clear, robust and reproducible processing and analysis workflow. We strongly believe that PUPAID could dramatically help scientists and researchers to extract more information from their immunofluorescence-based datasets with an increased statistical power and in a less supervised manner. Of note, its performance regarding cell segmentation as compared to manual-, StarDist- and Cellpose-generated cell segmentation, especially in high-density regions, clearly makes PUPAID a method of choice for the processing and analysis of sequential same-slide multiplex immunofluorescence data. Indeed, PUPAID could still be updated in the future to add more features, such as a broader compatibility with other kind of datasets (which was not fully tested yet in this version of the software) or even the automatic alignment of adjacent tissue sections.

10.1371/journal.pone.0308970.r001
Author response to previous submission
Submission Version0
Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

6 May 2024

Attachment Submitted filename: PUPAID_TransferRevision2_PLOS_One.docx

10.1371/journal.pone.0308970.r002
Decision Letter 0
Pesce Luca Academic Editor
© 2024 Luca Pesce
2024
Luca Pesce
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Submission Version0
14 Jun 2024

PONE-D-24-13313PUPAID: a R + ImageJ pipeline for thorough and semi-automated processing and analysis of multi-channel immunofluorescence dataPLOS ONE

Dear Dr. Régnier,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The revisions were positive, highlighting the manuscript's potential impact in research fields. However, while your work presents groundbreaking potential, its real advantages seem to be primarily in high-density regions. Given the clinical expertise among the authors, a detailed medical discussion would be highly beneficial.

From a reviewer's perspective, providing or at least describing the testing dataset is essential for comprehensive evaluation. Additionally, the manuscript lacks a thorough explanation of the benchmarking, which appears somewhat confusing. Improved communication on the quantitative methods used for benchmarking would significantly enhance the validation of PUPAID.

Please submit your revised manuscript by Jul 29 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Luca Pesce, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for uploading your study's underlying data set. Unfortunately, the repository you have noted in your Data Availability statement does not qualify as an acceptable data repository according to PLOS's standards.

At this time, please upload the minimal data set necessary to replicate your study's findings to a stable, public repository (such as figshare or Dryad) and provide us with the relevant URLs, DOIs, or accession numbers that may be used to access these data. For a list of recommended repositories and additional information on PLOS standards for data deposition, please see https://journals.plos.org/plosone/s/recommended-repositories.

3. When completing the data availability statement of the submission form, you indicated that you will make your data available on acceptance. We strongly recommend all authors decide on a data sharing plan before acceptance, as the process can be lengthy and hold up publication timelines. Please note that, though access restrictions are acceptable now, your entire data will need to be made freely accessible if your manuscript is accepted for publication. This policy applies to all data except where public deposition would breach compliance with the protocol approved by your research ethics board. If you are unable to adhere to our open data policy, please kindly revise your statement to explain your reasoning and we will seek the editor's input on an exemption. Please be assured that, once you have provided your new statement, the assessment of your exemption will not hold up the peer review process.

4. Please amend either the abstract on the online submission form (via Edit Submission) or the abstract in the manuscript so that they are identical.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for your contribution with the development of PUPAID. While your work presents groundbreaking potential, according to this version of the manuscript the real advantages appear to be primarily in high-density regions. Given the clinical expertise available among the authors, it would be highly beneficial to leverage this by providing detailed medical discussion.

From a reviewing point of view it would help to be provided with a testing dataset, or at least to describe it, for comprehensive evaluation. Additionally, the manuscript lacks a thorough explanation of the benchmarking which appears a bit confusing. I think venturing in many comparisons, different in nature, is not simple to deal with. Improved communication on the quantitative methods used for benchmarking would significantly enhance the validation of PUPAID.

I also think the paper lacks demonstration of user-friendliness, with the language used resulting in an additional barrier. Including a figure or, preferably, a video of the interface would greatly enhance understanding and usability for readers.

Lastly, the manuscript's language is quite self-referential and would benefit from a more reader-centric approach, ensuring clarity and accessibility for a broader audience. I suggest giving more scientific context and sometimes guiding the reader via bullet points.

Minor changes:

Abstract

Line 58: Would be nice for reviewers to have test files to run the code

Introduction

Line 82-83: would appreciate if the author could elaborate on what is meant by “exponential increase of the complexity”. Example: what is the role of noise and how is it evolving through time. Also it is not very clear what is an “early lack of open-source methods”

Line 88: The learning curve of coding within publicly available tools can be steep, conversely I would not define programs like Image J cumbersome to master.

Line 94: would be interesting if the author could elaborate on the relevance of Doc Parra in assessing methodology performances. Additionally, please provide further evidence of the status quo claimed here.

Lines 110-112: quite a statement about performance, please provide quantitative insights.

Dependencies

Lines 124-126: could the author stress further the decision of relying on R rather than python packages. Are R packages flexible in terms of being integrated on cloud and how suitable are they for integration with AI workflows?

Pre processing of raw data

Line 161: there are current efforts from the github community to manage such exotic formats https://github.com/cgohlke/czifile feel free to integrate in your script

Line 169: Is the “big idea” the innovation?

Line 170 and 180: It is a bit ambiguous to understand if the naming is either automatic or manual. Try to explain clearly and consider including an image solely dedicated to input data handling.

Processing of ROI

Lines 195-208: quite annoying to read through such a small amount of text calling back to so many supporting figures. Would it be possible to have a figure in main text or either organise the text differently?

Benchmarking of either PUPAID-, manual- or other state-of-the-art methods-generated

cell segmentation

Line 237: the section here seems a mix of user instructions and benchmarking. By the way, consider including a user interaction section along with UI images, would probably be very beneficial to promote the adoption of the tool.

Line 247: provide quantitative details about the test datasets

Line 252-253: what is the error on the single metric you are using to claim significance? There are hints in the images but this information is a bit tough to retrieve on the spot.

Results

Line 319: how is the past application of a novel tool a result? Consider providing a clear explanation. You could refer to validation on published studies, and simply include the reference

Line 342: Again this sounds like a validation rather than result section.

Reviewer #2: The manuscript PONE-D-24-13313 by P. Régnier and colleagues presents PUPAID, a workflow developed in R and ImageJ for semi-automated processing and analysis of multi-channel immunofluorescence data. They explain its workflow, which is user-friendly by incorporating an optional R Shiny-based interactive application for those not proficient in R. PUPAID performance is validated on few datasets and compared with state-of-the-art methods like StarDist or Cellpose, identifying conditions where it outperforms them, especially in dense areas. It exports single-cell data as FCS files, compatible with various cytometry analysis software. PUPAID is available as a GPLv3-licensed R package on GitHub. The work is well presented and with convincing experimental results and it is well written. The installation and usage is well documented and reproducible.

I support the publication of the manuscript without additional changes.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Vladislav Gavryusev

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment Submitted filename: Comment to authors PLOSone.docx

10.1371/journal.pone.0308970.r003
Author response to Decision Letter 0
Submission Version1
27 Jul 2024

Response to Editor and Reviewers

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The revisions were positive, highlighting the manuscript's potential impact in research fields. However, while your work presents groundbreaking potential, its real advantages seem to be primarily in high-density regions. Given the clinical expertise among the authors, a detailed medical discussion would be highly beneficial.

From a reviewer's perspective, providing or at least describing the testing dataset is essential for comprehensive evaluation. Additionally, the manuscript lacks a thorough explanation of the benchmarking, which appears somewhat confusing. Improved communication on the quantitative methods used for benchmarking would significantly enhance the validation of PUPAID.

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

As requested by the Editor, we profoundly edited our manuscript to answer to the reviewers’ comments as well as to fully comply with the PLOS One journal requirements regarding the formatting of the manuscript. The revised version of the manuscript should fully embrace the journal requirements based on the two PDF resources the Editor provided to us.

2. Thank you for uploading your study's underlying data set. Unfortunately, the repository you have noted in your Data Availability statement does not qualify as an acceptable data repository according to PLOS's standards.

At this time, please upload the minimal data set necessary to replicate your study's findings to a stable, public repository (such as figshare or Dryad) and provide us with the relevant URLs, DOIs, or accession numbers that may be used to access these data. For a list of recommended repositories and additional information on PLOS standards for data deposition, please see https://journals.plos.org/plosone/s/recommended-repositories.

As requested by the Editor, and given the provided URL regarding the recommended repositories, we uploaded the example dataset on the Data Station Life Sciences repository hosted by the Data Archiving and Networked Services (DANS). The associated accession URL (https://doi.org/10.17026/LS/7XQFAT) was indeed added within the revised version of the manuscript.

3. When completing the data availability statement of the submission form, you indicated that you will make your data available on acceptance. We strongly recommend all authors decide on a data sharing plan before acceptance, as the process can be lengthy and hold up publication timelines. Please note that, though access restrictions are acceptable now, your entire data will need to be made freely accessible if your manuscript is accepted for publication. This policy applies to all data except where public deposition would breach compliance with the protocol approved by your research ethics board. If you are unable to adhere to our open data policy, please kindly revise your statement to explain your reasoning and we will seek the editor's input on an exemption. Please be assured that, once you have provided your new statement, the assessment of your exemption will not hold up the peer review process.

We thank the Editor for his remark. As requested in the previous point, we already uploaded the full example dataset on the Data Station Life Sciences repository hosted by the Data Archiving and Networked Services (DANS), which will be accessible via the following URL: https://doi.org/10.17026/LS/7XQFAT. Regarding the GitHub repository, all authors confirm that the code with be fully available if the manuscript is accepted for publication. Concretely, the developer and maintainer of PUPAID (Dr. Paul Régnier actually) only has to toggle a setting from “Private” to “Public” in his GitHub repository profile, which will instantly make the full code available to everyone. He again wanted to reassure the Editor that he will do this task without delay if the manuscript is accepted for publication.

4. Please amend either the abstract on the online submission form (via Edit Submission) or the abstract in the manuscript so that they are identical.

We wanted to apologize for this point, as this was not intentional at all. The corresponding author probably copied and pasted within the online submission form a version of the abstract which was not the very last one. We carefully checked both abstracts and made sure they were identical between the manuscript and the online submission system.

Reviewers’s comments to the Author

Reviewer #1:

Thank you for your contribution with the development of PUPAID. While your work presents groundbreaking potential, according to this version of the manuscript the real advantages appear to be primarily in high-density regions. Given the clinical expertise available among the authors, it would be highly beneficial to leverage this by providing detailed medical discussion.

We thank the reviewer for his very important remark. To discuss this interesting point, we added a new Potential impact of PUPAID on the clinical and medical fields section in the manuscript which details how PUPAID could be useful in the clinical and medical fields. We notably expose here tissues and their associated diseases for which immunofluorescence is widely used for both diagnostic and research purposes, and for which standardized and robust analysis methods could potentially help a lot to better understand the diseases’ pathophysiology, but also to accelerate the discovery of new biomarkers and further refine the classification of patients.

From a reviewing point of view it would help to be provided with a testing dataset, or at least to describe it, for comprehensive evaluation. Additionally, the manuscript lacks a thorough explanation of the benchmarking which appears a bit confusing. I think venturing in many comparisons, different in nature, is not simple to deal with. Improved communication on the quantitative methods used for benchmarking would significantly enhance the validation of PUPAID.

We thank the reviewer for his remark and made modifications to improve the points he highlighted. First, to ease readers understanding, we transferred and renamed the Test dataset section present in the Supplemental Material and Methods to a new Example dataset for learning and test purposes subsection in the main manuscript in the Material and methods section in order to present the example dataset, and notably what kind of organ/patient is the tissue from, how it was stained (technology, antibodies and Opal reagents) and how it was acquired and processed (instrument, software and demultiplexing step). We also indicated the new URL from which users can download the dataset.

We additionally moved every supplemental methods from the Supplemental Material and Methods to the main manuscript. This lengthens the manuscript a bit but allows to avoid switching between files for an explanation of a precise point. In a similar manner, we decided to integrate the old Figure S1 as a new Figure 2 in the main manuscript, to directly provide to readers the totality of the benchmarking data.

Second, we were unsure about what the reviewer specifically referred to when writing about the “benchmarking”, because the manuscript details two different ones. The first benchmarking was related to the CLAHE algorithm and helped to demonstrate that this step was pertinent and enhanced the subsequent cell segmentation through PUPAID. The second benchmarking was about the performance of PUPAID (with different σ ratios) as compared to manual cell segmentation but also to other well-established methods: StarDist and Cellpose. To improve the overall readability of the manuscript, we decided to edit both parts in the revised version of the manuscript, even if one was not directly targeted by the reviewer. In a sense, his remark tells us that the manuscript was probably not organized properly. To summarize, we transferred the Comparison of masks generated with different cell segmentation methods section originally present in the Supplemental Material and Methods to the main manuscript, in the Benchmarking of the different cell segmentation approaches subsection of the Material and methods section. We also extracted the CLAHE algorithm benchmarking part to a dedicated subsection between the Processing of ROI and Benchmarking of either PUPAID-, manual- or other state-of-the-art methods-generated cell segmentation subsections. This way, the methodology used for both benchmarking is totally visible and independent of the other sections, and the CLAHE-related section comes after the full description of the ROI processing. We believe this will improve the readability of the manuscript. These modifications indeed led to integrating the old Figure S1 as the new Figure 2, whereas the old Figure 2 is now the new Figure 3 and the old Figure 3 is now the new Figure 4.

I also think the paper lacks demonstration of user-friendliness, with the language used resulting in an additional barrier. Including a figure or, preferably, a video of the interface would greatly enhance understanding and usability for readers.

We greatly thank the reviewer for his very pertinent remark about the user-friendliness of PUPAID. Even if it was not as easy as one could think, we finally managed to generate a video of roughly 14 minutes which shows in live the full workflow of PUPAID applied on the example dataset. This video is accessible from the following YouTube link: https://youtu.be/58Tm54OVP-g.

Lastly, the manuscript's language is quite self-referential and would benefit from a more reader-centric approach, ensuring clarity and accessibility for a broader audience. I suggest giving more scientific context and sometimes guiding the reader via bullet points.

We greatly thank the reviewer for his constructive remark. To make our manuscript easier to read, we deeply modified its structure and content, as previously stated. First, the (now) full compliance with the PLOS One journal format helped a lot to restructure our work and our thoughts. Second, we rewrote entire sections of the manuscript to give more details (or less in some paragraphs) and to make a lot of sentences clearer. We also moved/switched full sentences/paragraphs to other (or even new) subsections to better structure the manuscript. Third, to enhance clarity and readability, we also put as main figures and methods the old supplemental materials originally submitted. This will ensure that readers will not have to permanently switch between documents when they read our manuscript. Fourth, we modified as much as we could the figures to make graphs and texts as big as possible to ease the reading. Fifth, we implemented a new subsection to add more scientific context regarding PUPAID’s utility and impact, notably in the medical field.

Minor changes:

Abstract

Line 58: Would be nice for reviewers to have test files to run the code

We thank the reviewer for his remark but wanted to clarify that test files (in this case, TIFF-formatted images containing multi-channel immunofluorescence data) were already available during the last submission of this manuscript, as mentioned in the last paragraph of the old Availability and future directions section of the originally submitted manuscript. If the reviewer encountered difficulty to access the files using the provided URL within the last weeks/months, we wanted to apologize for this issue, which was indeed not intentional. To address this problem in the long term, and in accordance with the Editor, we uploaded the test dataset to the Data Station Life Sciences repository hosted by the Data Archiving and Networked Services (DANS), where it should be available at all times. The test dataset will be totally accessible via the following URL: https://doi.org/10.17026/LS/7XQFAT.

Introduction

Line 82-83: would appreciate if the author could elaborate on what is meant by “exponential increase of the complexity”. Example: what is the role of noise and how is it evolving through time. Also it is not very clear what is an “early lack of open-source methods”

To be more precise, we wanted to underline the fact that over time, and especially during the two last decades, multiplex immunofluorescence underwent massive improvements together with a great diversification of methods, thus leading to the increase of the number of simultaneously acquired markers as well as the overall resolution and number of co-analyzed samples. We rephrased this sentence to be clearer and added references to emphasize on this point. We also removed the early lack of open-source methods part, because if it was true 10 to 20 years ago, it does not seem to be totally valid anymore, especially when we look at the plethora of analysis methods that were recently developed for this precise kind of purpose.

Line 88: The learning curve of coding within publicly available tools can be steep, conversely I would not define programs like Image J cumbersome to master.

We wanted to clarify what is said in this part of the manuscript. We did not mean to say that Image J is difficult to master. Actually, this software is very well programmed and organized, and offers the ability to quickly analyze heavy images with a broad variety of tools. However, if one needs to analyze dozens or hundreds of images using the same methodology in Image J, the need for automatization through macros and scripts (thus necessarily involving programming) is almost mandatory. To make this point of view clearer, we also rephrased this part.

Line 94: would be interesting if the author could elaborate on the relevance of Doc Parra in assessing methodology performances. Additionally, please provide further evidence of the status quo claimed here.

We thank the reviewer for his very constructive comment. Our initial sentence was meant to highlight the fact that the plethora of available analysis methods for immunofluorescence assays could potentially lead to the biased selection by researchers/scientists of methods that actually “produce” convenient results and thus avoid the “least performant” ones. We wanted to underline the notion that workflows which process data from A to Z (pre-processing, processing, normalization, analysis, results export, etc.) are one way to intent standardization of such analyses and avoid potential issues and biases. We thought this was relevant to write at first, but all your remarks taken as a whole finally lead us to doubt about the true relevance of this sentence in the introduction. In essence, our message is slightly suggested in the sentence the vast majority of the available methods only seems to propose a given kind of analysis and almost never include actual pre-processing and processing of the raw images written right before. In consequence, we thought it was better to remove the sentence related to Dr. Parra and thus rewrote the two last paragraphs of the introduction to make it clearer.

Lines 110-112: quite a statement about performance, please provide quantitative insights.

We thank the reviewer for his remark and added some quantitative insights in the last paragraph of the introduction but also added a new Table 2 which summarizes the efficacy of StarDist, Cellpose and PUPAID (using its most balanced 1:1.4 σ ratio and an IoU threshold of 0.4) independently for each measurement (% of detected objects and each of the four mentioned metrics) and in average. This will help readers to have a simpler “take home” message regarding PUPAID’s efficacy as compared to other well-established cell segmentation methods.

Dependencies

Lines 124-126:

Attachment Submitted filename: PUPAID_PLOS_One_Revision.docx

10.1371/journal.pone.0308970.r004
Decision Letter 1
Pesce Luca Academic Editor
© 2024 Luca Pesce
2024
Luca Pesce
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Submission Version1
5 Aug 2024

PUPAID: a R + ImageJ pipeline for thorough and semi-automated processing and analysis of multi-channel immunofluorescence data

PONE-D-24-13313R1

Dear Dr. Régnier,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Luca Pesce, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Great job, really appreciated the hard work on making the manuscript more readable and sharing data from a more insightful perspective.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

10.1371/journal.pone.0308970.r005
Acceptance letter
Pesce Luca Academic Editor
© 2024 Luca Pesce
2024
Luca Pesce
https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
11 Sep 2024

PONE-D-24-13313R1

PLOS ONE

Dear Dr. Régnier,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Luca Pesce

Academic Editor

PLOS ONE
==== Refs
References

1 IV. ‘Aμóρϕω⋎a, no. I.—on a case of superficial colour presented by a homogeneous liquid internally colourless. Phil Trans R Soc 1845;135 :143–5. doi: 10.1098/rstl.1845.0004
2 Heimstädt O. Das fluoreszenzmikroskop 1911.
3 Lehmann H. Das lumineszenz-mikroskop seine grundlagen und seine anwendungen. 1913.
4 Coons AH , Creech HJ , Jones RN , Berliner E . The Demonstration of Pneumococcal Antigen in Tissues by the Use of Fluorescent Antibody. The Journal of Immunology 1942;45 :159–70. doi: 10.4049/jimmunol.45.3.159
5 Atalla MM , Tannenbaum E , Scheibner EJ . Stabilization of Silicon Surfaces by Thermally Grown Oxides*. Bell System Technical Journal 1959;38 :749–83. doi: 10.1002/j.1538-7305.1959.tb03907.x
6 Sah C. A New Semiconductor Tetrode-The Surface-Potential Controlled Transistor. Proc IRE 1961;49 :1623–34. doi: 10.1109/JRPROC.1961.287763
7 Hofstein SR , Heiman FP . The silicon insulated-gate field-effect transistor. Proc IEEE 1963;51 :1190–202. doi: 10.1109/PROC.1963.2488
8 Boyle WS , Smith GE . Charge Coupled Semiconductor Devices. Bell System Technical Journal 1970;49 :587–93. doi: 10.1002/j.1538-7305.1970.tb01790.x
9 Janesick JR . Scientific Charge-Coupled Devices. SPIE; 2001. doi: 10.1117/3.374903
10 Williams JB . The electronics revolution: inventing the future. New York, NY: Springer Science+Business Media; 2017.
11 Ohta J. Smart CMOS Image Sensors and Applications. 2nd ed. CRC Press; 2020. doi: 10.1201/9781315156255
12 Tan WCC , Nerurkar SN , Cai HY , Ng HHM , Wu D , Wee YTF , et al . Overview of multiplex immunohistochemistry/immunofluorescence techniques in the era of cancer immunotherapy. Cancer Communications 2020;40 :135–53. doi: 10.1002/cac2.12023 32301585
13 Cho W , Kim S , Park Y-G . Towards multiplexed immunofluorescence of 3D tissues. Mol Brain 2023;16 :37. doi: 10.1186/s13041-023-01027-9 37131224
14 Sheng W , Zhang C , Mohiuddin TM , Al-Rawe M , Zeppernick F , Falcone FH , et al . Multiplex Immunofluorescence: A Powerful Tool in Cancer Immunotherapy. IJMS 2023;24 :3086. doi: 10.3390/ijms24043086 36834500
15 Harms PW , Frankel TL , Moutafi M , Rao A , Rimm DL , Taube JM , et al . Multiplex Immunohistochemistry and Immunofluorescence: A Practical Update for Pathologists. Modern Pathology 2023;36 :100197. doi: 10.1016/j.modpat.2023.100197 37105494
16 Pau G , Fuchs F , Sklyar O , Boutros M , Huber W . EBImage—an R package for image processing with applications to cellular phenotypes. Bioinformatics 2010;26 :979–81. doi: 10.1093/bioinformatics/btq046 20338898
17 Parra ER . Methods to Determine and Analyze the Cellular Spatial Distribution Extracted From Multiplex Immunofluorescence Data to Understand the Tumor Microenvironment. Front Mol Biosci 2021;8 :668340. doi: 10.3389/fmolb.2021.668340 34179080
18 Wilson CM , Ospina OE , Townsend MK , Nguyen J , Moran Segura C , Schildkraut JM , et al . Challenges and Opportunities in the Statistical Analysis of Multiplex Immunofluorescence Data. Cancers 2021;13 :3031. doi: 10.3390/cancers13123031 34204319
19 Rojas F , Hernandez S , Lazcano R , Laberiano-Fernandez C , Parra ER . Multiplex Immunofluorescence and the Digital Image Analysis Workflow for Evaluation of the Tumor Immune Environment in Translational Research. Front Oncol 2022;12 :889886. doi: 10.3389/fonc.2022.889886 35832550
20 Fridley B , Wang X , editors. Statistical Genomics. vol. 2629 . New York, NY: Springer US; 2023. doi: 10.1007/978-1-0716-2986-4
21 Rodríguez-Arribas M , Pizarro-Estrella E , Gómez-Sánchez R , Yakhine-Diop SMS , Gragera-Hidalgo A , Cristo A , et al . IFDOTMETER: A New Software Application for Automated Immunofluorescence Analysis. SLAS Technology 2016;21 :246–59. doi: 10.1177/2211068215600650 26303944
22 Barnett D , Hall J , Haab B . Automated Identification and Quantification of Signals in Multichannel Immunofluorescence Images. The American Journal of Pathology 2019;189 :1402–12. doi: 10.1016/j.ajpath.2019.03.011 31026417
23 Amitay Y , Bussi Y , Feinstein B , Bagon S , Milo I , Keren L . CellSighter: a neural network to classify cells in highly multiplexed images. Nat Commun 2023;14 :4302. doi: 10.1038/s41467-023-40066-7 37463931
24 Nirmal AJ , Yapp C , Santagata S , Sorger PK . Cell Spotter (CSPOT): A machine-learning approach to automated cell spotting and quantification of highly multiplexed tissue images. Bioinformatics; 2023. doi: 10.1101/2023.11.15.567196 38014110
25 Schmidt U , Weigert M , Broaddus C , Myers G . Cell Detection with Star-convex Polygons. vol. 11071 , 2018, p. 265–73. doi: 10.1007/978-3-030-00934-2_30
26 Weigert M , Schmidt U , Haase R , Sugawara K , Myers G . Star-convex Polyhedra for 3D Object Detection and Segmentation in Microscopy. 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, p. 3655–62. doi: 10.1109/WACV45572.2020.9093435
27 Stringer C , Wang T , Michaelos M , Pachitariu M . Cellpose: a generalist algorithm for cellular segmentation. Nat Methods 2021;18 :100–6. doi: 10.1038/s41592-020-01018-x 33318659
28 Sternberg. Biomedical Image Processing. Computer 1983;16 :22–34. doi: 10.1109/MC.1983.1654163
29 Pizer SM , Amburn EP , Austin JD , Cromartie R , Geselowitz A , Greer T , et al . Adaptive Histogram Equalization and Its Variations n.d.
30 Wilson HR , Giese SC . Threshold visibility of frequency gradient patterns. Vision Research 1977;17 :1177–90. doi: 10.1016/0042-6989(77)90152-3 595381
31 Theory of edge detection. Proc R Soc Lond B 1980;207 :187–217. doi: 10.1098/rspb.1980.0020 6102765
32 Young RA . The Gaussian derivative model for spatial vision: I. Retinal mechanisms. Spatial Vis 1987;2 :273–93. doi: 10.1163/156856887x00222 3154952
33 Lindeberg T. Image Matching Using Generalized Scale-Space Interest Points. J Math Imaging Vis 2015;52 :3–36. doi: 10.1007/s10851-014-0541-0
34 Régnier P , Marques C , Saadoun D . PICAFlow: a complete R workflow dedicated to flow/mass cytometry data, from pre-processing to deep and comprehensive analysis. Bioinformatics Advances 2023;3:vbad177. doi: 10.1093/bioadv/vbad177 38089110
35 Chen H , Lau MC , Wong MT , Newell EW , Poidinger M , Chen J . Cytofkit: A Bioconductor Package for an Integrated Mass Cytometry Data Analysis Pipeline. PLoS Comput Biol 2016;12 :e1005112. doi: 10.1371/journal.pcbi.1005112 27662185
36 Nowicka M , Krieg C , Crowell HL , Weber LM , Hartmann FJ , Guglietta S , et al . CyTOF workflow: differential discovery in high-throughput high-dimensional cytometry datasets. F1000Res 2017;6 :748. doi: 10.12688/f1000research.11622.3 28663787
37 Régnier P , Le Joncour A , Maciejewski-Duval A , Darrasse-Jèze G , Dolladille C , Meijers WC , et al . CTLA-4 Pathway Is Instrumental in Giant Cell Arteritis. Circulation Research 2023;133 :298–312. doi: 10.1161/CIRCRESAHA.122.322330 37435729
38 Le Joncour A , Régnier P , Maciejewski‐Duval A , Charles E , Barete S , Fouret P , et al . Reduction of Neutrophil Activation by Phosphodiesterase 4 Blockade in Behçet’s Disease. Arthritis & Rheumatology 2023;75 :1628–37. doi: 10.1002/art.42486 36862398
39 Thresholding Using the ISODATA Clustering Algorithm. IEEE Trans Syst, Man, Cybern 1980;10 :771–4. doi: 10.1109/TSMC.1980.4308400
40 Otsu N. A Tlreshold Selection Method from Gray-Level Histograms n.d.
41 Scheer RL . Immune Aspects of the Glomerulonephritis Associated with Pulmonary Hemmorhage. Ann Intern Med 1964;60 :1009. doi: 10.7326/0003-4819-60-6-1009
42 Bajema IM , Hagen EC , Hermans J , Noël L-H , Waldherr R , Ferrario F , et al . Kidney biopsy as a predictor for renal outcome in ANCA-associated necrotizing glomerulonephritis. Kidney International 1999;56 :1751–8. doi: 10.1046/j.1523-1755.1999.00758.x 10571783
43 Nossent H , Berden J , Swaak T . Renal immuno¯uorescence and the prediction of renal outcome in patients with proliferative lupus nephritis n.d.
44 Hauer HA , Bajema IM , Van Houwelingen HC , Ferrario F , Noël L-H , Waldherr R , et al . Renal histology in ANCA-associated vasculitis: Differences between diagnostic and serologic subgroups. Kidney International 2002;61 :80–9. doi: 10.1046/j.1523-1755.2002.00089.x 11786087
45 Haas M , Eustace JA . Immune complex deposits in ANCA-associated crescentic glomerulonephritis: A study of 126 cases. Kidney International 2004;65 :2145–52. doi: 10.1111/j.1523-1755.2004.00632.x 15149327
46 Li J , Cui Z , Wang J , Hu S , Jia X , Guan Z , et al . Autoantibodies against Linear Epitopes of Myeloperoxidase in Anti–Glomerular Basement Membrane Disease. Clinical Journal of the American Society of Nephrology 2016;11 :568–75. doi: 10.2215/CJN.05270515 26813562
47 Fogo AB , Lusco MA , Najafian B , Alpers CE . AJKD Atlas of Renal Pathology: Anti–Glomerular Basement Membrane Antibody–Mediated Glomerulonephritis. American Journal of Kidney Diseases 2016;68 :e29–30. doi: 10.1053/j.ajkd.2016.09.003 27772636
48 Geetha D , Jefferson JA . ANCA-Associated Vasculitis: Core Curriculum 2020. American Journal of Kidney Diseases 2020;75 :124–37. doi: 10.1053/j.ajkd.2019.04.031 31358311
49 Javeed S , Sadaf S , Batool S , Batool A , Rafique Z , Chughtai AS . Spectrum of Morphological and Immunofluorescence Patterns in Lupus Nephritis: A Single Institutional Study. Cureus 2022. doi: 10.7759/cureus.25363 35765398
50 Ye J , Croom N , Troxell ML , Kambham N , Zuckerman JE , Andeen N , et al . Non-Full House Membranous Lupus Nephritis Represents a Clinically Distinct Subset. Kidney360 2023;4 :935–42. doi: 10.34067/KID.0000000000000161 37257088
51 Louis Sam Titus ASC , Tan Y , Tran P , Lindblom J , Ivbievbiokun M , Xu Y , et al . Molecular architecture of proliferative lupus nephritis as elucidated using 50-plex imaging mass cytometry proteomics. Clinical Immunology 2023;254 :109713. doi: 10.1016/j.clim.2023.109713 37516396
52 Chhabra S , Minz R , Saikia B . Immunofluorescence in dermatology. Indian J Dermatol Venereol Leprol 2012;78 :677. doi: 10.4103/0378-6323.102355 23075636
53 Abreu-Velez A , Calle-Isaza J , Howard M . Immunofluorescence patterns in selected dermatoses, including blistering skin diseases utilizing multiple fluorochromes. North Am J Med Sci 2015;7 :397. doi: 10.4103/1947-2714.166219 26605203
54 Shetty V , Subramaniam K , Rao R . Utility of immunofluorescence in dermatology. Indian Dermatol Online J 2017;8 :1. doi: 10.4103/2229-5178.198774 28217464
55 Lath K , Chatterjee D , Saikia UN , Saikia B , Minz R , De D , et al . Role of Direct Immunofluorescence in Cutaneous Small-Vessel Vasculitis: Experience From a Tertiary Center. The American Journal of Dermatopathology 2018;40 :661–6. doi: 10.1097/DAD.0000000000001170 29672364
56 Valencia-Guerrero A , Deng A , Dresser K , Bouliane G , Cornejo KM . The Value of Direct Immunofluorescence on Proteinase-Digested Formalin-Fixed Paraffin-Embedded Skin Biopsies. The American Journal of Dermatopathology 2018;40 :111–7. doi: 10.1097/DAD.0000000000000934 28816740
57 Reimann JDR , Moynihan SP , Horn TD . Assessment of Clinical and Laboratory Use of the Cutaneous Direct Immunofluorescence Assay. JAMA Dermatol 2021;157 :1343. doi: 10.1001/jamadermatol.2021.3892 34613346
58 Balakrishnan S , Kalappurayil NB . Immunofluorescence in dermatology: A brief review. JSSTD 2021;5 :66–74. doi: 10.25259/JSSTD_65_2021
59 Alpsoy E. Cutaneous vasculitis; An algorithmic approach to diagnosis. Front Med 2022;9 :1012554. doi: 10.3389/fmed.2022.1012554 36213632
60 Bk P , Panwar H , Joshi D , Asati D , Chaurasia JK , Vamseekrishna D , et al . Diagnostic Utility of Direct Immunofluorescence on Paraffin-Embedded Skin Biopsy Samples for the Diagnosis of Autoimmune Vesiculobullous Lesions. Cureus 2024. doi: 10.7759/cureus.56916 38665766
61 Manzione NC , Das KM . Immunofluorescence assay using crohn’s disease tissue-injected athymic nude mouse lymph nodes in the diagnosis of inflammatory bowel diseases. The American Journal of Medicine 1986;80 :1060–6. doi: 10.1016/0002-9343(86)90666-2 3524209
62 Kondo A , Ma S , Lee MYY , Ortiz V , Traum D , Schug J , et al . Highly Multiplexed Image Analysis of Intestinal Tissue Sections in Patients With Inflammatory Bowel Disease. Gastroenterology 2021;161 :1940–52. doi: 10.1053/j.gastro.2021.08.055 34529988
