
==== Front
Radiol Med
Radiol Med
La Radiologia Medica
0033-8362
1826-6983
Springer Milan Milan

39048761
1852
10.1007/s11547-024-01852-5
Chest Radiology
Impact of an expert-derived, quick hands-on tool on classifying pulmonary hypertension in chest computed tomography: a study on inexperienced readers using RAPID-CT-PH
http://orcid.org/0000-0003-4480-8872
Cereser Lorenzo lorenzo.cereser@uniud.it

1
Zussino Gaia 1
Cicciò Carmelo 2
Tullio Annarita 3
Montanaro Chiara 1
Driussi Mauro 4
Di Poi Emma 5
Patruno Vincenzo 6
Zuiani Chiara 1
Girometti Rossano 1
1 https://ror.org/05ht0mh31 grid.5390.f 0000 0001 2113 062X Department of Medicine, Institute of Radiology, University of Udine, University Hospital S. Maria della Misericordia, Azienda Sanitaria-Universitaria Friuli Centrale (ASUFC), p.le S. Maria della Misericordia, 15, 33100 Udine, Italy
2 grid.416422.7 0000 0004 1760 2489 Department of Diagnostic Imaging and Interventional Radiology, IRCCS Sacro Cuore Don Calabria Hospital, via don A. Sempreboni, 5, 37024 Negrar di Valpolicella, Verona, Italy
3 https://ror.org/05ht0mh31 grid.5390.f 0000 0001 2113 062X Department of Medicine, Institute of Hygiene and Clinical Epidemiology, University of Udine, University Hospital S. Maria della Misericordia, Azienda Sanitaria Universitaria Friuli Centrale (ASUFC), p.le S. Maria della Misericordia, 15, 33100 Udine, Italy
4 grid.518488.8 Cardiology, Cardiothoracic Department, University Hospital S. Maria della Misericordia, Azienda Sanitaria Universitaria Friuli Centrale (ASUFC), p.le S. Maria della Misericordia, 15, 33100 Udine, Italy
5 https://ror.org/05ht0mh31 grid.5390.f 0000 0001 2113 062X Department of Medicine, Rheumatology Clinic, University of Udine, University Hospital S. Maria della Misericordia, Azienda Sanitaria Universitaria Friuli Centrale (ASUFC), p.le S. Maria della Misericordia, 15, 33100 Udine, Italy
6 grid.518488.8 Pulmonology Department, University Hospital S. Maria della Misericordia, Azienda Sanitaria Universitaria Friuli Centrale (ASUFC), p.le S. Maria della Misericordia, 15, 33100 Udine, Italy
24 7 2024
24 7 2024
2024
129 9 13131328
18 3 2024
4 7 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by/4.0/ Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Purpose

To test the inter-reader agreement in classifying pulmonary hypertension (PH) on chest contrast-enhanced computed tomography (CECT) between a consensus of two cardio-pulmonary-devoted radiologists (CRc) and inexperienced readers (radiology residents, RRs) when using a CECT-based quick hands-on tool built upon PH imaging literature, i.e., the “Rapid Access and Practical Information Digest on Computed Tomography for PH-RAPID-CT-PH”.

Material and methods

The observational study retrospectively included 60 PH patients who underwent CECT between 2015 and 2022. Four RRs independently reviewed all CECTs and classified each case into one of the five PH groups per the 2022 ESC/ERS guidelines. While RR3 and RR4 (RAPID-CT-PH group) used RAPID-CT-PH, RR1 and RR2 (control group) did not. RAPID-CT-PH and control groups’ reports were compared with CRc using unweighted Cohen’s Kappa (k) statistics. RRs’ report completeness and reporting time were also compared using the Wilcoxon–Mann–Whitney test.

Results

The inter-reader agreement in classifying PH between the RAPID-CT-PH group and CRc was substantial (k = 0.75 for RR3 and k = 0.65 for RR4); while, it was only moderate for the control group (k = 0.57 for RR1 and k = 0.49 for RR2). Using RAPID-CT-PH resulted in significantly higher report completeness (all p < 0.0001) and significantly lower reporting time (p < 0.0001) compared to the control group.

Conclusion

RRs using RAPID-CT-PH showed a substantial agreement with CRc on CECT-based PH classification. RAPID-CT-PH improved report completeness and reduced reporting time. A quick hands-on tool for classifying PH on chest CECT may help inexperienced radiologists effectively contribute to the PH multidisciplinary team.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11547-024-01852-5.

Keywords

Pulmonary hypertension
Thoracic imaging
Chest computed tomography
Competency-based medical education
Università degli Studi di UdineOpen access funding provided by Università degli Studi di Udine within the CRUI-CARE Agreement.

issue-copyright-statement© Italian Society of Medical Radiology 2024
==== Body
pmcIntroduction

Pulmonary hypertension (PH) is a multifactorial pulmonary vascular disorder that may be idiopathic or related to multiple clinical conditions, represented mainly by cardiac and respiratory diseases [1, 2]. The updated 2022 European Society of Cardiology / European Respiratory Society (ESC/ERS) guidelines define PH as the presence of mean pulmonary arterial pressure (PAP) values greater than 20 mmHg at rest, as determined by right heart catheterization [1]. PH is classified into five groups, including conditions with similar pathophysiological mechanisms and hemodynamic characteristics [1, 3]. The rationale behind this classification scheme relies on providing patients with the most appropriate management and treatment, which largely depend on inherent group-related differences, thus requiring a multidisciplinary approach [1, 3, 4].

When dealing with patients with suspected PH, the diagnostic challenge lies in identifying the causes early to institute prompt treatment [5]. In this light, chest contrast-enhanced computed tomography (CECT) plays a crucial role in suggesting the presence and possible etiology of PH [3, 6, 7] due to its anatomical comprehensiveness, allowing for integrated evaluation of lung, pulmonary vasculature, and mediastinal structures, including the heart [3, 6–8]. Given the clinical relevance of PH, radiologists’ active participation in the multidisciplinary PH team requires adequate knowledge and training in chest CECT imaging.

The appearance of PH on CECT is pleomorphic, encompassing various signs and patterns involving all the thoracic compartments [3, 6–8]. Therefore, one can assume that CECT reporting of PH requires experienced readers. However, the shortage of radiologists dedicated to this topic raises the question of what essential radiological information is needed to enable inexperienced readers to report a PH case knowingly, reliably, and rapidly. It is conceivable that this core consists not just of a set of distinct elements of sophisticated imaging features but of general patterns allowing for relevant clinical information concerning the PH phenotype. To our knowledge, no previous studies assessed the potential benefit inexperienced and/or non-dedicated chest radiologists might have from using an updated hands-on synopsis summarizing and organizing the CECT imaging findings of PH.

The primary aim was to evaluate the impact of using a quick hands-on tool for classifying PH on chest CECT (Rapid Access and Practical Information Digest on Computed Tomography for Pulmonary Hypertension, RAPID-CT-PH) on readers with limited experience in CT imaging and non-dedicated to thoracic imaging. We assessed the inter-reader agreement in assigning the PH group between four radiology residents (RRs) and two radiologists with cardio-pulmonary CT imaging expertise. The secondary objectives were to assess the impact of the RAPID-CT-PH on the agreement between inexperienced and experienced readers in formulating an etiological hypothesis of PH and its effect on the completeness of reports generated by inexperienced readers. Finally, we compared the CECT reading times using or not using the RAPID-CT-PH.

Material and methods

Our Institutional Review Board approved this monocentric, observational study and waived the acquisition of informed consent from patients due to the retrospective design.

Study design

Overall, we organized the study as follows (Fig. 1).Fig. 1 Graphical representation of the study organization (see the main text for details)

First, the study coordinator, i.e., a radiologist not involved in image reading, drafted the RAPID-CT-PH, a PH-dedicated quick hands-on tool based on the current literature evidence [6–25]. Two radiologists with 14 years of experience in cardio-pulmonary CT imaging (chest radiologist 1 [CR1] and chest radiologist 2 [CR2]) actively contributed to this task by reviewing and approving the final draft. The RAPID-CT-PH consisted of two parts: (i) A checklist of typical thoracic signs of PH to be identified on CECT; and (ii) a synoptic table series in which these signs are categorized within each PH group and subgroup. The signs included in the checklist are defined according to the glossary of terms for thoracic imaging from the Fleischner Society [26] and specific papers on PH chest computed tomography findings [6, 8, 12]. The two components forming the RAPID-CT-PH are shown in Fig. 2.Fig. 2 Rapid access and practical information digest on computed tomography for pulmonary hypertension (RAPID-CT-PH). A Checklist of typical chest computed tomography signs of pulmonary hypertension. B–F Synoptic table series categorizing chest computed tomography signs within each PH group and subgroup

Second, the study coordinator identified four radiology residents (RRs) attending the residency program at our University Hospital, including two senior residents in the last year of the program (radiology resident 1 [RR1] and radiology resident 3 [RR3]) and two novice residents at the beginning of their first year of the program with no previous experience in chest CT imaging (radiology resident 2 [RR2] and radiology resident 4 [RR4]).

Finally, all the residents (RR1-4) participated in a two-phase study, including a dedicated 2-h-long frontal teaching session focused on the chest CECT imaging role in patients with PH (“training” phase” of the study) and a subsequent case reading session, with or without the aid of the RAPID-CT-PH (“practical phase” of the study). Details are explained below.

Study population

By performing a computerized search, we identified all consecutive patients aged ≥ 18 years and diagnosed with PH who underwent a chest CECT in our Institution from 2015 to 2022. Patients were referred from the Cardiology Unit or the Rheumatology Clinic of our tertiary care University Hospital. Chest CECT was defined as a CT examination of the whole thorax after intravenous injection of iodinated contrast agent, utilizing two alternative protocols: CT pulmonary angiogram (CTPA) or venous-phase chest CT (VPCT). In the case of multiple available CECT scans, we considered the one closest to the PH diagnosis. According to 2022 ESC/ERS guidelines, PH was defined as the presence of a resting mean PAP > 20 mmHg on right heart catheterization or, in the case of unfeasible catheterization, highly probable PH on echocardiography [1]. Exclusion criteria encompassed unavailability of clinical data, prior cardiac surgery or lung transplantation history, and chest CECT examinations of non-diagnostic quality.

Of the 101 eligible subjects diagnosed with PH, we excluded 17 patients with unavailable CECT, 6 with unavailable clinical data, 3 with acute pulmonary infection potentially masquerading the PH imaging findings, 2 with prior cardiac surgery or lung transplantation history, and 13 because of chest CECT examinations of non-diagnostic quality. Therefore, the final population comprised 60 patients (25 men and 35 women; median age, 70 years; range, 41–85 years). The diagnosis of PH was based on right heart catheterization findings in 39/60 patients (mPAP values: median, 36.8 mmHg; range, 21–68 mmHg), the remaining 21/60 with a high-probability diagnosis on echocardiography. Fifty-three patients underwent chest CECT with CTPA protocol, the remaining 7 being VPCT.

Chest CECT examination technique

All the chest CECTs were performed on a 64-row computed tomography scanner (Discovery HD750 or Optima, GE Healthcare, Milwaukee, WI, USA), with the patient in the supine position, during inspiratory breath-hold, following intravenous administration of iodinated contrast medium (Iomeprol or Iobitridol, Bracco, Milan, Italy, with an Iodine concentration ranging from 350 to 400 mg/mL). The CTPA and VPCT technical parameters are reported in the supplementary material. The reconstruction sets included images with windowing and kernel dedicated to lung parenchyma (level, − 500 Hounsfield Units [HU]; width, 1700 HU; high-spatial-frequency algorithm) and soft tissues (level, 50 HU; width, 350 HU; standard algorithm). For CTPA examinations, images with arterial pulmonary vessel windowing (level, 100 HU; width, 700 HU) were also obtained.

Study phases, image analysis, and reference standard

Training phase

All the RRs, blinded to the study objectives, attended a dedicated 2 h-long frontal lecture held by CR1 and CR2. The lecture aimed to provide a shared theoretical basis for all the RRs and focused on the role, semiotics, and interpretation of chest CECT in patients with PH.

Practical phase

For each reader, the order of case presentation was randomized using freely available software (https://www.randomizer.org).

All RRs, independently and blinded to patient clinical, functional, and imaging data, reviewed all the CECT examinations. Their sole knowledge of clinical data was that all patients had confirmed PH diagnosis. For each CECT examination, the RRs were tasked with formulating a primary hypothesis regarding the PH group assignment. In cases of uncertainty, they were allowed to propose an alternative hypothesis for the PH group. Lastly, the RRs were required to indicate their presumed etiology of PH. For PH case reviewing and reporting, each RR disposed of a days’ number commensurate with the sample size, i.e., three consecutive working days stating 60 cases and a reasonable evaluation of 20 examinations per day.

The RRs were divided into two groups, each consisting of a senior and a novice RR. The groups included the “control” group, composed of RR1 (senior reader) and RR2 (novice reader), without any assistance for reporting the PH cases, and the “RAPID-CT-PH” group, composed of RR3 (senior reader) and RR4 (novice reader), both provided with the RAPID-CT-PH.

The consensus of CR1 and CR2 defined the reference standard (chest radiologists’ consensus, CRc) after they independently reviewed all CECT examinations, blinded to the patient’s clinical history except having been diagnosed with PH. CR1 and CR2 were given a reporting template with designated sections for “description” and “interpretation.” The “description” section comprised the twelve key features constituting the findings’ checklist in the RAPID-CT-PH. In the “interpretation” section, following the same approach as the RRs, they formulated a primary hypothesis regarding the PH group assignment and, in case of uncertainty, could propose an alternative PH group hypothesis. They also indicated the presumed PH etiology. Finally, all discrepancies were resolved through consensus (CRc), and a single PH group allocation hypothesis was selected for each case.

All CECT examinations were evaluated on a Picture Archiving and Communication System workstation (Suitestensa Ebit srl, Esaote Group Company, Genoa, Italy). The same software allowed the readers to multiplanar reconstructions and apply post-processing algorithms such as Maximum Intensity Projection (MIP), Minimum Intensity Projection (MinIP), and Average Intensity Projection (AIP) for more comprehensive image analysis.

Statistical analysis

The inter-reader agreement between each RR and CRc in classifying PH into the five groups as per the 2022 ESC/ERS guidelines [1] was determined using the unweighted Cohen’s Kappa statistic (k) with 95% confidence intervals (CI). Similarly, for the same classification task, we calculated the inter-reader agreement between RR1-RR2-CRc and RR3-RR4-CRc using the unweighted Fleiss’ kappa, and between RRs within the “control” group (RR1-RR2) and “RAPID-CT-PH” group (RR3-RR4) using the unweighted Cohen’s kappa. We deemed the agreement positive when the first or second-choice hypothesis for allocating the PH group provided by the RRs matched that of CRc. The k coefficient was interpreted as < 0.00, poor; 0.00–0.20, slight; 0.21–0.40, fair; 0.41–0.60, moderate; 0.61–0.80, substantial; 0.81–1.00, almost perfect [27].

The inter-reader agreement between each RR and CRc and between RRs within the “control” group and the “RAPID-CT-PH” group in producing an etiological hypothesis of PH was evaluated using Cohen’s kappa statistic. The same methodology outlined in the primary objective subsection was applied to this analysis. We focused on only PH group I and group III cases while excluding PH cases from groups II, IV, and V from the etiology analysis. Indeed, non-cardiac CT suffers from inherent limitations in assessing the heart and coronaries (group II), all the group IV cases in our series were due to CTEPH, and we had only one group V case.

The completeness of reports produced by the RRs was quantified using a completeness index. Initially, the index was expressed on a scale of 0–12 points, with each key feature being assigned one point and later converted to a scale of 0–100. The twelve key features considered were those reported in the RAPID-CT-PH and preliminarily presented to CR1 and CR2 (see above for details). The completeness indexes were calculated for each RR and compared between senior RRs (RR1 vs. RR3) and novice RRs (RR2 vs. RR4) using the Wilcoxon–Mann–Whitney test, as the data distribution did not follow a normal distribution as per the Kolmogorov–Smirnov test.

The average CECT reporting time was compared between RRs with and without the RAPID-CT-PH, i.e., reporting time of RR1-RR2 versus reporting time of RR3-RR4. The Wilcoxon–Mann–Whitney test was used for the comparison due to the non-normal distribution of the data.

To assess consistency between the CRc group hypothesis and the MDT-driven PH final group diagnosis, we calculated the CRc-MDT agreement in grouping PH using the percent agreement (PA) and the Prevalence and Bias Adjusted Kappa (PABAK) with 95%CI. Reference PABAK values were interpreted likewise the k coefficients.

Statistical analyses were conducted using R software version 3.4.2 (R Foundation for Statistical Computing, Vienna, Austria) and Single Case Research—web-based calculators for SCR analysis version 2.0, College Station, Texas. A significance level of 0.05 was used for all tests.

Results

CECT-based PH grouping and etiology according to the reference standard

Table 1 presents the distribution of CECT-defined case allocation across the five PH groups based on CRc readings. The two most prevalent PH groups were group II (21/60, 35%), which corresponds to PH associated with left heart disease, and group III (16/60, 26%), representing PH associated with lung diseases and/or hypoxia. Ten out of 60 patients (17%) were categorized as group IV PH, all attributed to chronic thrombo-embolic PH (CTEPH). Only one case was classified as group V PH, resulting from sarcoidosis. The remaining 12 out of 60 (20%) cases fell under group I PH, with connective tissue disease being the most hypothesized etiology (5/12 cases). Table 1 Distribution of chest contrast-enhanced computed tomography-defined case allocation across the five pulmonary hypertension groups based on the chest radiologists’ consensus readings

PHa grouping according to CRcb	PH etiology according to CRc	
Group	Definition	N (%)	Subgroup etiology	N (%)	
I	Pulmonary arterial hypertension (PAH)	12/60 (20)	1.1 Idiopathic	4/12 (33)	
1.4 Associated with:		
1.4.1 Connective tissue disease	5/12 (42)	
1.4.3 Portal hypertension	2/12 (17)	
1.4.4 congenital heart disease	1/12 (8)	
II	PH associated with left heart disease	21/60 (35)	2.1 Heart failure	14/21 (66)	
2.2 Valvular heart disease	7/21 (33)	
III	PH associated with lung diseases and/or hypoxia	16/60 (26)	3.1 Obstructive lung disease or emphysema	4/16 (25)	
3.2 Restrictive lung disease	8/16 (50)	
3.3 Lung diseases with mixed restrictive/obstructive pattern	3/16 (19)	
3.4 Hypoventilation syndromes (e.g., obstructive sleep apnea)	1/16 (6)	
IV	PH associated with pulmonary artery obstructions	10/60 (6)	4.1 Chronic thrombo-embolic PH (CTEPH)	10/10 (100)	
V	PH with unclear and/or multifactorial mechanisms	1/60 (1)	5.2 Systemic disorders

Sarcoidosis

	1/1 (100)	
aPulmonary hypertension

bChest radiologists’ consensus

The CRc-MDT agreement in grouping PH was almost perfect, with PA = 87% (52/60 cases) and PABAK = 0.83 (95%CI, 0.73–0.93).

Inter-reader agreement in classifying PH and hypothesizing its etiology

Table 2 reports the distribution of cases across PH groups, as categorized according to RRs. Group 2 PH was the most prevalent, with frequencies ranging from 28 to 50%. Table 2 Distribution of cases across pulmonary hypertension groups, as categorized according to the radiology residents

PHa group	RRb 1
N (%)	RR 2
N (%)	RR 3
N (%)	RR 4
N (%)	
I	14/60 (23)	18/60 (30)	16/60 (26)	18/60 (30)	
II	23/60 (38)	30/60 (50)	17/60 (28)	17/60 (28)	
III	19/60 (15)	8/60 (13)	17/60 (28)	13/60 (21)	
IV	12/60 (20)	3/60 (5)	9/60 (15)	11/60 (18)	
V	2/60 (3)	1/60 (1)	1/60 (1)	1/60 (1)	
aPulmonary hypertension

bRadiology resident

Table 3 shows the results of the inter-reader agreement analysis. The inter-reader agreement in classifying PH between the RRs who used RAPID-CT-PH and CRc was substantial for both the novice reader (RR4) and the senior reader (RR3); while, it was only moderate for the readers who did not employ it (RR1 and RR2). When comparing RRs within the same groups, the inter-reader agreement was fair (0.34) in the “control” group (RR1-RR2) and substantial (0.69) in the “RAPID-CT-PH” group (RR3-RR4). Table 3 Results of the inter-reader agreement analysis on pulmonary hypertension group allocation and etiology

	PHa group allocation
k [95%CI]	PH etiology
k [95%CI]	
RR1b—CRcd

Cohen’s kappa

	0.57 [0.42–0.73]

Moderate

	0.43 [0.24–0.62]

Moderate

	
RR2b—CRc

Cohen’s kappa

	0.49 [0.33–0.65]

Moderate

	0.29 [0.12–0.47]

Fair

	
RR1—RR2—CRc

Fleiss’ kappa

	0.46 [0.38–0.55]

Moderate

	0.31 [0.24–0.38]

Fair

	
RR3c—CRc

Cohen’s kappa

	0.75 [0.62–0.88]

Substantial

	0.74 [0.57–0.91]

Substantial

	
RR4c—CRc

Cohen’s kappa

	0.65 [0.50–0.79]

Substantial

	0.66 [0.48–0.85]

Substantial

	
RR3—RR4—CRc

Fleiss’ kappa

	0.69 [0.61–0.77]

Substantial

	0.66 [0.57–0.74]

Substantial

	
aPulmonary hypertension

bRadiology residents not using RAPID-CT-PH

cRadiology residents using RAPID-CT-PH

dChest radiologists’ consensus

The inter-reader agreement with CRc regarding PH etiology was substantial when using RAPID-CT-PH (RR3 and RR4) and only fair-to-moderate for the readers who did not employ it (RR1 and RR2). When comparing RRs within the same groups, the inter-reader agreement was fair (0.25) in the “control” group and moderate (0.58) in the “RAPID-CT-PH” group.

Figure 3 visually represents the differences in agreement between RRs and CRc across the cases through dispersion diagrams. Example PH cases are shown in Figs. 4, 5.Fig. 3 Dispersion diagrams illustrating the differences in agreement across the cases between radiology residents and chest radiologists’ consensus (A) and between radiology residents of the same group (control group and RAPID-CT-PH group) (B)

Fig. 4 Group I pulmonary hypertension in an 81-year-old woman. Images from CT pulmonary angiography examination show an abnormal return of the inferior vena cava to the left atrium (A, B), contrast medium jet directed from the left atrium to the right atrium (C), and lung mosaic attenuation pattern (D). The radiology residents in the control group did not identify the cardiovascular abnormality (RR2) or misclassified it (RR1); while, the ones in the RAPID-CT-PH group (RR3 and RR4) correctly identified and classified the condition

Fig. 5 Group III pulmonary hypertension in an 84-year-old man. Images from CT pulmonary angiography examination show enlarged pulmonary artery (A), enlarged right heart chambers, with normal appearance of the left ones, and without signs of chronic thromboembolic disease (not shown) (B), and diffuse lung emphysema (C, D). The radiology residents in the control group (RR1 and RR2) misclassified the heart enlargement as a group II pulmonary hypertension; while, the ones in the RAPID-CT-PH group (RR3 and RR4) correctly identified and classified the condition

Chest CECT report completeness and reporting time

Table 4 reports the RRs’ report completeness indexes and reporting times. Using RAPID-CT-PH resulted in significantly higher completeness in CECT reports compared to those without it, regardless of RR expertise (all p < 0.0001). It also significantly reduced the reporting time (p < 0.0001), with a median of 15 min for RRs using RAPID-CT-PH (RR3-RR4) versus 20 min for those who did not (RR1-RR2). Table 4 Radiology residents’ report completeness indexes and reporting times

Report completeness index	Senior residents	Novice residents	
RRa 1
without RAPID-CT-PH	RR 3
with RAPID-CT-PH	RR 2
without RAPID-CT-PH	RR 4
with RAPID-CT-PH	
Median (IQR) [min–max]	66.7 (16.7) [33.3–91.7]	100 (0) [100–100]	37.5 (0) [16.7–66.7]	100 (8.33) [83.3–100]	
p-valuea	 < 0.0001	 < 0.0001	
Reporting time
(minutes)	Residents without RAPID-CT-PHb	Residents with RAPID-CT-PH	
Median (IQR) [min–max]	20 (5) [10–40]	15 (9.75) [3–30]	
p-value*	 < 0.0001	
aRadiology resident

bRapid access and practical information digest on computed tomography for pulmonary hypertension

*Wilcoxon–Mann–Whitney test

Discussion

We found that the agreement between readers with limited experience in CT imaging (RRs) and radiologists with expertise in thoracic CT imaging (CRc) regarding chest CECT-based PH classification was substantial when the inexperienced readers utilized RAPID-CT-PH. Conversely, the agreement was only moderate when they did not use RAPID-CT-PH independently from being a novice or senior RR. To our knowledge, no previous studies have investigated the inter-reader agreement for classifying PH on chest CECT nor assessed how a quick hands-on tool could help inexperienced readers with such a task. Our results can be a valuable starting point for developing an educational PH-focused chest CT strategy within radiology residency programs or a practical tool aiding non-chest-devoted radiologists.

Several reasons may explain the higher agreement between RRs and CRc when using RAPID-CT-PH. First, RAPID-CT-PH includes a systematic checklist of CT findings, encompassing the various thoracic anatomical districts. Previous studies on CT imaging of different anatomical regions [28–30] demonstrated that utilizing a checklist of CT findings enables the identification of subtle signs with greater efficiency, going beyond the assessment of apparent findings and, in turn, improving diagnostic quality. Specifically, when dealing with chest imaging, the heart is often under-reported in non-dedicated CT examinations [31]. However, gathering valuable information on cardiac structures is possible even from a “routine” contrast-enhanced chest CT [32–34]. In PH patients, detectable cardiac anomalies include chamber enlargement, coarse valvular or coronary artery calcifications, gross intra- and extracardiac shunts, and atrial thrombi or masses [35]. In addition, explicitly seeking and reporting signs of pulmonary edema may suggest heart failure or valvular heart disease as causes of group II PH [36].

Second, RAPID-CT-PH incorporates a group-based organization of CT findings. This structured layout can assist inexperienced readers in conducting a comprehensive assessment of all the signs related to a particular group, thus integrating information from various anatomical regions. We hypothesize that visually complementing the list of findings in lung parenchyma, vessels, and mediastinum aided the RRs in reliably allocating PH group cases. This could be the case of PH group IV CECTs, wherein attention needs to be directed toward both pulmonary vessels and the lung [37, 38].

Third, RAPID-PH-CT was beneficial in assessing pulmonary abnormalities and assigning their relative priority compared to other findings. Specifically, compared to CRc, readers using RAPID-PH-CT effectively identified most group III PH cases (12/16 for RR4 and 16/16 for RR3). On the other hand, readers without RAPID-PH-CT properly allocated only around half of the cases (8/16 for RR1 and 7/16 for RR2). In clinical practice, distinguishing between group I and group III PH can be challenging [39], and physicians should reckon with cases displaying mixed PH phenotypes, i.e., cases that share characteristics of various PH groups rather than identify in a unique one [40]. Therefore, even if the final classification of PH derived from a comprehensive multidisciplinary evaluation may not accomplish the CT-derived hypothesis, the radiological assessment of parenchymal abnormalities remains critical. Indeed, CT-detected signs of lung fibrosis and emphysema in PH patients suggest chronic hypoxia [41] and are associated with significantly poorer survival, particularly when coupled with reduced DLCO [42].

The inter-reader agreement between RRs and CRc regarding PH etiology was substantial when using RAPID-CT-PH and only fair-to-moderate without employing it. We built RAPID-CT-PH as a comprehensive collection of complex CECT semiotics to organize imaging findings according to the thoracic anatomical districts, PH groups, and subgroup etiologies. It is worth underlining that CECT cannot claim to identify the PH etiology, and a multidisciplinary approach integrating imaging, functional, and laboratory tests is necessary to approach such a target. However, utilizing RAPID-CT-PH to browse the various conditions associated with each PH group may assist non-dedicated radiologists in avoiding the omission of subgroup-specific CT findings that can be subtle or not obvious, e.g., within group I PH, lung mosaic pattern or centrilobular ground-glass nodules in the “idiopathic form” [10], and macroscopic left-to-right cardiac shunts in the “congenital heart disease form” [1].

Using RAPID-CT-PH positively impacted the reporting completeness of chest CECT. Readers in the “control” group frequently omitted specific information that may be required for management decisions as part of the PH multidisciplinary evaluation. For instance, omitting to explicitly report the absence of notable lung abnormalities, e.g., fibrosis or emphysema, may require the referring clinician to subsequently contact the radiologist, ask for a second opinion, or even repeat the diagnostics, thus resulting in time and energy loss and, ultimately, potential management delays.

RAPID-CT-PH aided RRs in shortening the CECT reporting time. This result aligns with previous studies on diverse chest CT scenarios, e.g., COVID-19 pneumonia [43] and connective tissue diseases [44], showing the positive impact of digital supporting tools on the readers’ interpretation time. Of note, when using RAPID-CT-PH, RRs had a mean reporting time for chest CECT of 15 min, comparable (if not shorter) to large-scale radiology information system-derived radiologists’ mean reporting times, ranging from 17 to 19 min [45].

In the rising imaging-applied artificial intelligence (AI) era, emphasizing human intelligence (HI) may seem questionable. Contemporary RRs face increasing information demand on each imaging scenario, starting from the basics, such as terminology, definitions, and classifications. A direct comparison between HI and AI focusing solely on such “factual knowledge” components [46] would likely demonstrate the superiority of AI tools over humans. It has been advocated that prioritizing the reasoning processes involved in clinical-radiological integration, thereby operating at a higher level of knowledge, is essential to enhance RR education [47]. In response to this call, we set up this study involving RRs in a specific subspecialty topic, PH, to provide them with a challenge that could prototype a wide range of imaging scenarios. The present study aligns with endeavors toward implementing competency-based medical education (CBME) initiatives within radiology residency programs [48].

Some study limitations warrant mention. First, as the readers were aware that all cases were PH-confirmed, we did not evaluate the impact of RAPID-CT-PH in identifying PH in suspected cases. Therefore, no control cases without PH have been included in the study cohort. However, we intended RAPID-CT-PH to help classify rather than identify PH at CECT. We also believe that RAPID-CT-PH could provide a reliable basis for integrating chest CT-dedicated AI-driven tools. Further research is needed to explore the potential benefits of a human–machine partnership approach [49, 50], combining AI and HI to enhance imaging-derived PH phenotyping. Second, 7/60 CECTs were acquired via VPCT protocol, presumably less accurate in detecting the vascular signs of group IV PH (CTEPH). Due to the potential of VPCT protocol for effectively revealing signs related to the other PH groups [24], the influence of such a protocol heterogeneity on the reliability of PH classification is likely limited. Third, not all patients had an RHC-based diagnosis of PH; instead, a high probability of PH at echocardiography was used in 21 out of 60 cases. Although this may appear as a suboptimal patient selection, according to the 2022 ESC/ERS Guidelines on PH, RHC can be omitted in certain conditions, e.g., in patients with a high likelihood of left heart disease as the leading cause of PH [1]. We, therefore, believe this compromise does not undermine our results regarding RAPID-CT-PH. Last, this study was conducted at a single center with a small sample size, which may have led to an unbalanced distribution of cases among the groups, thus potentially hampering reproducibility. Indeed, we reported only one group V PH case related to sarcoidosis. Nonetheless, it is worth mentioning that most cases were attributed to left heart disease (group II PH), followed by lung disease (group III PH), which aligns with the frequencies reported in previous studies [2].

In conclusion, we observed substantial agreement on chest CECT-based PH classification between inexperienced readers using RAPID-CT-PH and expert radiologists. RAPID-CT-PH improved report completeness and reduced reporting time for chest CECT. Our results suggest that a quick hands-on tool for classifying PH on chest CECT can enable inexperienced radiologists to play a valuable role within the PH multidisciplinary team, thus impacting clinical decision-making. RAPID-CT-PH should be used early and systematically during the residency.

Supplementary Information

Below is the link to the electronic supplementary material.Supplementary file1 (PDF 37 KB)

Acknowledgements

Figure 1 was created with BioRender.com. We gratefully acknowledge the valuable assistance of Dr. Martina Meduri in graphic design and Dr. Valentino Collini for clinical support.

Author contributions

Lorenzo Cereser, Vincenzo Patruno, Chiara Zuiani, and Rossano Girometti contributed to the study conception and design. Gaia Zussino, Carmelo Cicciò, Annarita Tullio, Chiara Montanaro, Mauro Driussi, and Emma Di Poi performed material preparation, data collection, and analysis. Lorenzo Cereser and Gaia Zussino wrote the first draft of the manuscript. All authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Funding

Open access funding provided by Università degli Studi di Udine within the CRUI-CARE Agreement. The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

Declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Ethical approval

The Department of Medicine Institutional Review Board of the University of Udine approved the study (Rif. Prot. IRB 48/2023).

Consent to participate

This retrospective cohort study was performed in accordance with the principles of the Declaration of Helsinki. The study was approved by the Department of Medicine Institutional Review Board of the University of Udine (Rif. Prot. IRB 48/2023). The informed consent from patients to study participation was waived due to its retrospective nature.

Consent to publish

All the authors give the consent to publish the paper.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
==== Refs
References

1. Humbert M Kovacs G Hoeper MM Badagliacca R Berger RMF Brida M Carlsen J Coats AJS Escribano-Subias P Ferrari P Ferreira DS Ghofrani HA Giannakoulas G Kiely DG Mayer E Meszaros G Nagavci B Olsson KM Pepke-Zaba J Quint JK Rådegran G Simonneau G Sitbon O Tonia T Toshner M Vachiery JL Vonk Noordegraaf A Delcroix M Rosenkranz S ESC/ERS Scientific Document Group 2022 ESC/ERS guidelines for the diagnosis and treatment of pulmonary hypertension Eur Respir J 2023 61 1 2200879 10.1183/13993003.00879-2022 36028254
Humbert M, Kovacs G, Hoeper MM, Badagliacca R, Berger RMF, Brida M, Carlsen J, Coats AJS, Escribano-Subias P, Ferrari P, Ferreira DS, Ghofrani HA, Giannakoulas G, Kiely DG, Mayer E, Meszaros G, Nagavci B, Olsson KM, Pepke-Zaba J, Quint JK, Rådegran G, Simonneau G, Sitbon O, Tonia T, Toshner M, Vachiery JL, Vonk Noordegraaf A, Delcroix M, Rosenkranz S, ESC/ERS Scientific Document Group (2023) 2022 ESC/ERS guidelines for the diagnosis and treatment of pulmonary hypertension. Eur Respir J 61(1):2200879. 10.1183/13993003.00879-202236028254 10.1183/13993003.00879-2022
2. Hoeper MM Humbert M Souza R Idrees M Kawut SM Sliwa-Hahnle K Jing ZC Gibbs JS A global view of pulmonary hypertension Lancet Respir Med 2016 4 4 306 322 10.1016/S2213-2600(15)00543-3 26975810
Hoeper MM, Humbert M, Souza R, Idrees M, Kawut SM, Sliwa-Hahnle K, Jing ZC, Gibbs JS (2016) A global view of pulmonary hypertension. Lancet Respir Med 4(4):306–322. 10.1016/S2213-2600(15)00543-326975810 10.1016/S2213-2600(15)00543-3
3. Remy-Jardin M Ryerson CJ Schiebler ML Leung ANC Wild JM Hoeper MM Alderson PO Goodman LR Mayo J Haramati LB Ohno Y Thistlethwaite P van Beek EJR Knight SL Lynch DA Rubin GD Humbert M Imaging of pulmonary hypertension in adults: a position paper from the fleischner society Radiology 2021 298 3 531 549 10.1148/radiol.2020203108 33399507
Remy-Jardin M, Ryerson CJ, Schiebler ML, Leung ANC, Wild JM, Hoeper MM, Alderson PO, Goodman LR, Mayo J, Haramati LB, Ohno Y, Thistlethwaite P, van Beek EJR, Knight SL, Lynch DA, Rubin GD, Humbert M (2021) Imaging of pulmonary hypertension in adults: a position paper from the fleischner society. Radiology 298(3):531–549. 10.1148/radiol.202020310833399507 10.1148/radiol.2020203108
4. Opitz CF Hoeper MM Gibbs JS Kaemmerer H Pepke-Zaba J Coghlan JG Scelsi L D’Alto M Olsson KM Ulrich S Scholtz W Schulz U Grünig E Vizza CD Staehler G Bruch L Huscher D Pittrow D Rosenkranz S Pre-capillary, combined, and post-capillary pulmonary hypertension: a pathophysiological continuum J Am Coll Cardiol 2016 68 4 368 378 10.1016/j.jacc.2016.05.047 27443433
Opitz CF, Hoeper MM, Gibbs JS, Kaemmerer H, Pepke-Zaba J, Coghlan JG, Scelsi L, D’Alto M, Olsson KM, Ulrich S, Scholtz W, Schulz U, Grünig E, Vizza CD, Staehler G, Bruch L, Huscher D, Pittrow D, Rosenkranz S (2016) Pre-capillary, combined, and post-capillary pulmonary hypertension: a pathophysiological continuum. J Am Coll Cardiol 68(4):368–378. 10.1016/j.jacc.2016.05.04727443433 10.1016/j.jacc.2016.05.047
5. Hassoun PM Pulmonary arterial hypertension N Engl J Med 2021 385 25 2361 2376 10.1056/NEJMra2000348 34910865
Hassoun PM (2021) Pulmonary arterial hypertension. N Engl J Med 385(25):2361–2376. 10.1056/NEJMra200034834910865 10.1056/NEJMra2000348
6. Foley RW Kaneria N Ross RVM Suntharalingam J Hudson BJ Rodrigues JC Robinson G Computed tomography appearances of the lung parenchyma in pulmonary hypertension Br J Radiol 2021 94 1117 20200830 10.1259/bjr.20200830 32915646
Foley RW, Kaneria N, Ross RVM, Suntharalingam J, Hudson BJ, Rodrigues JC, Robinson G (2021) Computed tomography appearances of the lung parenchyma in pulmonary hypertension. Br J Radiol 94(1117):20200830. 10.1259/bjr.2020083032915646 10.1259/bjr.20200830
7. François CJ Schiebler ML Imaging of pulmonary hypertension Radiol Clin North Am 2016 54 6 1133 1149 10.1016/j.rcl.2016.05.011 27719980
François CJ, Schiebler ML (2016) Imaging of pulmonary hypertension. Radiol Clin North Am 54(6):1133–1149. 10.1016/j.rcl.2016.05.01127719980 10.1016/j.rcl.2016.05.011
8. Altschul E Remy-Jardin M Machnicki S Sulica R Moore JA Singh A Raoof S Imaging of pulmonary hypertension: pictorial essay Chest 2019 156 2 211 227 10.1016/j.chest.2019.04.003 30981724
Altschul E, Remy-Jardin M, Machnicki S, Sulica R, Moore JA, Singh A, Raoof S (2019) Imaging of pulmonary hypertension: pictorial essay. Chest 156(2):211–227. 10.1016/j.chest.2019.04.00330981724 10.1016/j.chest.2019.04.003
9. Rajaram S Swift AJ Condliffe R Johns C Elliot CA Hill C Davies C Hurdman J Sabroe I Wild JM Kiely DG CT features of pulmonary arterial hypertension and its major subtypes: a systematic CT evaluation of 292 patients from the ASPIRE Registry Thorax 2015 70 4 382 387 10.1136/thoraxjnl-2014-206088 25523307
Rajaram S, Swift AJ, Condliffe R, Johns C, Elliot CA, Hill C, Davies C, Hurdman J, Sabroe I, Wild JM, Kiely DG (2015) CT features of pulmonary arterial hypertension and its major subtypes: a systematic CT evaluation of 292 patients from the ASPIRE Registry. Thorax 70(4):382–387. 10.1136/thoraxjnl-2014-20608825523307 10.1136/thoraxjnl-2014-206088
10. Aluja Jaramillo F Gutierrez FR Díaz Telli FG Yevenes Aravena S Javidan-Nejad C Bhalla S Approach to pulmonary hypertension: from CT to clinical diagnosis Radiographics 2018 38 2 357 373 10.1148/rg.201817004611 29432063
Aluja Jaramillo F, Gutierrez FR, Díaz Telli FG, Yevenes Aravena S, Javidan-Nejad C, Bhalla S (2018) Approach to pulmonary hypertension: from CT to clinical diagnosis. Radiographics 38(2):357–373. 10.1148/rg.20181700461129432063 10.1148/rg.201817004611
11. Grosse C Grosse A CT findings in diseases associated with pulmonary hypertension: a current review Radiographics 2010 30 7 1753 1777 10.1148/rg.307105710 21057119
Grosse C, Grosse A (2010) CT findings in diseases associated with pulmonary hypertension: a current review. Radiographics 30(7):1753–1777. 10.1148/rg.30710571021057119 10.1148/rg.307105710
12. Hoey ETD Gopalan D Agrawal SKB Screaton NJ Cardiac causes of pulmonary arterial hypertension: assessment with multidetector CT Eur Radiol 2009 19 11 2557 2568 10.1007/s00330-009-1460-0 19471938
Hoey ETD, Gopalan D, Agrawal SKB, Screaton NJ (2009) Cardiac causes of pulmonary arterial hypertension: assessment with multidetector CT. Eur Radiol 19(11):2557–2568. 10.1007/s00330-009-1460-019471938 10.1007/s00330-009-1460-0
13. Ali N Loughborough WW Rodrigues JCL Suntharalingam J Hudson B Hall T Augustine D Mackenzie R Robinson G Computed tomographic and clinical features of pulmonary veno-occlusive disease: raising the radiologist’s awareness Clin Radiol 2019 74 9 655 662 10.1016/j.crad.2019.04.023 31178067
Ali N, Loughborough WW, Rodrigues JCL, Suntharalingam J, Hudson B, Hall T, Augustine D, Mackenzie R, Robinson G (2019) Computed tomographic and clinical features of pulmonary veno-occlusive disease: raising the radiologist’s awareness. Clin Radiol 74(9):655–662. 10.1016/j.crad.2019.04.02331178067 10.1016/j.crad.2019.04.023
14. Kumar N Price LC Montero MA Dimopoulos K Wells AU Wort SJ Pulmonary tumour thrombotic microangiopathy: unclassifiable pulmonary hypertension? Eur Respir J 2015 46 4 1214 1217 10.1183/13993003.00052-2015 26206876
Kumar N, Price LC, Montero MA, Dimopoulos K, Wells AU, Wort SJ (2015) Pulmonary tumour thrombotic microangiopathy: unclassifiable pulmonary hypertension? Eur Respir J 46(4):1214–1217. 10.1183/13993003.00052-201526206876 10.1183/13993003.00052-2015
15. Criado E Sánchez M Ramírez J Arguis P de Caralt TM Perea RJ Xaubet A Pulmonary sarcoidosis: typical and atypical manifestations at high-resolution CT with pathologic correlation Radiographics 2010 30 6 1567 1586 10.1148/rg.306105512 21071376
Criado E, Sánchez M, Ramírez J, Arguis P, de Caralt TM, Perea RJ, Xaubet A (2010) Pulmonary sarcoidosis: typical and atypical manifestations at high-resolution CT with pathologic correlation. Radiographics 30(6):1567–1586. 10.1148/rg.30610551221071376 10.1148/rg.306105512
16. Foti G Gobbi F Angheben A Faccioli N Cicciò C Carbognin G Buonfrate D Radiographic and HRCT imaging findings of chronic pulmonary schistosomiasis: review of 10 consecutive cases BJR Case Rep 2019 5 3 20180088 10.1259/bjrcr.20180088 31555468
Foti G, Gobbi F, Angheben A, Faccioli N, Cicciò C, Carbognin G, Buonfrate D (2019) Radiographic and HRCT imaging findings of chronic pulmonary schistosomiasis: review of 10 consecutive cases. BJR Case Rep 5(3):20180088. 10.1259/bjrcr.2018008831555468 10.1259/bjrcr.20180088
17. Coste F Benlala I Dournes G Girodet PO Laurent F Berger P Assessing pulmonary hypertension in COPD. Is there a role for computed tomography? Int J Chron Obstruct Pulmon Dis 2019 14 2065 2079 10.2147/COPD.S207363 31564854
Coste F, Benlala I, Dournes G, Girodet PO, Laurent F, Berger P (2019) Assessing pulmonary hypertension in COPD. Is there a role for computed tomography? Int J Chron Obstruct Pulmon Dis 14:2065–2079. 10.2147/COPD.S20736331564854 10.2147/COPD.S207363
18. Raghu G Remy-Jardin M Ryerson CJ Myers JL Kreuter M Vasakova M Bargagli E Chung JH Collins BF Bendstrup E Chami HA Chua AT Corte TJ Dalphin JC Danoff SK Diaz-Mendoza J Duggal A Egashira R Ewing T Gulati M Inoue Y Jenkins AR Johannson KA Johkoh T Tamae-Kakazu M Kitaichi M Knight SL Koschel D Lederer DJ Mageto Y Maier LA Matiz C Morell F Nicholson AG Patolia S Pereira CA Renzoni EA Salisbury ML Selman M Walsh SLF Wuyts WA Wilson KC Diagnosis of hypersensitivity pneumonitis in adults. An official ATS/JRS/ALAT clinical practice guideline Am J Respir Crit Care Med 2020 202 3 e36 e69 10.1164/rccm.202005-2032ST 32706311
Raghu G, Remy-Jardin M, Ryerson CJ, Myers JL, Kreuter M, Vasakova M, Bargagli E, Chung JH, Collins BF, Bendstrup E, Chami HA, Chua AT, Corte TJ, Dalphin JC, Danoff SK, Diaz-Mendoza J, Duggal A, Egashira R, Ewing T, Gulati M, Inoue Y, Jenkins AR, Johannson KA, Johkoh T, Tamae-Kakazu M, Kitaichi M, Knight SL, Koschel D, Lederer DJ, Mageto Y, Maier LA, Matiz C, Morell F, Nicholson AG, Patolia S, Pereira CA, Renzoni EA, Salisbury ML, Selman M, Walsh SLF, Wuyts WA, Wilson KC (2020) Diagnosis of hypersensitivity pneumonitis in adults. An official ATS/JRS/ALAT clinical practice guideline. Am J Respir Crit Care Med 202(3):e36–e69. 10.1164/rccm.202005-2032ST32706311 10.1164/rccm.202005-2032ST
19. Rossi A Zompatori M Tchouante Tchouanhou P Amadori M Palazzini M Conficoni E Galiè N Poletti V Gavelli G Rare causes of pulmonary hypertension: spectrum of radiological findings and review of the literature Radiol Med 2014 119 1 41 53 10.1007/s11547-013-0305-8 24234182
Rossi A, Zompatori M, Tchouante Tchouanhou P, Amadori M, Palazzini M, Conficoni E, Galiè N, Poletti V, Gavelli G (2014) Rare causes of pulmonary hypertension: spectrum of radiological findings and review of the literature. Radiol Med 119(1):41–53. 10.1007/s11547-013-0305-824234182 10.1007/s11547-013-0305-8
20. Alves Júnior SF Zanetti G Melo ASAD Souza AS Jr Souza LS Meirelles GDSP Irion KL Hochhegger B Marchiori E Neurofibromatosis type 1: state-of-the-art review with emphasis on pulmonary involvement Respir Med 2019 149 9 15 10.1016/j.rmed.2019.01.002 30885426
Alves Júnior SF, Zanetti G, Melo ASAD, Souza AS Jr, Souza LS, Meirelles GDSP, Irion KL, Hochhegger B, Marchiori E (2019) Neurofibromatosis type 1: state-of-the-art review with emphasis on pulmonary involvement. Respir Med 149:9–15. 10.1016/j.rmed.2019.01.00230885426 10.1016/j.rmed.2019.01.002
21. Borie R Crestani B Guyard A Lidove O Interstitial lung disease in lysosomal storage disorders Eur Respir Rev 2021 30 160 200363 10.1183/16000617.0363-2020 33927007
Borie R, Crestani B, Guyard A, Lidove O (2021) Interstitial lung disease in lysosomal storage disorders. Eur Respir Rev 30(160):200363. 10.1183/16000617.0363-202033927007 10.1183/16000617.0363-2020
22. Cottin V Selman M Inoue Y Wong AW Corte TJ Flaherty KR Han MK Jacob J Johannson KA Kitaichi M Lee JS Agusti A Antoniou KM Bianchi P Caro F Florenzano M Galvin L Iwasawa T Martinez FJ Morgan RL Myers JL Nicholson AG Occhipinti M Poletti V Salisbury ML Sin DD Sverzellati N Tonia T Valenzuela C Ryerson CJ Wells AU Syndrome of combined pulmonary fibrosis and emphysema: an official ATS/ERS/JRS/ALAT research statement Am J Respir Crit Care Med 2022 206 4 e7 e41 10.1164/rccm.202206-1041ST 35969190
Cottin V, Selman M, Inoue Y, Wong AW, Corte TJ, Flaherty KR, Han MK, Jacob J, Johannson KA, Kitaichi M, Lee JS, Agusti A, Antoniou KM, Bianchi P, Caro F, Florenzano M, Galvin L, Iwasawa T, Martinez FJ, Morgan RL, Myers JL, Nicholson AG, Occhipinti M, Poletti V, Salisbury ML, Sin DD, Sverzellati N, Tonia T, Valenzuela C, Ryerson CJ, Wells AU (2022) Syndrome of combined pulmonary fibrosis and emphysema: an official ATS/ERS/JRS/ALAT research statement. Am J Respir Crit Care Med 206(4):e7–e41. 10.1164/rccm.202206-1041ST35969190 10.1164/rccm.202206-1041ST
23. Castoldi MC Verrioli A De Juli E Vanzulli A Pulmonary Langerhans cell histiocytosis: the many faces of presentation at initial CT scan Insights Imaging 2014 5 4 483 492 10.1007/s13244-014-0338-0 24996395
Castoldi MC, Verrioli A, De Juli E, Vanzulli A (2014) Pulmonary Langerhans cell histiocytosis: the many faces of presentation at initial CT scan. Insights Imaging 5(4):483–492. 10.1007/s13244-014-0338-024996395 10.1007/s13244-014-0338-0
24. Expert Panel on Thoracic ImagingSirajuddin A Mirmomen SM Henry TS Kandathil A Kelly AM King CS Kuzniewski CT Lai AR Lee E Martin MD Mehta P Morris MF Raptis CA Roberge EA Sandler KL Donnelly EF ACR appropriateness criteria® suspected pulmonary hypertension: 2022 update J Am Coll Radiol 2022 19 11S S502 S512 10.1016/j.jacr.2022.09.018 36436973
Expert Panel on Thoracic Imaging, Sirajuddin A, Mirmomen SM, Henry TS, Kandathil A, Kelly AM, King CS, Kuzniewski CT, Lai AR, Lee E, Martin MD, Mehta P, Morris MF, Raptis CA, Roberge EA, Sandler KL, Donnelly EF (2022) ACR appropriateness criteria® suspected pulmonary hypertension: 2022 update. J Am Coll Radiol 19(11S):S502–S512. 10.1016/j.jacr.2022.09.01836436973 10.1016/j.jacr.2022.09.018
25. Collini V Driussi M Nalli C Baldassi M Di Poi E Cereser L Giuliana F Patruno V Stolfo D Sinagra G Imazio M Leflunomide-induced pulmonary arterial hypertension: case report and review of literature J Cardiol Cases 2022 26 2 148 150 10.1016/j.jccase.2022.04.001 35949584
Collini V, Driussi M, Nalli C, Baldassi M, Di Poi E, Cereser L, Giuliana F, Patruno V, Stolfo D, Sinagra G, Imazio M (2022) Leflunomide-induced pulmonary arterial hypertension: case report and review of literature. J Cardiol Cases 26(2):148–150. 10.1016/j.jccase.2022.04.00135949584 10.1016/j.jccase.2022.04.001
26. Bankier AA MacMahon H Colby T Gevenois PA Goo JM Leung ANC Lynch DA Schaefer-Prokop CM Tomiyama N Travis WD Verschakelen JA White CS Naidich DP Fleischner society: glossary of terms for thoracic imaging Radiology 2024 310 2 e232558 10.1148/radiol.232558 38411514
Bankier AA, MacMahon H, Colby T, Gevenois PA, Goo JM, Leung ANC, Lynch DA, Schaefer-Prokop CM, Tomiyama N, Travis WD, Verschakelen JA, White CS, Naidich DP (2024) Fleischner society: glossary of terms for thoracic imaging. Radiology 310(2):e232558. 10.1148/radiol.23255838411514 10.1148/radiol.232558
27. Landis JR Koch GG The measurement of observer agreement for categorical data Biometrics 1977 33 1 159 174 10.2307/2529310 843571
Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174843571 10.2307/2529310
28. Dendl LM Pausch AM Hoffstetter P Dornia C Höllthaler J Ernstberger A Becker R Kopf S Schleder S Schreyer AG Structured reporting of whole-body trauma ct scans using checklists: diagnostic accuracy of reporting radiologists depending on their level of experience Rofo 2021 193 12 1451 1460 10.1055/a-1541-8265 34348402
Dendl LM, Pausch AM, Hoffstetter P, Dornia C, Höllthaler J, Ernstberger A, Becker R, Kopf S, Schleder S, Schreyer AG (2021) Structured reporting of whole-body trauma ct scans using checklists: diagnostic accuracy of reporting radiologists depending on their level of experience. Rofo 193(12):1451–1460. 10.1055/a-1541-826534348402 10.1055/a-1541-8265
29. Lin E Powell DK Kagetsu NJ Efficacy of a checklist-style structured radiology reporting template in reducing resident misses on cervical spine computed tomography examinations J Digit Imaging 2014 27 5 588 593 10.1007/s10278-014-9703-2 24865860
Lin E, Powell DK, Kagetsu NJ (2014) Efficacy of a checklist-style structured radiology reporting template in reducing resident misses on cervical spine computed tomography examinations. J Digit Imaging 27(5):588–593. 10.1007/s10278-014-9703-224865860 10.1007/s10278-014-9703-2
30. Blum SFU Hertzschuch D Langer E Schön F Oppermann N Kamin K Kühn JP Eberlein-Gonska M Hoffmann RT Routine use of structured reporting in whole-body trauma CT facilitates quality improvement Rofo 2023 195 6 521 528 10.1055/a-2031-2364 37019142
Blum SFU, Hertzschuch D, Langer E, Schön F, Oppermann N, Kamin K, Kühn JP, Eberlein-Gonska M, Hoffmann RT (2023) Routine use of structured reporting in whole-body trauma CT facilitates quality improvement. Rofo 195(6):521–528. 10.1055/a-2031-236437019142 10.1055/a-2031-2364
31. Choy G Kröpil P Scherer A El-Sherief AH Chung J Rojas CA Abbara S Pertinent reportable incidental cardiac findings on chest CT without electrocardiography gating: review of 268 consecutive cases Acta Radiol 2013 54 4 396 400 10.1177/0284185113475918 23436832
Choy G, Kröpil P, Scherer A, El-Sherief AH, Chung J, Rojas CA, Abbara S (2013) Pertinent reportable incidental cardiac findings on chest CT without electrocardiography gating: review of 268 consecutive cases. Acta Radiol 54(4):396–400. 10.1177/028418511347591823436832 10.1177/0284185113475918
32. Krueger M Cronin P Sayyouh M Kelly AM Significant incidental cardiac disease on thoracic CT: what the general radiologist needs to know Insights Imaging 2019 10 1 10 10.1186/s13244-019-0693-y 30725202
Krueger M, Cronin P, Sayyouh M, Kelly AM (2019) Significant incidental cardiac disease on thoracic CT: what the general radiologist needs to know. Insights Imaging 10(1):10. 10.1186/s13244-019-0693-y30725202 10.1186/s13244-019-0693-y
33. Verdini D Lee AM Prabhakar AM Abbara S Ghoshhajra B Writing Group Detection of cardiac incidental findings on routine chest CT: the impact of dedicated training in cardiac imaging J Am Coll Radiol 2018 15 8 1153 1157 10.1016/j.jacr.2016.02.011 27039002
Verdini D, Lee AM, Prabhakar AM, Abbara S, Ghoshhajra B, Writing Group (2018) Detection of cardiac incidental findings on routine chest CT: the impact of dedicated training in cardiac imaging. J Am Coll Radiol 15(8):1153–1157. 10.1016/j.jacr.2016.02.01127039002 10.1016/j.jacr.2016.02.011
34. Secchi F Di Leo G Zanardo M Alì M Cannaò PM Sardanelli F Detection of incidental cardiac findings in noncardiac chest computed tomography Medicine (Baltimore) 2017 96 29 e7531 10.1097/MD.0000000000007531 28723768
Secchi F, Di Leo G, Zanardo M, Alì M, Cannaò PM, Sardanelli F (2017) Detection of incidental cardiac findings in noncardiac chest computed tomography. Medicine (Baltimore) 96(29):e7531. 10.1097/MD.000000000000753128723768 10.1097/MD.0000000000007531
35. Melzig C Do TD Egenlauf B Partovi S Grünig E Kauczor HU Heussel CP Rengier F Diagnostic accuracy of automated 3D volumetry of cardiac chambers by CT pulmonary angiography for identification of pulmonary hypertension due to left heart disease Eur Radiol 2022 32 8 5222 5232 10.1007/s00330-022-08663-0 35267088
Melzig C, Do TD, Egenlauf B, Partovi S, Grünig E, Kauczor HU, Heussel CP, Rengier F (2022) Diagnostic accuracy of automated 3D volumetry of cardiac chambers by CT pulmonary angiography for identification of pulmonary hypertension due to left heart disease. Eur Radiol 32(8):5222–5232. 10.1007/s00330-022-08663-035267088 10.1007/s00330-022-08663-0
36. Mehra P Mehta V Sukhija R Sinha AK Gupta M Girish MP Aronow WS Pulmonary hypertension in left heart disease Arch Med Sci 2019 15 1 262 273 10.5114/aoms.2017.68938 30697278
Mehra P, Mehta V, Sukhija R, Sinha AK, Gupta M, Girish MP, Aronow WS (2019) Pulmonary hypertension in left heart disease. Arch Med Sci 15(1):262–273. 10.5114/aoms.2017.6893830697278 10.5114/aoms.2017.68938
37. Hahn LD Papamatheakis DG Fernandes TM Poch DS Yang J Shen J Hoh CK Hsiao A Kerr KM Pretorius V Madani MM Kim NH Kligerman SJ Multidisciplinary approach to chronic thromboembolic pulmonary hypertension: role of radiologists Radiographics 2023 43 2 e220078 10.1148/rg.220078 36525366
Hahn LD, Papamatheakis DG, Fernandes TM, Poch DS, Yang J, Shen J, Hoh CK, Hsiao A, Kerr KM, Pretorius V, Madani MM, Kim NH, Kligerman SJ (2023) Multidisciplinary approach to chronic thromboembolic pulmonary hypertension: role of radiologists. Radiographics 43(2):e220078. 10.1148/rg.22007836525366 10.1148/rg.220078
38. Yang J Madani MM Mahmud E Kim NH Evaluation and management of chronic thromboembolic pulmonary hypertension Chest 2023 164 2 490 502 10.1016/j.chest.2023.03.029 36990148
Yang J, Madani MM, Mahmud E, Kim NH (2023) Evaluation and management of chronic thromboembolic pulmonary hypertension. Chest 164(2):490–502. 10.1016/j.chest.2023.03.02936990148 10.1016/j.chest.2023.03.029
39. Olschewski H The challenge to decide between pulmonary hypertension due to chronic lung disease and PAH with chronic lung disease Diagnostics (Basel) 2021 11 2 311 10.3390/diagnostics11020311 33671914
Olschewski H (2021) The challenge to decide between pulmonary hypertension due to chronic lung disease and PAH with chronic lung disease. Diagnostics (Basel) 11(2):311. 10.3390/diagnostics1102031133671914 10.3390/diagnostics11020311
40. Mandras SA Mehta HS Vaidya Pulmonary hypertension: a brief guide for clinicians Mayo Clin Proc 2020 95 9 1978 1988 10.1016/j.mayocp.2020.04.039 32861339
Mandras SA, Mehta HS, Vaidya (2020) Pulmonary hypertension: a brief guide for clinicians. Mayo Clin Proc 95(9):1978–1988. 10.1016/j.mayocp.2020.04.03932861339 10.1016/j.mayocp.2020.04.039
41. Valentini A Franchi P Cicchetti G Messana G Chiffi G Strappa C Calandriello L Del Ciello A Farchione A Preda L Larici AR Pulmonary hypertension in chronic lung diseases: what role do radiologists play? Diagnostics (Basel) 2023 13 9 1607 10.3390/diagnostics13091607 37174998
Valentini A, Franchi P, Cicchetti G, Messana G, Chiffi G, Strappa C, Calandriello L, Del Ciello A, Farchione A, Preda L, Larici AR (2023) Pulmonary hypertension in chronic lung diseases: what role do radiologists play? Diagnostics (Basel) 13(9):1607. 10.3390/diagnostics1309160737174998 10.3390/diagnostics13091607
42. Dwivedi K Condliffe R Sharkey M Lewis R Alabed S Rajaram S Hill C Saunders L Metherall P Alandejani F Alkhanfar D Wild JM Lu H Kiely DG Swift AJ Computed tomography lung parenchymal descriptions in routine radiological reporting have diagnostic and prognostic utility in patients with idiopathic pulmonary arterial hypertension and pulmonary hypertension associated with lung disease ERJ Open Res 2022 8 1 00549 2021 10.1183/23120541.00549-2021 35083317
Dwivedi K, Condliffe R, Sharkey M, Lewis R, Alabed S, Rajaram S, Hill C, Saunders L, Metherall P, Alandejani F, Alkhanfar D, Wild JM, Lu H, Kiely DG, Swift AJ (2022) Computed tomography lung parenchymal descriptions in routine radiological reporting have diagnostic and prognostic utility in patients with idiopathic pulmonary arterial hypertension and pulmonary hypertension associated with lung disease. ERJ Open Res 8(1):00549–02021. 10.1183/23120541.00549-202135083317 10.1183/23120541.00549-2021
43. Stanzione A Ponsiglione A Cuocolo R Rumolo M Santarsiere M Scotto R Viceconte G Imbriaco M Maurea S Camera L Gentile I Brunetti A Chest CT in COVID-19 patients: structured vs conventional reporting Eur J Radiol 2021 138 109621 10.1016/j.ejrad.2021.109621 33677417
Stanzione A, Ponsiglione A, Cuocolo R, Rumolo M, Santarsiere M, Scotto R, Viceconte G, Imbriaco M, Maurea S, Camera L, Gentile I, Brunetti A (2021) Chest CT in COVID-19 patients: structured vs conventional reporting. Eur J Radiol 138:109621. 10.1016/j.ejrad.2021.10962133677417 10.1016/j.ejrad.2021.109621
44. Cereser L Marchesini F Di Poi E Quartuccio L Zabotti A Zuiani C Girometti R Structured report improves radiology residents’ performance in reporting chest high-resolution computed tomography: a study in patients with connective tissue disease Diagn Interv Radiol 2022 28 6 569 575 10.5152/dir.2022.21488 36550757
Cereser L, Marchesini F, Di Poi E, Quartuccio L, Zabotti A, Zuiani C, Girometti R (2022) Structured report improves radiology residents’ performance in reporting chest high-resolution computed tomography: a study in patients with connective tissue disease. Diagn Interv Radiol 28(6):569–575. 10.5152/dir.2022.2148836550757 10.5152/dir.2022.21488
45. Cowan IA MacDonald SL Floyd RA Measuring and managing radiologist workload: measuring radiologist reporting times using data from a radiology information system: measuring radiologist reporting times J Med Imaging Radiat Oncol 2013 57 5 558 566 10.1111/1754-9485.12092 24119269
Cowan IA, MacDonald SL, Floyd RA (2013) Measuring and managing radiologist workload: measuring radiologist reporting times using data from a radiology information system: measuring radiologist reporting times. J Med Imaging Radiat Oncol 57(5):558–566. 10.1111/1754-9485.1209224119269 10.1111/1754-9485.12092
46. Anderson LW Krathwohl D A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives 2001 Complete New York Longman
Anderson LW, Krathwohl D (2001) A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives, Complete. Longman, New York
47. Lourenco AP Slanetz PJ Baird GL Rise of ChatGPT: it may be time to reassess how we teach and test radiology residents Radiology 2023 307 5 e231053 10.1148/radiol.231053 37191490
Lourenco AP, Slanetz PJ, Baird GL (2023) Rise of ChatGPT: it may be time to reassess how we teach and test radiology residents. Radiology 307(5):e231053. 10.1148/radiol.23105337191490 10.1148/radiol.231053
48. Bentley H Diep Quoc Vo C Zaki-Metias K Nikpanah M Competency-based medical education in radiology graduate medical education: overview and future perspectives Radiographics 2023 43 5 e220197 10.1148/rg.220197 37053101
Bentley H, Diep Quoc Vo C, Zaki-Metias K, Nikpanah M (2023) Competency-based medical education in radiology graduate medical education: overview and future perspectives. Radiographics 43(5):e220197. 10.1148/rg.22019737053101 10.1148/rg.220197
49. Coppola F Faggioni L Gabelloni M De Vietro F Mendola V Cattabriga A Cocozza MA Vara G Piccinino A Lo Monaco S Pastore LV Mottola M Malavasi S Bevilacqua A Neri E Golfieri R Human, all too human? An all-around appraisal of the “artificial intelligence revolution” in medical imaging Front Psychol 2021 12 710982 10.3389/fpsyg.2021.710982 34650476
Coppola F, Faggioni L, Gabelloni M, De Vietro F, Mendola V, Cattabriga A, Cocozza MA, Vara G, Piccinino A, Lo Monaco S, Pastore LV, Mottola M, Malavasi S, Bevilacqua A, Neri E, Golfieri R (2021) Human, all too human? An all-around appraisal of the “artificial intelligence revolution” in medical imaging. Front Psychol 12:710982. 10.3389/fpsyg.2021.71098234650476 10.3389/fpsyg.2021.710982
50. Patel BN Rosenberg L Willcox G Baltaxe D Lyons M Irvin J Rajpurkar P Amrhein T Gupta R Halabi S Langlotz C Lo E Mammarappallil J Mariano AJ Riley G Seekins J Shen L Zucker E Lungren M Human-machine partnership with artificial intelligence for chest radiograph diagnosis NPJ Digit Med 2019 2 111 10.1038/s41746-019-0189-7 31754637
Patel BN, Rosenberg L, Willcox G, Baltaxe D, Lyons M, Irvin J, Rajpurkar P, Amrhein T, Gupta R, Halabi S, Langlotz C, Lo E, Mammarappallil J, Mariano AJ, Riley G, Seekins J, Shen L, Zucker E, Lungren M (2019) Human-machine partnership with artificial intelligence for chest radiograph diagnosis. NPJ Digit Med 2:111. 10.1038/s41746-019-0189-731754637 10.1038/s41746-019-0189-7
