
==== Front
Langenbecks Arch Surg
Langenbecks Arch Surg
Langenbeck's Archives of Surgery
1435-2443
1435-2451
Springer Berlin Heidelberg Berlin/Heidelberg

39251463
3463
10.1007/s00423-024-03463-0
Research
Perspective or Spectacle? Teaching thoracic aortic anatomy in a mixed reality assisted educational approach– a two-armed randomized pilot study
Zimmer Lea 1
Hatzl Johannes 1
Uhl Christian 12
Kilian Samuel 3
Bischoff Moritz S. 1
Böckler Dittmar 1
Meisenbacher Katrin katrin.meisenbacher@med.uni-heidelberg.de

1
1 https://ror.org/038t36y30 grid.7700.0 0000 0001 2190 4373 Department of Vascular and Endovascular Surgery, University of Heidelberg, Heidelberg, Germany
2 https://ror.org/04xfq0f34 grid.1957.a 0000 0001 0728 696X Department of Vascular Surgery, University Hospital RWTH Aachen, 52074 Aachen, Germany
3 https://ror.org/038t36y30 grid.7700.0 0000 0001 2190 4373 Institute of Medical Biometry, University of Heidelberg, Heidelberg, Germany
9 9 2024
9 9 2024
2024
409 1 27413 7 2024
28 8 2024
© The Author(s) 2024
2024
https://creativecommons.org/licenses/by/4.0/ Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Purpose

Anatomical understanding is an important basis for medical teaching, especially in a surgical context. The interpretation of complex vascular structures via two-dimensional visualization can yet be difficult, particularly for students. The objective of this study was to investigate the feasibility of an MxR-assisted educational approach in vascular surgery undergraduate education, comparing an MxR-based teaching-intervention with CT-based material for learning and understanding the vascular morphology of the thoracic aorta.

Methods

In a prospective randomized controlled trial learning success and diagnostic skills following an MxR- vs. a CT-based intervention was investigated in 120 thoracic aortic visualizations. Secondary outcomes were motivation, system-usability as well as workload/satisfaction. Motivational factors and training-experience were also assessed. Twelve students (7 females; mean age: 23 years) were randomized into two groups undergoing educational intervention with MxR or CT.

Results

Evaluation of learning success showed a mean improvement of 1.17 points (max.score: 10; 95%CI: 0.36–1.97). The MxR-group has improved by a mean of 1.33 [95% CI: 0.16–2.51], against 1.0 points [95% CI: -0.71- 2.71] in the CT-group. Regarding diagnostic skills, both groups performed equally (CT-group: 58.25 ± 7.86 vs. MxR-group:58.5 ± 6.60; max. score 92.0). 11/12 participants were convinced that MxR facilitated learning of vascular morphologies. The usability of the MxR-system was rated positively, and the perceived workload was low.

Conclusion

MxR-systems can be a valuable addition to vascular surgery education. Further evaluation of the technology in larger teaching situations are required. Especially regarding the acquisition of practical skills, the use of MxR-systems offers interesting application possibilities in surgical education.

Keywords

Mixed reality
Thoracic aorta
Vascular surgery
Virtual reality
Surgical education
Medizinische Fakultät Heidelberg der Universität Heidelberg (9149)Open Access funding enabled and organized by Projekt DEAL.

issue-copyright-statement© Springer-Verlag GmbH Germany, part of Springer Nature 2024
==== Body
pmcIntroduction

Year after year, the trajectory of medical-technical advancements is characterized by a continuous refinement and revolutionary transformation, manifesting in heightened efficiency and specialization. However, to maintain a truly forward-looking perspective, it would be myopic to confine innovation solely within the domain of clinical research. Ensuring the cultivation of adept clinical practice among future physicians necessitates the concurrent integration of technological progress into medical curricula. This imperative extends equivalently to the augmentation of conventional pedagogical approaches. Commencing with fundamental principles, the establishment of a comprehensive understanding of human anatomy constitutes a cornerstone pivotal to both medical education and advanced surgical training. Implementing anatomical models, and later three-dimensional (3D)-printing-methods in anatomy education, offered options to understand and teach topography in a realistic 3D-environment, rather than relying solely on two-dimensional (2D) anatomy atlases [1]. Clearly, studying anatomy from cadaver dissection is an excellent way to develop a first understanding for gross anatomy [2]. Due to high costs, limited availability, elaborate infrastructure, and time effort for the cadaver dissection, and – not least – ethical concerns – supplementary methods for future anatomical curricula are needed. Understanding and interpreting complex vascular structures represents a major challenge for both students and inexperienced physicians. While 2-D-imaging-techniques such as computed tomography (CT) are already widely established during anatomical education [3–6], apparently – and equally to traditional anatomic atlas imaging – stereoscopic perception is not provided. Therefore, 3-D-visualization tools have been proposed to be more suitable for this purpose [7–9].

In recent years, applications of “extended reality” (XR) have found their way into the medical field and partially into medical education as well. [10]. XR is used as an umbrella term to address all immersive technologies including augmented reality (AR), virtual reality (VR), mixed reality (MxR) and those yet to be discovered. In AR, virtual information and objects are overlaid on the real world, whereas in VR the user fully immerses into a simulated environment. In MxR, we find the merging of a real-world environment and a computer-generated one. In this reality, real-world- and virtual objects co-exist and interact with each other [11]. The perception of a user’s physical environment is thus enhanced with an artificial computer-generated perception, enabling a realistic interaction via a 3-D virtual object. For the practical implementation of MxR, the user is wearning a head-mounted display (HMD). Software processing projects any digital information (e.g. the data from a CT-scan) into the user’s field of vision, appearing as an object showing a 3-D-reconstruction of the given digital information. In other fields, such as the gaming or the marketing industry, these technologies are already successfully implemented. In medicine, however, they have mostly been the subject of research and have not yet been introduced to clinical practice [12]. So far, only a few randomized studies have evaluated the use of MxR technology in medical student education [13]. This pilot study’s objective is the feasibility of an MxR-assisted educational approach in vascular surgery undergraduate education, aiming at learning and understanding anatomical features and vascular morphologies of the thoracic aorta and its branches in comparison to CT-based training material. In a randomized setting, the learning success of students with different teaching material will be investigated. In addition, the study will address several complementary questions such as the usability of the MxR-system, the student’s perceived workload and motivational factors.

Methods

Study design and participants

The underlying study represents a prospective, randomized controlled trial. The scheduled course was divided into three sections: preparation, training and intervention. The study was conducted at the Department of Vascular and Endovascular Surgery of the University Hospital Heidelberg, Germany. Twelve medical students (7 females, mean age 23 years) of the Ruprecht-Karls-University Heidelberg have been recruited on a voluntary basis. Students had to have completed their pre-clinical education to participate, therefore all of them have been previously exposed to the general anatomy curriculum. The pilot study was conducted within the elective surgical track “modern surgery – innovation, research and technology”, comprising a vascular surgical module called “knives, wires and imaging – applied vascular surgery”. Ethical approval was obtained from the Institutional Ethical Review Board of the University of Heidelberg (S-488/2023). Written informed consent was provided from all participants.

Preparation and training

Before randomization, all participants followed the same preparation and training. During those, students were instructed to watch a 5-minute audio-visual presentation (AVP), discussing the anatomical basics of the vascular system, focusing on the thoracic aorta. The content of this video was compiled by a board-certified vascular surgeon. Additionally, the students had to watch an instructional 5-minutes video on how to handle the proposed MxR-system. For the following individual training, a set of 5 different anonymized CT-scans as well as 5 different MxR-objects were presented to the students. For this purpose, different morphologies of the thoracic aorta and its branches were selected, including as well healthy aortic conditions as anatomic variants and pathologies. The students were asked to analyze and explain what they see on each scan/object. A time limit of 5 min was set for each case, and an observer gave the students brief feedback after each case. This training session lasted about 90 min (Fig. 1, #1).

Fig. 1 Study design and general course description. Upper image section: preparation and training; Bottom image section: randomization and intervention. AVP: audio-visual presentation; CT: computer tomography; n = Numbers

Randomization and intervention

After the first two parts, students were randomized into two balanced study groups using a lottery method (Fig. 1, #2). While participants randomized to the control group (n = 6) were confronted with 10 different CT-scans showing various morphologies of the thoracic aorta and its branches, participants in the intervention group (n = 6) were confronted with the same morphologies in terms of a 3-D-object using the MxR-system. Again, a time limit of 5 min was set for each case, during which the students were asked to review the visualized image and to provide their answers on a questionnaire. The intervention took place around 10 days after the training and pre-test part and again lasted about 90 min. To improve standardization, both training and intervention were monitored by the same observer throughout the whole study.

Endpoints and Assessment

The primary outcome was the learning success and the diagnostic skills following intervention, thereby comparing the CT- vs. MxR-based intervention. Secondary outcomes were motivation, usability of the system as well as perceived workload and satisfaction.

Quantitative assessment

During preparation, demographics and baseline knowledge were collected. Theoretical and image-based multiple choice (MC) questions focusing on the topography of the thoracic aortic system were used to assess learning success (T1: evaluation of student’s prior knowledge of topographic anatomy of the thoracic aorta; T2: after the intervention; 10 questions per test, maximum score: 10 points). Diagnostic skills were additionally tested in ten thoracic aortic visualizations per participants. Using a specifically designed illustration (Fig. 2) anatomic conditions (physiological condition, one/more pathological conditions, one/more anomalies, previously operated aorta; maximum score: 60 points), localization according to the correct aortic/aortic branch segment (maximum score: 16 points) and morphology (i.e. describing the morphological conditions and name it correctly; maximum score: 16 points) had to be evaluated, respectively. The answers were subsequently scored by the observers following a given scoring system, a maximum of 92 points could be reached. In addition, all participants were asked to perform a mental rotation test to quantify their spatial ability (max. score: 24 points) [14, 15]. The Lang Stereotest II (Lang Stereotest, Forch, Switzerland) was carried out to detect whether stereoscopic vision was intact or not, since impairments in stereovision highly influence the ability to perceive virtual objects as three-dimensional in a MxR-environment [16].

Fig. 2 Illustration scoring anatomy, localization and morphology during intervention. During intervention, the participants had to assess whether the respective presented aortic anatomy was physiological, pathological, abnormal, or showed a post-operative condition. The task was to describe this morphology as well as possible and to name the relevant section using the demonstrated schematic illustration. (max. score: 92 points, time limit per aorta: 5 min)

Qualitative assessment

Perceived workload and satisfaction were assessed via the NASA Task load Index (NASA-TLX). This validated assessment tool scores six domains (mental demand, physical demand, performance, effort, and frustration) ranging from 0 (very low) to 100 (very high) in steps of five [17, 18]. For evaluation of the usability of the applied teaching instrument, the Standard System Usability Scale (SUS) was used. A score of 100 indicates high usability [19]. To further evaluate motivational aspects, students were given a self-designed questionnaire. A 4-point Likert scale was used to avoid a neutral position. All data was collected in pseudonymous form. Assessment performed during this study did not influence the students’ final grade.

Learning environment, hard- and software

The course was conducted in a consultation room in the surgical clinic, suiting for 2 students, equipped with a computer and a two-dimensional monitor with access to standard digital imaging and communications in Medicine (DICOM) images as well as the picture archiving and communication system (PACS) of our institution. All images were shown after anonymization. For the visualization of objects in the MxR-environment, an MxR-workstation, consisting of a personal computer (PC) running the Elements Viewer software (Brainlab AG, Munich, Germany) as well as a HMD (Magic Leap1, Magic Leap, Florida, USA). The MxR-workflow has been previously described [20]. During training and intervention in the MxR-group, the participant as well as the observer wore an HMD. In order to interact with the virtual object, the participant was additionally equipped with a controller. For testing and evaluation, every participant was equipped with a digital device (IPad Pro 11, Apple Inc., California, USA).

Statistical analysis

The collected data were analyzed using MS Excel Version 16.77.1 (Microsoft Corporation Washington, USA) and GraphPad Prism (Version 10, Graphpad Software, Inc.) Descriptive data evaluation was performed. Data are presented as absolute/relative frequencies or mean and standard deviation (SD). For group comparisons and comparisons of time points the Mann Whitney U test and the Wilcoxon-signed rank test were used. Multiple regression analysis was applied for estimation of any relation between baseline characteristics and learning success. All p-values are of descriptive nature.

Results

Baseline characteristics

A total of 12 students participated in this study. All of them completed all three parts of the study, so no dropout is to report. The participants´ demographics are shown in Table 1. None of the surveyed characteristics revealed an unbalanced distribution among the two study groups. All of them had either started or already finished the surgical part of their training, so at least some vascular-/surgical knowledge was present. Only one student mentioned related knowledge of the above and since him/her being in the control group no further importance was attached to the topic.

Table 1 Participants´ demographics

Characteristics n (%)	Overall (n = 12)	MxR (n = 6)	CTA (n = 6)	p-value	
Gender					
Female	7 (58.33%)	4	3		
Male	5 (41.67%)	2	3		
Age (mean)(1)	23 years	22	23		
Educational level					
4th year	7 (58.33%)	4	3		
5th year	5 (41.67%)	2	3		
Surgical undergrad education					
Started	6 (50%)	3	3		
Completed	6 (50%)	3	3		
Previous experience with MR/VR (1)	1 (9.09%)	0	1		
Video game experience(1)					
No	5 (45.45%)	3	2		
Some	3 (27.3%)	2	1		
Yes	3 (27.3%)	0	3		
Knowledge of programming language(1)	2 (18.2%)	1	1		
Active on social media(1)					
No	3 (27.3%)	1	2		
Sometimes	6 (54.55%)	3	3		
Often	2 (18.2%)	1	1		
Different job/studies before medical school(1)	1 (9.09%)	0	1		
Experience in vascular surgery(1)	1 (internship)	0	1		
Mental rotation test (mean ± SD)	17.92 ± 5.03	19 ± 4.19	16.83 ± 5.95	0.385	
Intact stereovision (Lang II stereotest)	12 (100%)	6	6		
Data are given as absolute/relative numbers and mean ± standard deviation (SD), (1)n = 11 due to uncompleted questionnaire

Learning success

Overall, the students scored a mean of 6.67 ± 1.23 points in the pre-test (T1) versus 7.83 ± 0.94 in the post-test (T2), showing a mean improvement of 1.17 points (95% CI: 0.36–1.97; p = 0.0156). The MxR-group showed a mean improvement of 1.33 [95% CI: 0.16–2.51] points, against 1.0 [95% CI: -0.71- 2.71] in the CT-group (Table 2; Fig. 3). Subanalysis of group-differences with respect to demographic characteristics such as educational level, surgical training, or gaming experience revealed no significant differences in improvement between T1 to T2. Considering the role of gender on learning success, female participants showed an overall mean improvement of 1.43 points [95% CI: 0.25–2.61] against 0.8 points [95% CI: -0.82 -2.42] in the male cohort. This difference was greater in the CT-group (mean 2.0 points of improvement in female vs. 0.0 points in male) and reverse in the MxR-group (1.0 points of improvement in female vs. 2.0 in male) (Table 2). Multiple linear regression for the outcome variable “learning success” (T1-T2) indicated “gender” and “educational level” as possible predictors (Table 3).

Table 2 Learning success

Group	T1	T2	MD [95% CI]	p-value	
Overall ( n  = 12)	6.67 ± 1.23	7.83 ± 0.94	1.17 [0.36–1.97]	0.0156	
Male (n = 5)	6.8 ± 1.30	7.6 ± 1.14	0.8 [-0.82 -2.42]	0.375	
Female (n = 7)	6.57 ± 1.27	8.0 ± 0.82	1.43 [0.25–2.61]	0.0625	
CT group ( n  = 6)	6.83 ± 1.47	7.83 ± 1.17	1.0 [-0.71- 2.71]	0.250	
Male (n = 3)	7.66 ± 0.58	7.66 ± 1.53	0 [-2.48–2.48]	> 0.99	
Female (n = 3)	6 ± 1.73	8 ± 1	2.0 [-0.48-4.48]	0.250	
MxR group ( n  = 6)	6.5 ± 1.05	7.83 ± 0.75	1.33 [0.16–2.51]	0.0938	
Male (n = 2)	5.5 ± 0.71	7.5 ± 0.71	2 [-1.04- 5.04]	n.a.	
Female (n = 4)	7.0 ± 0.82	8 ± 0.82	1 [-1.25–3.25]	0.375	
T 1/T2: Given as mean ± standard deviation; CI: confidence interval; MD: mean of differences (T2-T1); n.a.: not applicable

Fig. 3 Estimation Plots of learning success. (A) depicts the improvement between T1 and T2 in the CT-group, (B) in the MxR-group. (C) shows the mean improvement in both groups (T2-T1)

Table 3 Multiple linear regression for the outcome variable learning success T1-T2

Variable	estimate	95% CI	P value	
Intercept	-0.8361	-3.745–2.073	0.4932	
Gender [female]	1.549	-1.284–4.383	0.2189	
group [CT]	0.2596	-1.852–2.372	0.7648	
gaming experience [no]	0.6120	-1.994–3.218	0.5724	
social media [yes]	-0.1831	-2.996–2.630	0.8737	
educational level/year	1.440	-1.116–3.996	0.2072	
CT: computer tomography; CI: confidence interval

Imaging evaluation

In assessment of thoracic aortic conditions regarding anatomy, localization of potential anomalies/pathologies and description of morphology, both groups performed equally with a total score of 58.25 ± 7.86 in the CT-group vs. 58.50 ± 6.60 in the MxR-group (max. score: 92.0), with a mean difference of 0.25 [95% CI: -4.345–4.845] between the groups. In the subscales, the MxR-group showed a tendency to better performance regarding anatomical tasks (CT-group: 47.83 ± 3.82 vs. MxR-group: 48.67 ± 3.20; mean difference: 0.83 [95% CI: -0.97–2.641], p = 0.675). (Table 4). In contrast, men seemed to perform slightly better than women (59.70 ± 9.060 vs. 57.43 ± 5.533; mean difference: 2.27 [95% CI: -7.064-11.61]; p = 0.755).

Table 4 Imaging evaluation

	Overall (n = 12)	CT group (n = 6)	MxR group (n = 6)	p-value	MD [95% CI]	
Anatomy (max. 60 P)	48.25 ± 3.38	47.83 ± 3.82	48.67 ± 3.20	0.675	0.83 [-0.97–2.641]	
Localization (max. 16 P)	2.86 ± 3.14	3.17 ± 3.23	2.58 ± 3.29	0.368	-0.58 [-6.258 -5.092]	
Morphology (max. 16 P)	7.25 ± 2.19	7.25 ± 2.04	7.25 ± 2.53	0.987	0.0 [-1.787- 1.787]	
Total (max. 92 P)	58.38 ± 6.92	58.25 ± 7.86	58.50 ± 6.60	> 0.99	0.25 [-4.345–4.845]	
All values are given as mean ± standard deviation; CI: confidence interval; MD: mean of differences (T2-T1); P: points

Evaluation of the MxR technology

Usability of the MxR-system was scored at a mean of 85.0 ± 6.93 points (maximum score: 100 = high usability) (Table 5). With respect to workload, in the NASA-TLX, the MxR-system was associated with a higher level of mental demand compared to the physical demand. The effort to accomplish the requested performance was rated low, as was the level of frustration (Table 6).

Table 5 Evaluation of the MxR-system using the standardized system usability scale (SUS)

	Strongly disagree	Disagree	Neutral	Agree	Strongly agree	
I think that I would like to use this system frequently	-	-	16.7%	33.3%	50.0%	
I found this system unnecessarily complex	66.7%	33.3%	-	-	-	
I thought the system was easy to use	-	-	8.3%	41.7%	50.0%	
I think that I would need the support of a technical person to be able to use this system	25.0%	50.0%	16.7%	8.3%	-	
I found the various functions in this system were well integrated	-	16.7%	8.3%	58.3%	16.7%	
I thought there was too much inconsistency in this system	50.0%	25.0%	25.0%	-	-	
I would imagine that most people would learn to use this system very quickly	-	-	8.3%	33.3%	58.3%	
I found the system very cumbersome to use	75.0%	25.0%	-	-	-	
I felt very confident using the system	-	-	-	58.3%	41.7%	
I need to learn a lot of things before I could get going with this system	33.3%	58.3%	8.3%	-	-	
Usability of the MxR-system was scored at a mean of 85.0 ± 6.93 points. A score of 100 indicates high usability. Values are given in percentage or absolute values

Table 6 NASA TLX

	Overall	CT group	MxR group	p-value	
Mental demand	56.67 ± 17.75	51.67 ± 23.17	61.67 ± 9.83	0.560	
Physical demand	32.50 ± 17.65	26.67 ± 13.66	38.33 ± 20.41	0.292	
Temporal demand	37.50 ± 12.88	38.33 ± 11.69	36.67 ± 15.06	> 0.999	
Performance	68.33 ± 18.01	71.67 ± 16.02	65.0 ± 20.74	0.556	
Effort	38.33 ± 11.15	41.67 ± 11.69	35.0 ± 10.49	0.461	
Frustration	24.17 ± 18.32	23.33 ± 23.38	25.0 ± 13.78	0.471	
Given as mean ± standard deviation; NASA-TLX: NASA task load index (0 = very low, 100 = very high)

Motivational aspects regarding the MxR-system were rated high (mean 3.58 ± 0.67) as was facilitation of learning (mean 3.92 ± 0.28, 4-point Likert scale, 4 = strongly agree) (Fig. 4). Participants agreed on the exceedingly positive effects of MR systems onto motivational aspects.

Fig. 4 Subjective feedback on the MxR-System with respect to motivational aspects. Questions were: 1. How do you rate your skills in the field of MxR?; 2: I have learned a lot through the use of MxR; 3: I can imagine that MxR makes it easier to learn vascular anatomy.; 4: I enjoy learning new things with MxR more than with traditional teaching methods.; 5: I am more motivated to learn new medical knowledge with MxR than with traditional teaching methods. Rating was performed using a 4-Point Likert scale; 1: strongly disagree; 4: strongly agree

Discussion

This study shows that an MxR-system is suitable in teaching anatomical knowledge and vascular morphology of the thoracic aorta. Summarizing the main findings, learning success was recorded in both, the MxR- and the control (CT) group, indicating the general effectiveness of this teaching approach. Although there was no significant difference in learning success between both groups, participants randomized to the MxR-group improved slightly more, suggesting a potential advantage of using MxR as a visualization tool to acquire anatomical knowledge. Both imaging methods are appropriate for assessing complex vascular anatomy. This demonstrates no inferiority of the proposed MxR-system. Regarding anatomical description, the MxR-group showed a tendency to perform better than the control group. Additionally, the use of MxR increased motivation without increasing the subjective load of the students.

Within the expanding field of XR-technology in medicine, the application of innovative teaching methods in medical education has gained increasing popularity. Especially in the context of surgical training and high-fidelity simulations, the role of XR seems to be rapidly growing [13, 21]. In vascular and endovascular surgery, however, XR is rarely used with regards to training and mainly concentrates on conceptual ideas [12]. So far, undergraduate training has not been addressed. To our knowledge, this is the first randomized prospective controlled study evaluating an MxR-system in the context of an educational setting in vascular surgery undergraduate education. Imaging and image-evaluation have always played a major role in vascular surgery. It seems only logical, that this image-relatedness should also be reflected in medical education. However, vascular surgery medical school curricula rarely go beyond traditional lectures and seminars [22, 23]. While several studies already addressed the application of AR/MxR-technologies in different educational contexts [12, 21], their value in vascular surgery curricula has yet to be determined. In contrast, literature on the potential of AR/MxR-technology in improving clinician’s understanding of anatomy and subsequently image-guided surgery is rapidly growing, mostly promoting this new technology as a future “game changer” [12, 24, 25]. As medicine – and especially surgery – has to find its way into a digital era [26], future health care professionals should be incorporated in this evolution at an early educational stage.

It has already been shown, that the integration of 3D-visualization technologies in anatomy classes improves learning [7, 8, 27]. This is true for both, diagnostic skills as well as visual spatial ability [8, 28]. A few studies also evaluated the application of AR/VR in anatomy teaching [27, 29]. Similar to their results, the participants of our study showed a slightly better performance in the MxR-intervention group compared to the control group. Looking at the absolute numbers, the CT-group starts at a higher level of knowledge. Regarding the diagnostic abilities in imaging analysis, though, group differences are negligible; with the exception of the anatomical subscale, in which the MxR-group showed a tendency to a better performance. Noteworthy, the mean score in imaging evaluations scored only around 63% of the maximum possible score, thereby indicating the complexity of thoracic aortic anatomy. Multiple regression analysis revealed gender and educational level of being associated with a greater learning success. Considering the role of gender, women showed an overall improvement of 1.43 points against 0.8 points in the male cohort. This could not be seen in the context of detailed image evaluation. It has been proposed that male participants are more likely to be used to XR-technologies due to a potential gaming history [30, 31]. Our findings are not strong enough to support this suspicion, given the heterogenous improvement range within the groups. Previous gaming experiences, equally been found to influence performance outcomes with respect to virtual spatial tasks [32], did not influence learning success in our study. As all participants in our study were in their 4th or 5th year of medical school, approximately 42% of them have already passed the vascular surgery curriculum, which could have influenced the test results as well. One could hypothesize, that the differences in learning success could be more evident in novices. However, studies evaluating the use of MxR- vs. CT-guided patient education showed similar levels of informational gain between the two methods [20]. Integrating a third teaching arm including actual “traditional” 2D-learning methods such as anatomical drawings, could have influenced the results. Yet, the curriculum at our medical school integrates cross-sectional imaging, e.g. contrast-enhanced cadaver specific post mortem tomography already in first-year gross anatomy teaching [5, 6]. Therefore, including an “anatomical atlas” group would have been highly artificial in our context. Regarding motivational factors, students seemed highly interested in studying with innovative technologies like MxR-systems in contrast to traditional methods. Additionally, the perceived workload was rated to be at a low level, besides the mental demand subscale, which could be attributed to a higher level of additional steps using the controller and the HMD. The mean SUS-score of 85.0 points indicates an excellent system usability [33]. This contrasts with other studies in the XR-field, in which the proposed MxR-system was rated around 57 points, displaying only marginal acceptable system usability [34]. Different systems and HMDs can differ in their usability, though.

Clearly, motivation and joy aren’t “hard facts” in traditional research. Additionally, new kids on the block have an easy time getting people excited. Thus, a technology-driven approach should not be endorsed unreservedly. Nevertheless, motivational aspects should not be neglected, especially in the context of learning, maybe even more in the context of learning in the surgical field. Facing declining interest in surgical careers in the next generation, early motivation to get in touch with the field could be a relevant pull-factor. MxR-systems have the ability to address both, motivation as well as learning outcomes. Yet, the application should be used sensibly and focus on learner-centered approaches in future research, As such, they could have the potential to increase student engagement [35, 36].

Limitations

This study comes with several drawbacks. First, the small number of participants increases the uncertainty of the effect estimate. The implementation of the proposed teaching unit is time-consuming with approximately 3.5–4 h per participant, without considering the time for image-preparation. Given the limited number of available hardware and the currently high costs of the technical equipment, this restricts the broad application and integration into a medical school curriculum. Second, the students participating in this study were already in their 4th or 5th year of medical school, resulting in previous experience with traditional imaging techniques as mentioned above. In our institution students learn how to read a CT-scan in their very first semester, leading to a potential bias in our study. A training course of roughly 30 min cannot outweigh four years of experience.

Conclusion

Mixed Reality represents a helpful tool for the visualization of topographic anatomy of the thoracic vascular system. The modality can increase the student’s motivation to engage more intensively and comprehensively with the learning content. Apart from making learning more enjoyable, this study did not show any statistically sustainable, objectifiable benefit of an MxR-assisted educational approach against established teaching methods. Therefore, the effective value of such a system should not be overestimated. In addition, the current high demand on resources in terms of time, costs and staff significantly prevents broad curricular use. Nevertheless, MxR-technology is suitable for addressing the cognitive, affective and - perhaps most interestingly - the psychomotor level of learning. Future studies should take a learner-centered approach to further evaluate the utility of this technology and potentially advance the development and implementation of MxR in vascular surgery training. For MxR to gain in importance, use cases must be identified in which the physical and virtual objects are equally indispensable.

Acknowledgements

We would like to acknowledge Linda Westernhagen and Mark Fingerle of the Brainlab AG (Munich, Germany) for their support in conducting this study.

Author contributions

LZ: Conceptualization and design, formal analysis and investigation, writing - original draftpreparation, writing – review and editing. JH, CU, MSB and DB: Conceptualization and design, data interpretation, writing – review and editing; SK: Conceptualization and design, methodology, writing – review and editing; KM: Conceptualization and design, methodology, formal analysis and investigation, writing - original draft preparation, writing – review andediting, supervision.

Funding

Open Access funding enabled and organized by Projekt DEAL. No source of funding.

Open Access funding enabled and organized by Projekt DEAL.

Data availability

All data will be available on demand.

Declarations

Competing interests

DB and CU are consulting for Brainlab AG (Munich, Germany). The remaining authors declare no conflicts of interest. The funders and the Brainlab AG had no role in the design of the study, collection, analysis, or interpretation of the data, in the writing of the manuscript, or in the decision to publish the results.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
==== Refs
References

1. Pugliese L Marconi S Negrello E Mauri V Peri A Gallo V Auricchio F Pietrabissa A The clinical use of 3D printing in surgery Updates Surg 2018 70 3 381 388 10.1007/s13304-018-0586-5 30167991
Pugliese L, Marconi S, Negrello E, Mauri V, Peri A, Gallo V, Auricchio F, Pietrabissa A (2018) The clinical use of 3D printing in surgery. Updates Surg 70(3):381–388. 10.1007/s13304-018-0586-530167991 10.1007/s13304-018-0586-5
2. Davis CR Bates AS Ellis H Roberts AM Human anatomy: let the students tell us how to teach Anat Sci Educ 2014 7 4 262 272 10.1002/ase.1424 24249485
Davis CR, Bates AS, Ellis H, Roberts AM (2014) Human anatomy: let the students tell us how to teach. Anat Sci Educ 7(4):262–272. 10.1002/ase.142424249485 10.1002/ase.1424
3. Buenting M Mueller T Raupach T Luers G Wehrenberg U Gehl A Anders S Post mortem CT scans as a supplementary teaching method in gross anatomy Ann Anat 2016 208 165 169 10.1016/j.aanat.2016.05.003 27210060
Buenting M, Mueller T, Raupach T, Luers G, Wehrenberg U, Gehl A, Anders S (2016) Post mortem CT scans as a supplementary teaching method in gross anatomy. Ann Anat 208:165–169. 10.1016/j.aanat.2016.05.00327210060 10.1016/j.aanat.2016.05.003
4. Lufler RS Zumwalt AC Romney CA Hoagland TM Incorporating radiology into medical gross anatomy: does the use of cadaver CT scans improve students’ academic performance in anatomy? Anat Sci Educ 2010 3 2 56 63 10.1002/ase.141 20213692
Lufler RS, Zumwalt AC, Romney CA, Hoagland TM (2010) Incorporating radiology into medical gross anatomy: does the use of cadaver CT scans improve students’ academic performance in anatomy? Anat Sci Educ 3(2):56–63. 10.1002/ase.14120213692 10.1002/ase.141
5. Paech D Klopries K Doll S Nawrotzki R Schlemmer HP Giesel FL Kuner T Contrast-enhanced cadaver-specific computed tomography in gross anatomy teaching Eur Radiol 2018 28 7 2838 2844 10.1007/s00330-017-5271-4 29383525
Paech D, Klopries K, Doll S, Nawrotzki R, Schlemmer HP, Giesel FL, Kuner T (2018) Contrast-enhanced cadaver-specific computed tomography in gross anatomy teaching. Eur Radiol 28(7):2838–2844. 10.1007/s00330-017-5271-429383525 10.1007/s00330-017-5271-4
6. Paech D Klopries K Nawrotzki R Schlemmer HP Giesel FL Kirsch J Schultz JH Kuner T Doll S Strengths and weaknesses of non-enhanced and contrast-enhanced cadaver computed Tomography scans in the teaching of gross anatomy in an Integrated Curriculum Anat Sci Educ 2022 15 1 143 154 10.1002/ase.2034 33170986
Paech D, Klopries K, Nawrotzki R, Schlemmer HP, Giesel FL, Kirsch J, Schultz JH, Kuner T, Doll S (2022) Strengths and weaknesses of non-enhanced and contrast-enhanced cadaver computed Tomography scans in the teaching of gross anatomy in an Integrated Curriculum. Anat Sci Educ 15(1):143–154. 10.1002/ase.203433170986 10.1002/ase.2034
7. Yammine K Violato C A meta-analysis of the educational effectiveness of three-dimensional visualization technologies in teaching anatomy Anat Sci Educ 2015 8 6 525 538 10.1002/ase.1510 25557582
Yammine K, Violato C (2015) A meta-analysis of the educational effectiveness of three-dimensional visualization technologies in teaching anatomy. Anat Sci Educ 8(6):525–538. 10.1002/ase.151025557582 10.1002/ase.1510
8. Rengier F Häfner MF Unterhinninghofen R Nawrotzki R Kirsch J Kauczor HU Giesel FL Integration of interactive three-dimensional image post-processing software into undergraduate radiology education effectively improves diagnostic skills and visual-spatial ability Eur J Radiol 2013 82 8 1366 1371 10.1016/j.ejrad.2013.01.010 23415424
Rengier F, Häfner MF, Unterhinninghofen R, Nawrotzki R, Kirsch J, Kauczor HU, Giesel FL (2013) Integration of interactive three-dimensional image post-processing software into undergraduate radiology education effectively improves diagnostic skills and visual-spatial ability. Eur J Radiol 82(8):1366–1371. 10.1016/j.ejrad.2013.01.01023415424 10.1016/j.ejrad.2013.01.010
9. Peterson DC Mlynarczyk GS Analysis of traditional versus three-dimensional augmented curriculum on anatomical learning outcome measures Anat Sci Educ 2016 9 6 529 536 10.1002/ase.1612 27078503
Peterson DC, Mlynarczyk GS (2016) Analysis of traditional versus three-dimensional augmented curriculum on anatomical learning outcome measures. Anat Sci Educ 9(6):529–536. 10.1002/ase.161227078503 10.1002/ase.1612
10. Curran VR Xu X Aydin MY Meruvia-Pastor O Use of Extended reality in Medical Education: an integrative review Med Sci Educ 2023 33 1 275 286 10.1007/s40670-022-01698-4 36569366
Curran VR, Xu X, Aydin MY, Meruvia-Pastor O (2023) Use of Extended reality in Medical Education: an integrative review. Med Sci Educ 33(1):275–286. 10.1007/s40670-022-01698-436569366 10.1007/s40670-022-01698-4
11. Shankar PR Extended reality in educating the Next Generation of Health professionals Educ Med J 2021 13 1 87 91 10.21315/eimj2021.13.1.8
Shankar PR (2021) Extended reality in educating the Next Generation of Health professionals. Educ Med J 13(1):87–91. 10.21315/eimj2021.13.1.810.21315/eimj2021.13.1.8
12. Eves J Sudarsanam A Shalhoub J Amiras D Augmented reality in vascular and endovascular surgery: scoping review JMIR Serious Games 2022 10 3 e34501 10.2196/34501 36149736
Eves J, Sudarsanam A, Shalhoub J, Amiras D (2022) Augmented reality in vascular and endovascular surgery: scoping review. JMIR Serious Games 10(3):e34501. 10.2196/3450136149736 10.2196/34501
13. Tang KS Cheng DL Mi E Greenberg PB Augmented reality in medical education: a systematic review Can Med Educ J 2020 11 1 e81 e96 10.36834/cmej.61705 32215146
Tang KS, Cheng DL, Mi E, Greenberg PB (2020) Augmented reality in medical education: a systematic review. Can Med Educ J 11(1):e81–e96. 10.36834/cmej.6170532215146 10.36834/cmej.61705
14. Guillot A Champely S Batier C Thiriet P Collet C Relationship between spatial abilities, mental rotation and functional anatomy learning Adv Health Sci Educ Theory Pract 2007 12 4 491 507 10.1007/s10459-006-9021-7 16847728
Guillot A, Champely S, Batier C, Thiriet P, Collet C (2007) Relationship between spatial abilities, mental rotation and functional anatomy learning. Adv Health Sci Educ Theory Pract 12(4):491–507. 10.1007/s10459-006-9021-716847728 10.1007/s10459-006-9021-7
15. Consulting I, Diagnostik ZZT (2019) Test für Medizinische Studiengänge Und Eignungstest für das Medizinstudium III, vol 1. Hogrefe
16. Hohler C Rasamoel ND Rohrbach N Hansen JP Jahn K Hermsdorfer J Krewer C The impact of visuospatial perception on distance judgment and depth perception in an augmented reality environment in patients after stroke: an exploratory study J Neuroeng Rehabil 2021 18 1 127 10.1186/s12984-021-00920-5 34419086
Hohler C, Rasamoel ND, Rohrbach N, Hansen JP, Jahn K, Hermsdorfer J, Krewer C (2021) The impact of visuospatial perception on distance judgment and depth perception in an augmented reality environment in patients after stroke: an exploratory study. J Neuroeng Rehabil 18(1):127. 10.1186/s12984-021-00920-534419086 10.1186/s12984-021-00920-5
17. Haney CM Kowalewski KF Schmidt MW Lang F Bintintan V Fan C Wehrtmann F Studier-Fischer A Felinska EA Muller-Stich BP Nickel F Robotic-assisted versus laparoscopic bowel anastomoses: randomized crossover in vivo experimental study Surg Endosc 2023 37 8 5894 5901 10.1007/s00464-023-10044-7 37072638
Haney CM, Kowalewski KF, Schmidt MW, Lang F, Bintintan V, Fan C, Wehrtmann F, Studier-Fischer A, Felinska EA, Muller-Stich BP, Nickel F (2023) Robotic-assisted versus laparoscopic bowel anastomoses: randomized crossover in vivo experimental study. Surg Endosc 37(8):5894–5901. 10.1007/s00464-023-10044-737072638 10.1007/s00464-023-10044-7
18. Hart SGSL (1988) Development of NASA-TLX (Task load index): results of empirical and theoretical research. Advances in psychology, vol 52. North-Holland: Elsevier, pp 139–183
19. Brooke J Jordan PWTB Weerdmeester BA SUS: a quick and dirty usability scale Usability evaluation in industry 1996 Abingdon Taylor & Francis 189 194
Brooke J (1996) SUS: a quick and dirty usability scale. In: Jordan PWTB, Weerdmeester BA et al (eds) Usability evaluation in industry. Taylor & Francis, Abingdon, pp 189–194
20. Hatzl J Hartmann N Böckler D Henning D Peters A Meisenbacher K Uhl C Mixed reality in patient education prior to abdominal aortic aneurysm repair Vasa 2023 52 3 160 168 10.1024/0301-1526/a001062 36891667
Hatzl J, Hartmann N, Böckler D, Henning D, Peters A, Meisenbacher K, Uhl C (2023) Mixed reality in patient education prior to abdominal aortic aneurysm repair. Vasa 52(3):160–168. 10.1024/0301-1526/a00106236891667 10.1024/0301-1526/a001062
21. Suresh D Aydin A James S Ahmed K Dasgupta P The role of augmented reality in Surgical training: a systematic review Surg Innov 2023 30 3 366 382 10.1177/15533506221140506 36412148
Suresh D, Aydin A, James S, Ahmed K, Dasgupta P (2023) The role of augmented reality in Surgical training: a systematic review. Surg Innov 30(3):366–382. 10.1177/1553350622114050636412148 10.1177/15533506221140506
22. Larena-Avellaneda A Behrendt CA Adili F Debus ES Universitäre gefäßchirurgische Lehre in Deutschland – eine Bestandsaufnahme Gefässchirurgie 2019 24 8 617 623 10.1007/s00772-019-00593-4
Larena-Avellaneda A, Behrendt CA, Adili F, Debus ES (2019) Universitäre gefäßchirurgische Lehre in Deutschland. – eine Bestandsaufnahme Gefässchirurgie 24(8):617–623. 10.1007/s00772-019-00593-410.1007/s00772-019-00593-4
23. Lee KS Ng JJ Choong A A scoping review of vascular surgery education in the medical school curriculum J Vasc Surg 2021 74 4 1362 1374e1363 10.1016/j.jvs.2021.04.024 33940080
Lee KS, Ng JJ, Choong A (2021) A scoping review of vascular surgery education in the medical school curriculum. J Vasc Surg 74(4):1362–1374e1363. 10.1016/j.jvs.2021.04.02433940080 10.1016/j.jvs.2021.04.024
24. Lareyre F Chaudhuri A Adam C Carrier M Mialhe C Raffort J Applications of Head-mounted displays and Smart glasses in vascular surgery Ann Vasc Surg 2021 75 497 512 10.1016/j.avsg.2021.02.033 33823254
Lareyre F, Chaudhuri A, Adam C, Carrier M, Mialhe C, Raffort J (2021) Applications of Head-mounted displays and Smart glasses in vascular surgery. Ann Vasc Surg 75:497–512. 10.1016/j.avsg.2021.02.03333823254 10.1016/j.avsg.2021.02.033
25. Hatzl J Böckler D Meisenbacher K Barb A Hartmann N Henning D Uhl C [Mixed reality in vascular surgery - a Scoping Review] Zentralbl Chir 2022 147 5 439 446 10.1055/a-1939-7686 36220066
Hatzl J, Böckler D, Meisenbacher K, Barb A, Hartmann N, Henning D, Uhl C (2022) [Mixed reality in vascular surgery - a Scoping Review]. Zentralbl Chir 147(5):439–446. 10.1055/a-1939-768636220066 10.1055/a-1939-7686
26. Lam K Abramoff MD Balibrea JM Bishop SM Brady RR Callcut RA Chand M Collins JW Diener MK Eisenmann M Fermont K Neto MG Hager GD Hinchliffe RJ Horgan A Jannin P Langerman A Logishetty K Mahadik A Maier-Hein L Antona EM Mascagni P Mathew RK Muller-Stich BP Neumuth T Nickel F Park A Pellino G Rudzicz F Shah S Slack M Smith MJ Soomro N Speidel S Stoyanov D Tilney HS Wagner M Darzi A Kinross JM Purkayastha S A Delphi consensus statement for digital surgery NPJ Digit Med 2022 5 1 100 10.1038/s41746-022-00641-6 35854145
Lam K, Abramoff MD, Balibrea JM, Bishop SM, Brady RR, Callcut RA, Chand M, Collins JW, Diener MK, Eisenmann M, Fermont K, Neto MG, Hager GD, Hinchliffe RJ, Horgan A, Jannin P, Langerman A, Logishetty K, Mahadik A, Maier-Hein L, Antona EM, Mascagni P, Mathew RK, Muller-Stich BP, Neumuth T, Nickel F, Park A, Pellino G, Rudzicz F, Shah S, Slack M, Smith MJ, Soomro N, Speidel S, Stoyanov D, Tilney HS, Wagner M, Darzi A, Kinross JM, Purkayastha S (2022) A Delphi consensus statement for digital surgery. NPJ Digit Med 5(1):100. 10.1038/s41746-022-00641-635854145 10.1038/s41746-022-00641-6
27. Greuter L De Rosa A Cattin P Croci DM Soleman J Guzman R Randomized study comparing 3D virtual reality and conventional 2D on-screen teaching of cerebrovascular anatomy Neurosurg Focus 2021 51 2 E18 10.3171/2021.5.FOCUS21212 34333473
Greuter L, De Rosa A, Cattin P, Croci DM, Soleman J, Guzman R (2021) Randomized study comparing 3D virtual reality and conventional 2D on-screen teaching of cerebrovascular anatomy. Neurosurg Focus 51(2):E18. 10.3171/2021.5.FOCUS2121234333473 10.3171/2021.5.FOCUS21212
28. Benninger B Matsler N Delamarter T Classic versus millennial medical lab anatomy Clin Anat 2014 27 7 988 993 10.1002/ca.22260 24677128
Benninger B, Matsler N, Delamarter T (2014) Classic versus millennial medical lab anatomy. Clin Anat 27(7):988–993. 10.1002/ca.2226024677128 10.1002/ca.22260
29. Jiang N Jiang Z Huang Y Sun M Sun X Huan Y Li F Application of augmented reality models of canine skull in veterinary anatomical education Anat Sci Educ 2024 10.1002/ase.2372 38238283
Jiang N, Jiang Z, Huang Y, Sun M, Sun X, Huan Y, Li F (2024) Application of augmented reality models of canine skull in veterinary anatomical education. Anat Sci Educ. 10.1002/ase.237238238283 10.1002/ase.2372
30. Farshad-Amacker NA Kubik-Huch RA Kolling C Leo C Goldhahn J Learning how to perform ultrasound-guided interventions with and without augmented reality visualization: a randomized study Eur Radiol 2023 33 4 2927 2934 10.1007/s00330-022-09220-5 36350392
Farshad-Amacker NA, Kubik-Huch RA, Kolling C, Leo C, Goldhahn J (2023) Learning how to perform ultrasound-guided interventions with and without augmented reality visualization: a randomized study. Eur Radiol 33(4):2927–2934. 10.1007/s00330-022-09220-536350392 10.1007/s00330-022-09220-5
31. Munoz-Montoya F Fidalgo C Juan MC Mendez-Lopez M Memory for object location in augmented reality: the role of gender and the relationship among spatial and anxiety outcomes Front Hum Neurosci 2019 13 113 10.3389/fnhum.2019.00113 31001098
Munoz-Montoya F, Fidalgo C, Juan MC, Mendez-Lopez M (2019) Memory for object location in augmented reality: the role of gender and the relationship among spatial and anxiety outcomes. Front Hum Neurosci 13:113. 10.3389/fnhum.2019.0011331001098 10.3389/fnhum.2019.00113
32. Jentzsch T Rahm S Seifert B Farei-Campagna J Werner CM Bouaicha S Correlation between Arthroscopy Simulator and Video Game performance: a cross-sectional study of 30 volunteers comparing 2- and 3-Dimensional Video games Arthroscopy 2016 32 7 1328 1334 10.1016/j.arthro.2015.12.047 27006104
Jentzsch T, Rahm S, Seifert B, Farei-Campagna J, Werner CM, Bouaicha S (2016) Correlation between Arthroscopy Simulator and Video Game performance: a cross-sectional study of 30 volunteers comparing 2- and 3-Dimensional Video games. Arthroscopy 32(7):1328–1334. 10.1016/j.arthro.2015.12.04727006104 10.1016/j.arthro.2015.12.047
33. Bangor A Kortum P Miller J Determining what Individual SUS scores Mean: adding an adjective rating scale J Usability Stud 2009 4 114 123
Bangor A, Kortum P, Miller J (2009) Determining what Individual SUS scores Mean: adding an adjective rating scale. J Usability Stud 4:114–123
34. Schoeb DS Schwarz J Hein S Schlager D Pohlmann PF Frankenschmidt A Gratzke C Miernik A Mixed reality for teaching catheter placement to medical students: a randomized single-blinded, prospective trial BMC Med Educ 2020 20 1 510 10.1186/s12909-020-02450-5 33327963
Schoeb DS, Schwarz J, Hein S, Schlager D, Pohlmann PF, Frankenschmidt A, Gratzke C, Miernik A (2020) Mixed reality for teaching catheter placement to medical students: a randomized single-blinded, prospective trial. BMC Med Educ 20(1):510. 10.1186/s12909-020-02450-533327963 10.1186/s12909-020-02450-5
35. Logeswaran A Munsch C Chong YJ Ralph N McCrossnan J The role of extended reality technology in healthcare education: towards a learner-centred approach Future Healthc J 2021 8 1 e79 e84 10.7861/fhj.2020-0112 33791482
Logeswaran A, Munsch C, Chong YJ, Ralph N, McCrossnan J (2021) The role of extended reality technology in healthcare education: towards a learner-centred approach. Future Healthc J 8(1):e79–e84. 10.7861/fhj.2020-011233791482 10.7861/fhj.2020-0112
36. Moro C Stromberga Z Raikos A Stirling A The effectiveness of virtual and augmented reality in health sciences and medical anatomy Anat Sci Educ 2017 10 6 549 559 10.1002/ase.1696 28419750
Moro C, Stromberga Z, Raikos A, Stirling A (2017) The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anat Sci Educ 10(6):549–559. 10.1002/ase.169628419750 10.1002/ase.1696
