==== Front GMS J Med Educ GMS J Med Educ GMS J Med Educ GMS Journal for Medical Education 2366-5017 German Medical Science GMS Publishing House zma001390 10.3205/zma001390 Doc97 urn:nbn:de:0183-zma0013906 Article Opportunities and challenges of e-learning in vocational training in General Practice – a project report about implementing digital formats in the KWBW-Verbundweiterbildungplus Chancen und Herausforderungen von E-Learning in der allgemeinmedizinischen Weiterbildung – ein Erfahrungsbericht zur Implementierung digitaler Lehrformate in der KWBW-Verbundweiterbildungplus Förster Christian 1 Eismann-Schweimler Jessica 2 Stengel Sandra 3 Bischoff Martina 2 Fuchs Monika 4 Graf von Luckner Andreas 2 Ledig Thomas 3 Barzel Anne 4 Maun Andy 2 Joos Stefanie 1 Szecsenyi Joachim 3 Schwill Simon *3 1 Universitätsklinikum Tübingen, Institut für Allgemeinmedizin und Interprofessionelle Versorgung, Tübingen, Germany 2 Universitätsklinikum Freiburg, Lehrbereich Allgemeinmedizin, Freiburg, Germany 3 Universitätsklinikum Heidelberg, Abteilung für Allgemeinmedizin und Versorgungsforschung, Heidelberg, Germany 4 Universitätsklinikum Ulm, Institut für Allgemeinmedizin, Ulm, Germany *To whom correspondence should be addressed: Simon Schwill, Universitätsklinikum Heidelberg, Abteilung für Allgemeinmedizin und Versorgungsforschung, Im Neuenheimer Feld 130.3, D-69120 Heidelberg, Germany, Phone: +49 (0)6221/56-38379, Fax: +49 (0)6221/56-1972, E-mail: simon.schwill@med.uni-heidelberg.de 03 12 2020 2020 37 7 Teaching in times of Covid-19/Lehre in Zeiten von Covid-19Doc9707 8 2020 15 10 2020 30 9 2020 Copyright © 2020 Förster et al.2020This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.This article is available from https://www.egms.de/en/journals/zma/2020-37/zma001390.shtmlBackground: The task of the Competence Centers for vocational training (KW) is to increase the attractiveness and quality of vocational (=post-graduate) training in general practice. For this purpose, they offer, among other things, a structured seminar program for post-graduate trainees in general practice (GP-trainees). During the Covid-19 pandemic the seminar program of the KWBW-Verbundweiterbildungplus® in Baden-Württemberg was converted to digital formats. The goal of the paper is to evaluate the acceptance by the GP-trainees and lecturers, to describe experiences with the conversion to e-learning and to derive recommendations with regard to the future orientation of seminar programs in post-graduate as well as continuing medical education. The implementation was based on a modified Kern-cycle and aimed at offering eight teaching units of 45 minutes each to a large number of GP-trainees. It tried to maintain the high quality of content and education as well as the interactive character of the previous seminars. For this purpose, the events were designed as synchronous webinars (six units) with asynchronous preparation and post-processing (two units) according to the flipped classroom method. The evaluation by the participating GP-trainees and lecturers was performed online using a multi-center developed and pre-piloted questionnaire. Results and discussion: N=101 GP-trainees participated in the evaluation of five individual seminar days in the second quarter of 2020 (response rate 97%). 58% (N=59) of the trainees were satisfied or very satisfied with the implementation. 82% (n=83) rated pre-tasks as helpful. 99% (n=100) would participate in an online seminar again. For 52% (n=53) of the trainees, the attitude towards e-learning had changed positively. The main advantages mentioned were no travel, save in time and costs as well as increased flexibility. The main disadvantages mentioned were less personal interaction and technical obstacles. The high acceptance of the new digital format showed the fundamental potential of e-learning in continuing medical education. The experiences can be a source of inspiration for other departments and KW. However, it also shows that important goals of KW, such as the personal interaction of the peer group, could not be achieved. In the future, it is important to develop a suitable mix of presence and digital formats with the aim to improve the attractiveness as well as sustainability of continuing medical education. Zusammenfassung Hintergrund: Um die Attraktivität und Qualität der Weiterbildung in der Allgemeinmedizin zu steigern, bieten die Kompetenzzentren Weiterbildung (KW) u.a. ein strukturiertes Seminarprogramm für Ärztinnen und Ärzte in Weiterbildung (ÄiW) an. Im Zuge der Covid-19-Pandemie wurde das Seminarprogramm der KWBW-Verbundweiterbildungplus® in Baden-Württemberg auf digitale Formate umgestellt. Ziel der Arbeit ist es, die Akzeptanz bei ÄiW und Dozierenden zu evaluieren, die Erfahrungen bei der Umstellung auf E-Learning zu beschreiben und daraus Empfehlungen abzuleiten im Hinblick auf die zukünftige Ausrichtung von Seminarprogrammen in der Facharztweiterbildung. Die Umsetzung orientierte sich an einem modifizierten Kern-Zyklus und hatte zum Ziel, einer großen Zahl von ÄiW weiterhin acht Unterrichtseinheiten (UE) à 45 min anbieten zu können und dabei die hohe inhaltliche und didaktische Qualität sowie den interaktiven Charakter der bisherigen Seminare beizubehalten. Dazu wurden die Veranstaltungen als synchrone Webinare (sechs UE) mit asynchroner Vor- und Nachbereitung (zwei UE) im Sinne der flipped classroom Methode konzipiert. Die Evaluation durch die teilnehmenden ÄiW und Dozierenden erfolgte online mittels eines multizentrisch entwickelten und vorab pilotierten Fragebogens. Ergebnisse und Diskussion: An der Evaluation der fünf Einzelseminartage im zweiten Quartal 2020 nahmen N=101 ÄiW teil (Rücklauf 97%). 58% (N=59) der ÄiW waren mit der Umsetzung zufrieden oder sehr zufrieden. 82% (N=83) empfanden die Vorbereitungsaufgaben als hilfreich. 99% (N=100) würden erneut an einem Online-Seminar teilnehmen. Bei 52% (N=53) der ÄiW hat sich die Einstellung gegenüber E-Learning positiv geändert. Vorteile ergäben sich v.a. durch den Wegfall der Anreise, Zeit- und Kostenersparnisse sowie eine erhöhte Flexibilität. Als nachteilig wurden insbesondere der geringere persönliche Austausch und technische Hürden genannt. Die hohe Akzeptanz des neuen digitalen Formats zeigt das grundsätzliche Potenzial von E-Learning in der ärztlichen Weiterbildung. Die Erfahrungen können Impulsgeber für andere Fachbereiche und KW sein. Allerdings zeigt sich auch, dass wichtige Ziele der KW, wie der persönliche kollegiale Austausch, damit nicht erreicht werden können. Für die Zukunft gilt es, eine geeignete Mischung aus Präsenz und digitalen Formaten zu entwickeln mit dem Ziel, die ärztliche Weiterbildung noch attraktiver und zukunftsfähiger zu gestalten. postgraduate medical educationresidencyvocational trainingcompetence centers for postgraduate medical educationgeneral practiceprimary caree-learningwebinarblended learning ==== Body Background In order to increase the quality and efficiency of vocational (=post-graduate) training in general practice (=GP), competence centers for vocational training (KW) were founded in 2017 [1]. Based on the experience of the Verbundweiterbildungplus as the first project of its kind in Germany (2009-2017) [2], [3], the KW in Baden-Württemberg (KWBW) offers the KWBW-Verbundweiterbildungplus®, a concomitant program that accompanies the training post [https://www.weiterbildung-allgemeinmedizin.de/]. An essential component is the seminar program designed for post-graduate trainees in GP (=GP-trainees) [4]. In 2019, the KWBW conducted 39 seminar days, in which a total of 379 GP-trainees participated. While digital formats were already used in medical education before the Covid-19 pandemic [5], [6], they have rarely been used for vocational training in Germany. Since the regulations for protection against SARS-CoV-2 [7] were issued, the KWBW has converted the seminars that had already been planned in presence into digital formats in only four weeks. The project implementation was based on a modified Kern cycle [8]. In accordance with the requirements and objectives (steps 1-3 according to Kern), it was decided to hold up the standards of high quality in content and educations while maintaining the interactive character in the online format. A synchronous teaching format in the form of webinars was chosen as teaching method (step 4 according to Kern). For a better understanding of the content, the possibility of more intensive work during the seminars and to promote in-depth learning [9], preparatory and follow-up tasks were specified, based on the online inverted classroom model (oICM) [10]. This is a variant of the flipped classroom method [11]. To stimulate self-reflection, the preparatory tasks were carried out with a portfolio, the competence-based curriculum for general practice [12]. For the implementation (step 5 according to Kern), the technical aspects were considered as threats when implementing the E-EST. For this purpose, participants were requested to use a cable-based Internet connection, a headset and a software-based application (instead of a browser-based one). The evaluation (step 6 according to Kern) was carried out with a multicenter newly developed and pre-piloted questionnaire. For the participants it contained six questions on sociodemographic data and 22 questions on the format of e-learning. For the lecturers it contained six sociodemographic questions and 29 questions on e-learning. The aim of this study was to evaluate the acceptance of digital teaching formats and to explore the advantages and disadvantages compared to traditional face-to-face teachings from the trainee’s (=GP-trainees) as well as trainers’ (=lecturers) perspective. Results and discussion From 23.04.2020 to 09.05.2020 five seminar days were conducted online (offer for 125 GP-trainees). n=104 attended. A total of 101 GP-trainees (response rate 97.1%) and all lecturers (n=11) who were not employees of the KWBW participated. Table 1 (Tab. 1) depicts sociodemographic data. 28.7% (n=29) of GP-trainees and 45% (n=5) of the lecturers had already experienced e-learning. 52% (n=53) of the GP-trainees and 55% (n=6) of the lecturers have changed their attitude towards e-learning (all comments in the free text sections were positive changes in attitude). The results of the evaluation from the GP-trainees’ point of view are shown in figure 1 (Fig. 1). Nine lecturers (82%) were satisfied or very satisfied with the idea of e-learning, all of them would like to be involved in a digital format again. 55% (n=6) assessed the learning success for GP-trainees to be worse, 45% (n=5) considered it comparable to classical teaching formats. All lecturers felt that the interaction with the GP-trainees was worse (n=7) or significantly worse (n=4). Advantages and disadvantages of e-learning from the trainees’ and trainers’ perspective are shown in table 2 (Tab. 2) and table 3 (Tab. 3). In this short report we show for the first time that the conversion of an education program for GP-trainees into a digital format is possible at short notice and can be seen as an opportunity by the learners. Previous studies of the acceptance of e-learning in continuing medical education, reported a reserved basic attitude [13]. This seems to have changed positively with the increasing spread of electronic media [14], [15], which our results confirm. Half of the GP-trainees stated that their attitude towards e-learning had changed positively through participation. The main reasons cited were that it had exceeded existing expectations (n=13) and was a good alternative in the current situation (n=5). The limited opportunities for interaction with the lecturers and with each other were critically assessed. The explicit goal of the KW is to contribute not only to the transfer of knowledge, but also to the networking among GP-trainees and their professional identity in GP [2]. However, the limited exchange of information has also been described by others [16], e.g. students would also like to have more opportunities for interaction in e-learning [17]. Lecturers evaluated the e-learning experience surprisingly positive, but scrutinized whether the increase in learning is comparable to a classroom event. Qualitative studies with lecturers are necessary with regard to the justification of this position as well as possible changes in attitude. The high acceptance of the flipped classroom method shows that the integration of activating elements can be successful. The preparatory tasks were considered to be helpful by n=83 (82%). The reasons given were a positive effect on learning success (n=30), a better understanding of content (n=25) and a comparable level of knowledge of the ÄiW (n=6). This method has rarely been evaluated in vocational training in Germany [5]. Studies with medical students show that it can contribute positively to motivation and commitment [18]. In particular, it can help to promote deep learning [19]. These effects are not only limited to e-learning [20], therefore the positive attitude of the ÄiW described by us can also motivate a broad implementation of the flipped classroom in face-to-face seminars. A strength of this study is the high number of responses. Approximately one fifth of the places stayed vacant (comparable to participation in face-to-face seminars). We do not know whether professional or family obligations during the pandemic or the format itself (e.g. insufficient access or lack of inner readiness) influenced the registration. Changes in attitude can only be rudimentarily presented in a questionnaire, for a more detailed exploration a qualitative follow-up study is necessary. Despite all the opportunities offered by the digital possibilities, it is important to maintain the regional personal reference during the seminar days. During medical school and the clinical training of vocational trainees there is interdisciplinary and social interaction with colleagues on a regular basis. These opportunities are not available in general practice. This gap had been closed by our face-to-face seminars [2]. E-learning can contribute to a better compatibility of education and family tasks, especially for GP-trainees in rural regions. It can hereby further increase the attractiveness of general practice. The results of our work motivate us to implement e-learning beyond the Covid-19 pandemic as a supplement at the KWBW. Further studies on e-learning in vocational training and continuing medical education are needed with an emphasize on how the social interaction of colleagues can be improved parallelly to a continuous increase in learning. Competing interests The authors declare that they have no competing interests. Table 1 Sociodemographic data of post-graduate trainees in General Practice and lectures Table 2 Advantages of E-Learning from the perspectives of post-graduate trainees in general practice and their lecturers Table 3 Disadvantages of E-Learning from the perspectives of post-graduate trainees in general practice and their lecturers Figure 1 Evaluation of e-learning in the KWBW-Verbundweiterbildungplus by post-graduate trainees in general practice (n=101) ==== Refs 1 Kassenärztliche Bundesvereinigung Vereinbarung zur Förderung der Weiterbildung gemäß § 75a SGB V Anlage IV Förderung von Qualität und Effizienz der Weiterbildung 2019 Berlin Kassenärztliche Bundesvereinigung Available from: https://www.kbv.de/media/sp/Foerderung_Allgemeinmedizin_Anlage4.pdf 2 Schwill S Magez J Joos S Steinhäuser J Ledig T Rubik A Niebling W Szecsenyi J Flum E New paths in post-graduate medical training in general practice-8 years of experience with the pilot project Verbundweiterbildungplus Baden-Württemberg GMS J Med Educ 2017 34 5 Doc62 10.3205/zma001139 29226230 3 Steinhauser J Roos M Haberer K Ledig T Peters-Klimm F Szecsenyi J Joos S Bericht aus der Praxis: Das Programm Verbundweiterbildungplus des Kompetenzzentrums Allgemeinmedizin Baden-Württemberg - Entwicklung, Umsetzung und Perspektiven Report from general practice: the composite graduate education(plus) program of the Baden-Wurttemberg General Practice Competence Center - development, implementation and prospects Z Evid Fortbild Qual Gesundhwes 2011 105 2 105 109 10.1016/j.zefq.2011.02.002 21496778 4 Flum E Magez J Aluttis F Hoffmann M Joos S Ledig T Oeljeklaus L Simon M Szecsenyi J Steinhäuser J Das Schulungsprogramm der Verbundweiterbildungplus Baden-Württemberg: Entwicklung und Implikationen für die Implementierung von Verbundweiterbildungsprogrammen in Deutschland Z Evid Fortbild Qual Gesundhwes 2016 112 54 60 10.1016/j.zefq.2016.03.02 27172786 5 Kuhn S Frankenhauser S Tolks D Digitale Lehr-und Lernangebote in der medizinischen Ausbildung Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz 2018 61 2 201 209 10.1007/s00103-017-2673-z 6 Vaona A Banzi R Kwag KH Rigon G Cereda D Pecoraro V Tramacere I Moja L E-learning for health professionals Cochrane Database Syst Rev 2018 1 1 CD011736 10.1002/14651858.CD011736.pub2 29355907 7 Bundesland Baden-Württemberg Verordnung der Landesregierung über infektionsschützende Maßnahmen gegen die Ausbreitung des Virus SARS-Cov-2 (Corona-Verordnung - CoronaVO) 2020 Stuttgart Bundesland Baden-Württemberg Available from: https://www.baden-wuerttemberg.de/de/service/aktuelle-infos-zu-corona/aktuelle-corona-verordnung-des-landes-baden-wuerttemberg/ 8 Kern D Thomas P Howard D Bass E Curriculum development for medical education. A six-step approach Baltimore The Johns Hopkins University Press Chapter Four: Step. 1991 9 Marton F Säljö R On qualitative differences in learning: I-Outcome and process Br J Educ Psychol 1976 46 1 4 11 10.1111/j.2044-8279.1976.tb02980.x 10 Tolks D Romeike BF Ehlers J Kuhn S Kleinsorgen C Huber J Fischer MR Bohne C Hege I The online inverted classroom model (oICM). A blueprint to adapt the inverted classroom to an online learning setting in medical and health education MedEdPublish 2020 9 10.15694/mep.2020.000113.1 11 Tolks D Schäfer C Raupach T Kruse L Sarikas A Gerhardt-Szép S Klauer G Lemos M Fischer MR Eichner B Sostmann K Hege I An introduction to the inverted/flipped classroom model in education and advanced training in medicine and in the healthcare professions GMS J Med Educ 2016 33 3 Doc46 10.3205/zma001045 27275511 12 Steinhaeuser J Chenot JF Roos M Ledig T Joos S Competence-based curriculum development for general practice in Germany: a stepwise peer-based approach instead of reinventing the wheel BMC Res Notes 2013 6 1 314 10.1186/1756-0500-6-314 23937795 13 Vollmar HC Rieger MA Butzlaff ME Ostermann T General Practitioners' preferences and use of educational media: a German perspective BMC Health Serv Res 2009 9 1 31 10.1186/1472-6963-9-31 19220905 14 Shabli S Heuermann K Leffers D Kriesche F Abrams N Yilmaz M Klußmann JP Guntinas-Lichius O Beule A Umfrage zum Bedarf einer e-Learning-Plattform für Ärzte in der HNO-Facharzt-Weiterbildung Laryngorhinootologie 2019 98 12 869 876 10.1055/a-1025-2024 31658473 15 Necknig U Sterz J Leyh H Fischer M Urologie onLINE-Webinar für Assistenten Urologe 2019 58 6 658 665 10.1007/s00120-018-0845-6 16 Hoffmann E E-Learning als wirkungsvolles Element der Digitalisierung. Industrie 40 für die Praxis 2018 Heidelberg Springer 201 220 10.1007/978-3-658-21118-9_15 17 Busse B Bargel T Befragungen zu E-Learning an Hochschulen: Erfahrungen und Sicht der Studierenden 2017 Konstanz Universität Konstanz 18 Chen F Lui AM Martinelli SM A systematic review of the effectiveness of flipped classrooms in medical education Med Educ 2017 51 6 585 597 10.1111/medu.13272 28488303 19 McLean S Attardi SM Faden L Goldszmidt M Flipped classrooms and student learning: not just surface gains Adv Physiol Educ 2016 40 1 47 55 10.1152/advan.00098.2015 26847257 20 Hew KF Lo CK Flipped classroom improves student learning in health professions education: a meta-analysis BMC Med Educ 2018 18 1 38 10.1186/s12909-018-1144-z 29544495