
==== Front
J Prim Care Community Health
J Prim Care Community Health
JPC
spjpc
Journal of Primary Care & Community Health
2150-1319
2150-1327
SAGE Publications Sage CA: Los Angeles, CA

39269440
10.1177/21501319241277393
10.1177_21501319241277393
Original Research Article
The CATCH My Breath Vaping Prevention Curriculum: An Evaluation of Impacts in Central Appalachian Middle and High Schools, 2019-2023
https://orcid.org/0009-0007-7149-6866
Burchfield Katherine 1*
https://orcid.org/0000-0003-4849-2094
Doyle Daniel 12*
Mantey Dale 345
Bennett Trey 16
https://orcid.org/0000-0001-8993-3680
Baus Adam 17
1 West Virginia Alliance for Creative Health Solutions, Culloden, WV, USA
2 New River Health Association, Oak Hill, WV, USA
3 UTHealth, Department of Health Promotion and Behavioral Science, University of Texas School of Public Health, Austin, TX, USA
4 UTHealth, Department of Epidemiology, Human Genetics & Environmental Sciences, University of Texas School of Public Health, Austin, TX, USA
5 Michael and Susan Dell Center for Healthy Living, Austin, TX, USA
6 West Virginia University School of Medicine, Morgantown, WV, USA
7 West Virginia School of Public Health, Morgantown, WV, USA
Katherine Burchfield, West Virginia Alliance for Creative Health Solutions, 135 Community Rdg, Culloden, WV 25510-1147, USA. Email: katherine.burchfield@gmail.com
* These individuals are co-first authors and contributed equally to the development of this manuscript.

13 9 2024
Jan-Dec 2024
15 2150131924127739327 4 2024
23 7 2024
30 7 2024
© The Author(s) 2024
2024
SAGE Publications Inc unless otherwise noted. Manuscript content on this site is licensed under Creative Commons Licenses
https://creativecommons.org/licenses/by-nc/4.0/ This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
Introduction/Objectives:

Since 2015, the rise in e-cigarette use among youth has concerned public health authorities. After peaking in 2019, usage rates have declined but remain high. In 2023, 10% of high school and 4.6% of middle school students reported current use. This report describes the implementation and evaluation of a school-based e-cigarette prevention program, CATCH My Breath (CMB), in 8 central Appalachian counties. These counties have some of the highest rates of tobacco use, poor health, and premature death in the United States.

Methods:

A total of 6217 students across 25 middle and high schools in West Virginia and Kentucky received the CMB program from 2019 to 2023. Lists of participating counties, schools, and teachers were maintained on a rolling basis over the 4 years of the project. Program reach and impact on e-cigarette knowledge and use are reported. Thirteen-item pre- and post-tests were completed electronically by students before and after each course delivery. Questions assessed knowledge about e-cigarettes, current (past 30-day) e-cigarette use, and interest in future use.

Results:

From 2019 to 2023, there were 9399 deliveries of the 4-session CMB course, primarily to middle school students. Approximately 84% reported being less likely to use e-cigarettes following the program. Significant improvements in e-cigarette knowledge and beliefs on 5 of 8 items were observed, including a significant increase in knowledge composite score (4.15-4.75, P < .001). From pre- to post-test, declines in current e-cigarette use (5.1% to 4.4%; P = .005) and peer influence (4.9% to 4.0%; P = .025) were also observed.

Conclusions:

CMB was feasible, effective, and well-received in a convenience sample of central Appalachian counties and schools. This curriculum, combined with other policy initiatives, offers hope for curbing the growing epidemic of youth e-cigarette use and nicotine dependence. The success of this project contributed to a decision by the West Virginia Bureau for Public Health and the West Virginia Department of Education to launch a joint effort to bring CMB to middle schools in all 55 counties during the next 3 school years of 2023-2026.

community health
smoking
prevention
health promotion
program evaluation
Pallottine Foundation of Huntington https://doi.org/10.13039/100027951 CMB510 CAMC Foundation APHP1 cover-dateJanuary-December 2024
typesetterts1
==== Body
pmcIntroduction

E-cigarettes were introduced to the United States (US) market in 2007. By 2014, e-cigarettes were the most frequently used tobacco products among youth and young adults in the US. 1 The US Surgeon General issued a call to action for e-cigarette prevention programs in 2016. 2 Unfortunately, from 2017 to 2019, current (past 30-day) use of e-cigarettes in the US jumped from 11.7% to 27.5% among high school students and from 3.3% to 10.5% among middle school students.3,4 Public health authorities recognized this crisis and began working to develop interventions. 5

While the relative harms of e-cigarettes versus combustible cigarettes are still debated, there is no safe level of nicotine exposure for adolescents.6,7 According to one study, a single JUUL pod delivers an amount of nicotine equivalent to a pack of cigarettes, increasing the risk of rapid addiction among youth. 8 Nicotine has adverse effects on the developing adolescent brain including executive function, cognition, and attention.9 -12 E-cigarettes are associated with an increased risk of mental health issues in adolescents including depression, anxiety, suicidality, eating disorders, ADHD, and conduct disorders.11,12 Aerosolized e-cigarette fluid or “juice” contains heavy metals and carcinogens at doses with potential unknown long-term effects. 13 Furthermore, educators report a high volume of disciplinary problems which divert time from other educational priorities. 14

The 2021 Youth Behavioral Risk Survey (YBRS) revealed that 27.5% of West Virginia (WV) high school students were current users of e-cigarettes compared to 18% of high school students in the US as a whole. 15 WV middle school students were current users of e-cigarettes at a rate of 12% with no YBRS middle school comparison figure for the US as a whole. 15

The CATCH My Breath (CMB) curriculum, developed at the University of Texas School of Public Health, is the only curriculum designed for primary prevention with demonstrated effectiveness to reduce e-cigarette initiation among middle school students. 16 The program aims to improve knowledge about e-cigarettes, develop social-cognitive norms toward not using e-cigarettes, and build refusal skills. Beyond the pilot study, 16 limited evaluation of the CATCH My Breath program has been conducted. In one evaluation of the program in a private middle school, students’ knowledge about e-cigarettes significantly improved after receiving the curriculum, and this improvement was stable at follow-up 3 months later; however, students’ attitudes and susceptibility toward vaping did not improve. 17

This study reports the implementation of CMB in schools and impacts on knowledge about, use of, and interest in future use of e-cigarettes among students receiving the CMB curriculum in 8 WV and Kentucky (KY) counties. These are counties with some of the highest rates of adult smoking, premature death, poor health, and income inequality in the entire US. 18 WV has an adult smoking rate of 24%, ranging from 16% to 31% across counties; KY has an adult smoking rate of 20%, ranging from 14% to 35% across counties. 18 This is compared to a national adult smoking rate of 15%. 18 The high rates of tobacco use in this region among adults make it an especially important target for early prevention measures.

Methods

Design and Setting

The evaluation employed a descriptive design coupled with statistical analyses to assess the geographic reach of the program, baseline student knowledge about e-cigarettes, e-cigarette use, and interest in future use. A single-group, pre- and post-test design was adopted to quantify changes in knowledge, e-cigarette use, and interest in future use following completion of the CMB course.

The CMB course was delivered during 4 school years, specifically SY19-20 (2019-2020 school year), SY20-21, SY21-22, and SY22-23. The unforeseen outbreak of the COVID-19 pandemic in the Spring of 2020 caused school shutdowns and, in all but one school, delayed the start of instruction until Fall of 2020. During 2020, the national CATCH My Breath program quickly developed a video version of the curriculum that was easily loaded onto web-based instructional platforms. CMB instruction resumed in the Fall term of 2020 for both in-school and homebound students using school tablets or personal computers. All data collection was completed online, anonymized, and saved to UpMetrics secure servers. 19

For both logistical and Family Educational Rights and Privacy Act (FERPA) reasons, students remained anonymous during this project, resulting in exempt status from the reviewing IRB. Some schools delivered the CMB program every year to students across multiple grade levels. Thus, some students received the entire CMB curriculum annually over the course of 2 or 3 consecutive school years. These students could not be individually identified. For these reasons, “course deliveries” was chosen as the unit of analysis for this study, not individual students. The definition of a single course delivery was that a student received all 4 sessions of the CMB course, usually as 1 session per week, over 4 weeks.

Project funding did not allow in-school observations to measure fidelity of curriculum delivery including all 4 sessions, delivered at 1-week intervals, with peer-led small discussion groups. Teacher interviews indicated there was variation, usually in the number of course sessions and the use of peer discussion leaders. The direction of effect for these variations would be expected to diminish course impacts not increase them. For evaluation purposes, it was assumed that if a student completed a pre-test, then that student then received all 4 sessions of the CMB course. Therefore, the number of course deliveries was equal to the number of submitted pre-tests (9399).

The minimum number of unique participating students was estimated using the following procedure. First, for each participating school, all pre-tests from the semester with the greatest number of participating students were identified. Then, based on student grade level and the year the pre-test was taken, all pre-tests taken by students who would have graduated before they could take the course a second time were counted. Using these 2 criteria allowed the estimate of 6217 unique participating students.

This initiative and its evaluation were carried out by Partners in Health Network, Inc. (PIHN) and the West Virginia Alliance for Creative Health Solutions (WVACHS) based in Charleston, WV. WVACHS was primarily responsible for project evaluation.

Recruitment of Participants

PIHN used its network in an 11-county area of southern WV and eastern KY to recruit a convenience sample of schools having any or all of grades 5 through 10 to participate in the project. WV and KY state databases20,21 showed 200 such schools in these 11 counties with a combined enrollment of 40 000 students in grades 5 to 10. Half of the 200 schools were PK-5 elementary schools. Invitations via regular mail and e-mail were sent to superintendents in the 11 counties and directly to principals and health teachers in the 100 PK-8, middle, and high schools. Of those 100 contacted schools, 1, 9, 17, and 18 schools participated in the first, second, third, and fourth program years respectively. The CMB curriculum, training, technical support, and financial “wellness awards” were provided to participating schools. Financial incentives of $10 per student were awarded to schools based on the number of students who received the curriculum during each semester. To receive the school incentive, students needed to complete online pre-tests and post-tests with a post-test completion rate greater than or equal to 70% of the pre-test count.

Intervention

The CMB curriculum consists of four 40-min classroom sessions that include slide-show lectures, discussion opportunities, and peer-led small group activities. CMB was developed by the University of Texas School of Public Health. Social Cognitive Theory provides the theoretical basis for this curriculum and its delivery. 22 The curriculum is free to schools thanks to funding by the CVS Foundation. 23

Teacher Training

For schools to be eligible for incentive payments, teachers were required to complete a 45-min online training in CMB, complete an exam, and provide a copy of their certificate to PIHN.

Data Collection

The project used student pre- and post-tests adapted from longer surveys provided by the national CMB development and evaluation team. 13 The pre-test included 13 items that addressed knowledge about e-cigarettes, current use of e-cigarettes, and interest in future use of e-cigarettes. The post-test included the same 13 items plus 5 additional items asking for degree of agreement or disagreement about potential benefits of the course. The surveys were anonymous, with the demographic information limited to sex, year of birth, grade, school, and a secret nickname known only to the student. The responses were securely stored on a data platform by UpMetrics. 19 Surveys from the single participating school in SY19-20 were completed on paper and entered into UpMetrics by the research team. Starting in SY20-21, all surveys were completed by students online and loaded directly into UpMetrics. Survey data allowed measurement of counties reached, schools reached, and number of students who completed the course. Comparison of pre- and post-test data allowed measurement of knowledge gain and changes in e-cigarette use and interest in future use.

Measures

The following measures were used to assess e-cigarette knowledge, interest, and current use at baseline and after delivery of the CMB course.

Knowledge

Topics assessed ranged from e-cigarette contents (eg, “water vapor”; nicotine), age restrictions, and prevalence of e-cigarette use among peers. Each survey item is listed in Table 2. Responses were selected from a Likert scale that included “strongly agree,” “agree,” “disagree,” and “strongly disagree.”

Current use

Participants who reported using an e-cigarette, even once, in the past 30 days were classified as current users. Each survey item is listed in Table 3. Respondents were provided with 2 possible responses, “yes” and “no.”

Interest in future use

Participants were asked to answer 3 items related to interest in future e-cigarette use: (1) “Do you think you will vape in the next year?”; (2) “Are you curious about what it would be like to vape?”; and (3) “If one of your best friends offered you a vape, would you try it?” Each survey item is also listed in Table 3. Possible responses were “definitely yes,” “probably yes,” “probably not,” and “definitely not.” For analysis in Table 3, responses were collapsed into 2 categories: “yes” (including “definitely yes” and “probably yes”) and “no” (including “probably not” and “definitely not”).

Table 1 displays data groupings used for data analysis as part of this evaluation.

Table 1. Data Groupings for Analysis.

Data Grouping	Numerator	Denominator	Proportion	
Pre-tests (course deliveries)	9399	9399	1	
Post-tests	7008	9399	0.75	
Not current e-cigarette users on pre-tests	8888	9399	0.95	
Not current e-cigarette users on post-tests	6661	7008	0.95	
Unduplicated students	6217	9399	0.66	

Statistical Analysis

The pre- and post-test data collected through UpMetrics underwent rigorous cleaning (eg, addressing missing values), normalization (eg, addressing inconsistencies in free text entries), and validation (eg, confirming all responses are consistent with available survey choices) using Microsoft Access 24 to safeguard data integrity, enhance reliability, and ensure the meaningfulness of study findings. Statistical analyses were performed using JMP Statistical Software version 17.0 25 which facilitated comprehensive examination of the data collected. Descriptive analyses, including frequencies and percentages, provided a detailed overview of participant responses. Chi-square tests were used to assess for changes in students’ knowledge, beliefs, current e-cigarette use, and interest in future use of e-cigarettes. These tests were specifically applied to knowledge, belief, and interest statements, allowing for the detection of significant changes from pre- to post-curriculum delivery. Statistical significance was determined at the conventional threshold of P < .05, ensuring robust interpretation of the findings.

Results

Program Reach and Demographics

Over 4 school years starting in Fall 2019, CMB was implemented across 25 schools in 8 counties by 121 teachers. Some schools delivered the curriculum over multiple years, resulting in 9399 course deliveries to an estimated 6217 unique students. All reported results pertain to course deliveries. A total of 9399 pre-tests and 7008 post-tests were collected. Of the 9399 course deliveries, 48.6% were to female students, 49.1% to male students, and 2.3% provided another or no response. Ninety-six percent (96.0%) of course deliveries were to students in the target range of grades 5 to 10. Figure 1 shows counts for each grade.

Figure 1. Course deliveries by grade.

Psychosocial Impacts Knowledge and Beliefs

Full details of student responses for knowledge and beliefs about e-cigarettes are shown in Table 2.

Table 2. Knowledge and Beliefs.

	Pre	Post			
Knowledge or Belief Statements	N	% of Total	N	% of Total	χ2	P	
Knowledge gain	
E-cigarette vapor contains mostly water	1342.30	<.00001	
 Missing	57	0.61	35	0.50			
 I don’t know	4856	51.67	1716	24.49			
 No	3671	39.06	4670	66.64			
 Yes	815	8.67	587	8.38			
 Total	9399	100.00	7008	100.00			
Most E-cigarettes, including JUUL, contain nicotine	372.68	<.00001	
 Missing	55	0.59	29	0.41			
 I don’t know	2262	24.07	863	12.31			
 No	186	1.98	115	1.64			
 Yes	6896	73.37	6001	85.63			
 Total	9399	100.00	7008	100.00			
Which of the following is NOT a main part of E-liquid (or E-juice)?	1115.15	<.00001	
 Missing	46	0.49	14	0.20			
 Flavoring chemicals	333	3.54	255	3.64			
 I don’t know	4716	50.18	1879	26.81			
 Nicotine	354	3.77	246	3.51			
 Propylene Glycol	786	8.36	521	7.43			
 Water	3164	33.66	4093	58.40			
 Total	9399	100.00	7008	100.00			
It is illegal for teens under 18 to use E-cigarettes	289.35	<.00001	
 Missing	58	0.62	20	0.29			
 I don’t know	1878	19.98	765	10.92			
 No	918	9.77	576	8.22			
 Yes	6545	69.64	5647	80.58			
 Total	9399	100.00	7008	100.00			
Which of the following is NOT a smart refusal strategy?	227.60	<.00001	
 Missing	34	0.36	20	0.29			
 Add some humor	2576	27.41	1839	26.24			
 I don’t know	2127	22.63	1096	15.64			
 Just say no!	1515	16.12	1019	14.54			
 Put someone down for using E-cigarettes	2679	28.50	2686	38.33			
 Stand tall with nonsmoking friends	468	4.98	348	4.97			
 Total	9399	100.00	7008	100.00			
Nicotine is addictive and harmful to the body	67.39	<.00001	
 Missing	59	0.63	38	0.54			
 I don’t know	632	6.72	276	3.94			
 No	200	2.13	113	1.61			
 Yes	8508	90.52	6581	93.91			
 Total	9399	100.00	7008	100.00			
Cumulative knowledge	4.15 (SD:1.3)		4.75 (SD:1.2)			<.0001	
Beliefs			
Are E-cigarettes more, equal or less harmful than combustible cigarettes?	21.05	.000103	
 Missing	87	0.93	36	0.51			
 E-cigarettes are equally harmful as combustible cigarettes	5201	55.34	3919	55.92			
 E-cigarettes are less harmful than combustible cigarettes	1164	12.38	754	10.76			
 E-cigarettes are more harmful than combustible cigarettes	2947	31.35	2299	32.81			
 Total	9399	100.00	7008	100.00			
How many high school students do you think have vaped in the past 30 days?	438.44	<.00001	
 Missing	26	0.28	20	0.29			
 0%-20%	321	3.42	592	8.45			
 21%-40%	1056	11.24	1283	18.31			
 41%-60%	2208	23.49	1572	22.43			
 61%-80%	3094	32.92	2070	29.54			
 81%-100%	1439	15.31	842	12.01			
 I don’t know	1255	13.35	629	8.98			
 Total	9399	100.00	7008	100.00			

Receiving CMB was associated with strong knowledge gain by students about e-cigarettes. On all 6 survey questions that assessed factual knowledge, students made large gains.

For the first knowledge question about whether e-cigarettes contain mostly water, 39% gave a correct response of “no.” On post-tests, the correct response of “no” rose to 67% and “I don’t know” declined to 24%. A similar pattern was found for questions about whether all e-cigarettes contain nicotine (yes) and what is not a main ingredient of e-cigarette liquid (water).

There was a high percentage of correct responses to the question about whether nicotine is addictive and harmful to the body on both pre (91%) and post-tests (94%), but this gain still reached statistical significance.

Two psychosocial questions are best described as “belief” questions. The first was whether e-cigarettes are more or less harmful than combustible cigarettes. This issue is still debated among experts,6,7 although none argue that e-cigarettes are safe for tobacco-naïve children and adolescents. Over half of students responded “equally harmful” on both pre and post-tests.

The second belief question asked respondents how many high school students they thought had vaped within the past 30 days. Although the statistic cited in the course is 14%, 13 the majority of students endorsed percentages above 40% on both pre- and post-tests.

Behavioral Impacts Current e-cigarette Use and Interest in Future Use

Full details of student responses for current e-cigarette use and interest in future use are provided in Table 3. In Table 3, responses to the questions about future e-cigarette use were collapsed into 2 categories: “yes” (including “definitely yes” and “probably yes”) and “no” (including “probably not” and “definitely not”). This approach highlights the overall trends in student responses.

Table 3. Current E-Cigarette Use and Interest in Future Use.

	Pre	Post			
	N	% of Total	N	% of Total	χ2	P	
Current use	
During the past 30 days, have you vaped?	
 Missing	29	0.31	39	0.56			
 No	8888	94.56	6661	95.05			
 Yes	482	5.13	308	4.39			
 Total	9399	100.00	7008	100.00	10.54	.005148	
Interest in future use	
Do you think you will vape in the next year?	
 Missing	16	0.18	10	0.15			
 No	8677	97.63	6496	97.52			
 Yes	195	2.19	155	2.33			
 Total	8888	100.00	6661	100.00	0.51	.776143	
Are you curious about what it would be like to vape?	
 Missing	30	0.34	18	0.27			
 No	7595	85.45	5704	85.63			
 Yes	1263	14.21	939	14.10			
 Total	8888	100.00	6661	100.00	0.61	.737988	
If one of your best friends offered you a vape, would you try it?	
 Missing	23	0.26	20	0.30			
 No	8427	94.81	6373	95.68			
 Yes	438	4.93	268	4.02			
 Total	8888	100.00	6661	100.00	7.4	.024767	

On the pre-test, 5.13% of participants endorsed current e-cigarette use, compared to 4.39% on the post-test, indicating a statistically significant decrease (P < .05). Among all pre-test responses, 8888 (94.6%) reported no current e-cigarette use. Three questions asked students about interest in future e-cigarette use. Of those students who reported no current e-cigarette use, when asked whether they thought they would vape in the next year, 2.33% chose “yes” on the post-test compared to 2.19% on the pre-test, which was not a statistically significant change. When asked whether they were curious about what it would be like to vape, 14.10% answered “yes” on the post-test compared to 14.12% on the pre-test, which was also not a statistically significant change. However, when asked whether they would try a vape if it were offered by one of their best friends, 4.02% answered “yes” on the post-test compared to 4.93% on the pre-test, representing a statistically significant decrease (P < .05).

Student Reflections About CMB

On the post-test, students were asked to rate their agreement or disagreement with 5 statements describing potential benefits of the CMB course using a 4-point Likert scale with the choices of strongly agree, agree, disagree, or strongly disagree. Responses of strongly agree and agree were combined for a final rating of agreement. Perhaps the most important findings were that 87% stated that “all middle and high school students should go through the CMB program,” and 80% stated they are less likely to vape because of the course. Full details are shown in Table 4.

Table 4. Student Reflections About CMB.

Statement	% Agree (n = 7008)	
I think all middle and high school kids should go through the CATCH My Breath program.	87.43	
I learned a lot about E-cigarettes from the CATCH My Breath program.	86.42	
I am less likely to vape now that I have participated in the CATCH My Breath program.	84.12	
If I am offered a vape, I feel confident in using a refusal skill from the program.	80.31	
I understand E-cigarette advertising better because of the CATCH My Breath program.	82.17	

Discussion

Over the course of 4 school years, this project delivered the CMB curriculum in 8 counties and 25 schools to 6217 students with a total of 9399 course deliveries. This was more than double the original program goals. This was accomplished despite the major interruption of the COVID-19 pandemic during 2020 and 2021. Crucial to this success were program adaptations introduced in SY20-21 after a first year of very slow uptake. These adaptations included a change in recruitment model from using school-based health centers to direct outreach to principals and health teachers; replacement of paper pre- and post-test instruments with real-time online test instruments; development of video versions of the curriculum for home learning during the COVID shutdown; and cash school wellness awards of $10 per student based on the number of students who received the curriculum and the completion of pre- and post-tests. Participation increased dramatically in the Fall of 2021 and continued through Spring 2023.

Based on feedback from principals and teachers, the cash “wellness awards” were an important contributing factor to this improvement. The success of this project contributed to a decision by the West Virginia Bureau for Public Health and the West Virginia Department of Education to join forces to deliver the CMB curriculum to middle schools in all 55 counties of the state beginning in the Fall of 2023. 26

Students showed significant improvements in e-cigarette knowledge, use, and interest in future use after receiving CMB. However, on both pre-tests and post-tests, the majority of students maintained the mistaken belief that over 40% of high school students vape. The number has never been above 28% and fell to 10% on the 2023 National Youth Tobacco Survey (NYTS). 27 One of the goals of CMB is to demonstrate to students that not vaping is the norm.

This experience offers ideas for program improvement and future research. Future versions of the pre-test should include a question about “ever use” of e-cigarettes, which will allow for comparison to the NYTS and the YBRS estimates of population susceptibility. In addition to the school incentive, an incentive for teachers will be introduced in the next phase of the program. An important question is whether school districts or individual schools will add CMB to their regular health education curriculum when these incentives end.

Potential future directions in research include: investigating whether wide delivery of the course reduces e-cigarette disciplinary occurrences; investigating whether knowledge and behavioral outcomes continue to improve with repeated course deliveries; and determining whether better outcomes are achieved when teachers receive CMB’s 6-h interactive training versus the 1-h asynchronous training. Future research using this data set may also include subgroup analysis by grade level and gender to determine which students may benefit most from this intervention.

Limitations

The evaluation described within this study is limited by the real-world nature of the program implementation and training. That is to say, the data presented in this study were collected as part of a broader initiative to disseminate an evidence-based program 28 to youth in rural West Virginia and Kentucky. Therefore, schools were unable to be randomized or matched by treatment condition. As a result, this study may suffer from threats to internal validity, particularly selection bias, as it is plausible that the observed changes in e-cigarette knowledge and behavior may be due to characteristics within the sample that may not be generalizable to other populations; replication studies with control groups and randomization are needed.

As noted in the methods discussion, fidelity of course delivery was not observed or measured directly, and there was variation among schools in terms of how lessons were implemented. The variations reported would be expected to diminish not increase the positive changes that were observed. Future research applying methods of implementation science are needed to investigate these nuances.

While the measured impacts on e-cigarette knowledge, use, and interest in future use are impressive, these must be interpreted in light of known limitations of the single-group, pre- and post-test methodology used here. Marsden and Torgerson describe these limitations as history, maturation, test effects, and regression to the mean (RTM). 29 Because the time between pre-test, intervention, and post-test was usually less than 4 weeks, the history and maturation biases were minimized. Test effects and RTM likely contributed to the positive outcomes obtained, but the outcomes were in most cases so large and statistically strong that a positive effect of the CMB course is most probable.

Additionally, while this study evaluates changes in knowledge and use via pre-test/post-test study design, the program was not implemented to account for intra-class correlation (ICC), nesting of participants within schools, or other aspects of sample size parameters and power analysis. Future research designed and powered for extensive program evaluation, particularly via experimental study, are needed to further investigate the impact of CMB on adolescent e-cigarette knowledge and use.

A second, 6-month post-test could have provided information about the durability of the curriculum’s impacts on knowledge, use, and interest in future use.

The Family Educational Rights and Privacy Act of 1974 (FERPA) required student anonymity as part of this project, and this prevented a matched-pairs analysis of student responses. For further data collection, the surveys have been changed to include primarily multiple-choice answers and dropdown menus for demographic questions like school and county, rather than text entry, allowing for improved pairing of responses while maintaining student anonymity. In future projects, each student could be provided with a participant card that contains unique pre-survey and post-survey links.

Conclusion

This CMB implementation project was undertaken as a rapid response to a public health crisis. This report is a summative evaluation of that experience. This evaluation adds to a growing body of national data that the CMB curriculum is effective, well received by teachers and students, and easy to integrate into regular health curriculum offerings. 26 While CMB shows promise as a standard part of middle school health curricula, robust success in tobacco prevention and cessation efforts requires a comprehensive approach including legislation, media, and family involvement. 30

The authors wish to acknowledge important contributions to this project by the following individuals and organizations: project officer Laura Boone of the Pallottine Foundation of Huntington; teacher consultants Brianne Barker, Melissa Cyfers, Angela Harless, Holly Mitchell, and Ashley Stephens; PIHN staff Tom Kuhn and Hilary Payne; UpMetrics staff Briana Roberge, Luisa Sydlik-Smith, and Greg Woodburn; the Coalition for a Tobacco-Free West Virginia; Josh Grant of the WV Department of Education; and the principals, teachers, and students of participating schools in Kentucky and West Virginia. This study is a project of the West Virginia Alliance for Creative Health Solutions, an AHRQ-recognized Practice Based Research Network.

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project was funded by grants from the Pallottine Foundation of Huntington, WV and the CAMC Foundation of Charleston, WV.

Data Availability Statement: De-identified data from this manuscript are available by approved request from Adam Baus, PhD at abaus@hsc.wvu.edu.

Ethics Approval: The study protocol was determined to be exempt from review on 9/1/2022 by the Charleston Area Medical Center Institutional Review Board. IRB Study #22-876.

ORCID iDs: Katherine Burchfield https://orcid.org/0009-0007-7149-6866

Daniel Doyle https://orcid.org/0000-0003-4849-2094

Adam Baus https://orcid.org/0000-0001-8993-3680
==== Refs
References

1 Arrazola RA Singh T Corey CG , et al . Tobacco use among middle and high school students - United States, 2011-2014. MMWR Morb Mortal Wkly Rep. 2015;64 (14 ):381-385.25879896
2 US Office of the Surgeon General. E-cigarette use among youth and young adults: a report of the surgeon general; 2016. https://e-cigarettes.surgeongeneral.gov/documents/2016_SGR_Full_Report_non-508.pdf
3 Wang TW Gentzke A Sharapova S Cullen KA Ambrose BK Jamal A. Tobacco product use among middle and high school students - United States, 2011-2017. MMWR Morb Mortal Wkly Rep. 2018;67 (22 ):629-633. doi:10.15585/mmwr.mm6722a3 29879097
4 Wang TW Gentzke AS Creamer MR , et al . Tobacco product use and associated factors among middle and high school students - United States, 2019. MMWR Surveill Summ. 2019;68 (12 ):1-22. doi:10.15585/mmwr.ss6812a1
5 Slemp C. West Virginia youth and vaping: a dangerous combination summary report and recommendations; 2020. https://dhhr.wv.gov/bph/about/Documents/Youth%20Vaping%20Summary%201-23-20.pdf
6 Balfour DJK Benowitz NL Colby SM , et al . Balancing consideration of the risks and benefits of e-cigarettes. Am J Public Health. 2021;111 (9 ):1661-1672. doi:10.2105/AJPH.2021.306416 34410826
7 Eaton DL Alberg AJ Goniewicz M , et al . Public health consequences of e-cigarettes. 2018. Accessed June 21, 2024. https://www.nap.edu/catalog/24952/public-health-consequences-of-e-cigarettes
8 Prochaska JJ Vogel EA Benowitz N. Nicotine delivery and cigarette equivalents from vaping a JUULpod. Tob Control. 2022;31 (e1 ):E88-E93. doi:10.1136/tobaccocontrol-2020-056367
9 Goriounova NA Mansvelder HD. Short- and long-term consequences of nicotine exposure during adolescence for prefrontal cortex neuronal network function. Cold Spring Harb Perspect Med. 2012;2 (12 ):1-14. doi:10.1101/cshperspect.a012120
10 England LJ Bunnell RE Pechacek TF Tong VT McAfee TA. Nicotine and the developing human: a neglected element in the electronic cigarette debate. Am J Prev Med. 2015;49 (2 ):286-293. doi:10.1016/j.amepre.2015.01.015 25794473
11 Becker TD Arnold MK Ro V Martin L Rice TR. Systematic review of electronic cigarette use (vaping) and mental health comorbidity among adolescents and young adults. Nicotine Tob Res. 2021;23 (3 ):415-425. doi:10.1093/ntr/ntaa171 32905589
12 Baiden P Szlyk HS Cavazos-Rehg P Onyeaka HK Peoples JE Kasson E. Use of electronic vaping products and mental health among adolescent high school students in the United States: the moderating effect of sex. J Psychiatr Res. 2022;147 :24-33. doi:10.1016/j.jpsychires.2021.12.050 35007808
13 CATCH Global Foundation. CATCH my breath evidence-based youth vaping prevention program. Published 2024. Accessed June 21, 2024. https://catch.org/program/vaping-prevention/
14 Dai H Ramos A Tamraker N Cheney M Samson K Grimm B. School personnel’s responses to school-based vaping prevention program: a qualitative study. Health Behav Policy Rev. 2021;8 (2 ):130-147. doi:10.14485/HBPR.8.2.4
15 Centers for Disease Control and Prevention (CDC). 1991-2021 Youth risk behavior survey data. Accessed June 21, 2024. https://nccd.cdc.gov/Youthonline/App/Default.aspx
16 Kelder SH Mantey DS Van Dusen D Case K Haas A Springer AE . A middle school program to prevent e-cigarette use: a pilot study of “catch my breath.” Public Health Rep. 2020;135 (2 ):220-229. doi:10.1177/0033354919900887 31968177
17 Baker KA Campbell NJ Noonan D Thompson JA Derouin A. Vaping prevention in a middle school population using CATCH my breath. J Pediatr Health Care. 2022;36 (2 ):90-98. doi:10.1016/J.PEDHC.2021.07.013 34620523
18 University of Wisconsin Population Health Institute. County health rankings & roadmaps. Published 2024. Accessed June 21, 2024. https://www.countyhealthrankings.org/explore-health-rankings/county-health-rankings-measures
19 UpMetrics. UpMetrics 201 Spear Street, Suite 1100, San Francisco, CA 94105. Published online 2024. Accessed June 21, 2024. https://upmetrics.com/terms-of-use
20 Zoom WV . Published 2024. Accessed June 19, 2024. https://zoomwv.k12.wv.us/Dashboard/dashboard/28116
21 Kentucky Department of Education’s District and School Directory. Published 2024. Accessed June 19, 2024. Kentucky Department of Education’s District and School Directory
22 Kelder S Hoelscher D Perry C. How individuals, environments, and health behaviors interact: social cognitive theory. In: Glanz K Rimer B Viswanath K eds. Health Behavior: Theory, Research, and Practice, 5th ed. Jossey-Bass/Wiley and Sons; 2015;159-181.
23 CVS Health. CVS health announces aggressive new plans to combat the significant rise in e-cigarette use among youth. CVS Health Press Release. Published June 17, 2019. Accessed June 8, 2024. https://www.cvshealth.com/news/public-policy/cvs-health-announces-aggressive-new-plans-to-combat-the.html
24 Microsoft Corporation. Microsoft Access 365. Published online 2023.
25 SAS Institute Inc. JMP 17. Published online 2022.
26 Lewis J . DHHR and the state’s Department of Education launch anti-vaping campaign. Metro News. Published 2023. Accessed June 21, 2024. https://wvmetronews.com/2023/08/23/dhhr-and-the-states-department-of-education-launch-anti-vaping-campaign/
27 Birdsey J Cornelius M Jamal A , et al . Tobacco product use among U.S. middle and high school students - National Youth Tobacco Survey, 2023. MMWR Morb Mortal Wkly Rep. 2023;72 (44 ):1173-1182. https://www.cdc.gov/mmwr/volumes/72/wr/pdfs/mm7244a1-H.pdf 37917558
28 Kelder SH Mantey DS Van Dusen D Vaughn T Bianco M Springer AE. Dissemination of CATCH my breath, a middle school e-cigarette prevention program. Addict Behav. 2021;113 :1-7. doi:10.1016/j.addbeh.2020.106698
29 Marsden E Torgerson CJ. Single group, pre- and post-test research designs: some methodological concerns. Oxf Rev Educ. 2012;38 (5 ):583-616. doi:10.1080/03054985.2012.731208
30 Bhatnagar A Whitsel LP Blaha MJ , et al . New and emerging tobacco products and the nicotine endgame: the role of robust regulation and comprehensive tobacco control and prevention: a presidential advisory from the American Heart Association. Circulation. 2019;139 (19 ):e937-e958. doi:10.1161/CIR.0000000000000669
