==== Front Int J Equity Health Int J Equity Health International Journal for Equity in Health 1475-9276 BioMed Central London 1940 10.1186/s12939-023-01940-4 Research Addressing health disparities using multiply imputed injury surveillance data http://orcid.org/0000-0001-7806-5881 Liu Yang wcq6@cdc.gov 1 Wolkin Amy F. 1 Kresnow Marcie-jo 1 Schroeder Thomas 2 1 grid.416738.f 0000 0001 2163 0069 Division of Injury Prevention, National Center for Injury Prevention and Control, U.S. Centers for Disease Control and Prevention, Atlanta, GA USA 2 grid.420322.5 0000 0001 2299 1421 Division of Hazard and Injury Data Systems, U.S. Consumer Product Safety Commission, Bethesda, MD USA 3 7 2023 3 7 2023 2023 22 12627 2 2023 18 6 2023 © This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply 2023 https://creativecommons.org/licenses/by/4.0/ Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data. Background Assessing disparities in injury is crucial for injury prevention and for evaluating injury prevention strategies, but efforts have been hampered by missing data. This study aimed to show the utility and reliability of the injury surveillance system as a trustworthy resource for examining disparities by generating multiple imputed companion datasets. Methods We employed data from the National Electronic Injury Surveillance System-All Injury Program (NEISS-AIP) for the period 2014–2018. A comprehensive simulation study was conducted to identify the appropriate strategy for addressing missing data limitations in NEISS-AIP. To evaluate the imputation performance more quantitatively, a new method based on Brier Skill Score (BSS) was developed to assess the accuracy of predictions by different approaches. We selected the multiple imputations by fully conditional specification (FCS MI) to generate the imputed companion data to NEISS-AIP 2014–2018. We further assessed health disparities systematically in nonfatal assault injuries treated in U.S. hospital emergency departments (EDs) by race and ethnicity, location of injury and sex. Results We found for the first time that significantly higher age-adjusted nonfatal assault injury rates for ED visits per 100,000 population occurred among non-Hispanic Black persons (1306.8, 95% Confidence Interval [CI]: 660.1 – 1953.5), in public settings (286.3, 95% CI: 183.2 – 389.4) and for males (603.5, 95% CI: 409.4 – 797.5). We also observed similar trends in age-adjusted rates (AARs) by different subgroups for non-Hispanic Black persons, injuries occurring in public settings, and for males: AARs of nonfatal assault injury increased significantly from 2014 through 2017, then declined significantly in 2018. Conclusions Nonfatal assault injury imposes significant health care costs and productivity losses for millions of people each year. This study is the first to specifically look at health disparities in nonfatal assault injuries using multiply imputed companion data. Understanding how disparities differ by various groups may lead to the development of more effective initiatives to prevent such injury. Supplementary Information The online version contains supplementary material available at 10.1186/s12939-023-01940-4. Keywords Health Disparity Missing Data Multiple Imputation Non-fatal Assault Injury National Electronic Injury Surveillance System-All Injury Program (NEISS-AIP) issue-copyright-statement© BioMed Central Ltd., part of Springer Nature 2023 ==== Body pmcIntroduction Over a million people are treated in emergency departments for nonfatal assault injuries in the United States every year [1]. Such injuries are also a leading cause of mortality among children and young adults, and many result in life-long disabilities and health consequences [2]. These health issues can impose heavy costs on individuals and society. The Centers for Disease Control and Prevention estimates the 2019 nonfatal injury costs $2.0 trillion in medical care and lost productivity, which is more than four times as high as the 2013 estimate ($457 billion) [3]. According to Moore et. al., there are disparities in injury incidence and the burden of injury falls disproportionately on “communities of color, those who are economically disadvantaged, and those who are geographically isolated” [4]. Understanding how health disparities differ by various groups may lead to the development of more effective initiatives to prevent such injury. Investigating disparities in health between groups requires accurate identification and categorization [5, 6]. However, information about key indicators for identification such as race/ethnicity, sex, age, and geographic location may be missing or not collected in large survey data [7–9]. This lack of complete information may cause inaccurate estimation of disparities, especially when the proportion of missing data is high. Efforts to address health disparities in injury research have been hampered by missing data [10–12]. Complete data are essential for identifying disparities, minimizing bias, and for improving statistical power and efficiency. NEISS-AIP collects data from a nationally representative sample of hospital emergency departments (EDs) using specific guidelines for recording the primary diagnosis and mechanism of all types of injuries treated [1, 13]. It can be used to (1) measure the magnitude and distribution of nonfatal injuries in the United States; (2) monitor unintentional and violence-related injuries over time; (3) discover emerging injury problems; and (4) set national priorities. Analysing and disseminating these surveillance data will help support the mission of reducing all types and causes of injuries in the United States [14]. However, as with any large-scale data collection effort, NEISS-AIP often contains missing data. For the data years of 2014–2018, more than half (57.1%) of records reported at least one missing variable. In particular, patient race/ethnicity (RACE) and location of injury (LOC) had the highest proportions of missing data (32.7% for RACE and 35.3% for LOC). Identifying disparities requires accurate data on health status and individual determinants of health for subgroups of the population. These missing key indicators can hinder the use of NEISS-AIP in investigating health disparities. Missing data continues to limit the analysis of health-related disparities and their causes. The most widely adopted strategy to overcome the missing data barrier is to omit observations with missing values and perform a complete case analysis (CCA). However, the cumulative effect of missing data in several variables often leads to exclusion of a substantial proportion of original sample. The results from CCA may be biased because the complete case can be unrepresentative of the full population. CCA may suffer from the loss of statistical precision and risk of bias, since incorrect handling of missing data might result in drawing the wrong conclusion, as effect estimates and error measurements may be altered [15]. Multiple imputation (MI) is widely recognized as another standard approach for handling missing data, particularly when data are partially missing for multiple variables [16–18]. The missing values are imputed based on a model that relates the missing variable to observed variables, which generates multiple complete datasets without missingness. Estimates and standard errors (SE) are calculated for each imputation set and pooled into one overall estimate and SE. MI predicts data based on the known variables with the incorporation of missing data uncertainty, which leads to more accurate estimates than single imputation. It is a powerful and statistically valid method for creating imputations in large datasets with complex data structures [19, 20]. Accounting for missing data is essential for facilitating injury research into health disparities [21–23]. The present study aims to make NEISS-AIP a more useful and reliable resource for examining disparities by generating multiple imputed companion datasets. We conducted a comprehensive simulation study to identify the appropriate MI method for handling missing data in NEISS-AIP. We selected the multiple imputations by fully conditional specification (FCS MI) to generate the imputed companion data to NEISS-AIP 2014–2018. These complete data were used to further assess health disparities by race and ethnicity, location of injury, and sex in nonfatal assault injuries treated in U.S. hospital EDs. To our knowledge, this study is the first to assess health disparities in injury using multiple imputed NEISS-AIP data. Methods NEISS-AIP 2014–2018 Data The NEISS-AIP is designed to provide national incidence estimates of all types and external causes of nonfatal injuries and poisonings treated in U.S. hospital EDs [13]. Data on injury-related visits were obtained from a national sample of 66 of 100 NEISS hospitals, which were selected as a stratified probability sample of hospitals in the United States with a minimum of six beds and a 24-h ED. Data were weighted by the inverse of the probability of selection to produce national estimates. The sample included separate strata for very large, large, medium and small hospitals, defined by the number of annual ED visits per hospital. Trained, onsite hospital coders abstracted data for injury-related cases from ED records at NEISS hospitals. NEISS-AIP is providing data on approximately 600,000 cases annually. Data collected include age, race/ethnicity, gender, principal diagnosis, primary body part affected, consumer products involved, disposition at ED discharge, the locale where the injury occurred, work-relatedness, and a narrative description of the injury circumstances. Also, major categories of external cause of injury and of the intent of injury are being coded for each case in a manner consistent with the International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) coding rules and guidelines. NEISS-AIP provides an excellent data source for monitoring national estimates of injuries over time. However, incomplete NEISS-AIP data poses challenges for identifying health disparities and for analysing the underlying causes. Multiple Imputation (MI) Method To create a full dataset and to minimize bias due to systematic differences between complete records and those with missing data, MI was performed. MI is a three-step approach following Rubin’s rules [24] to estimation of incomplete data: (1) imputation of missing values from a so-called “imputation model” repeated m times, which results in the m complete imputed data set; (2) the fitting of an “analysis model” (i.e., the model of interest) to each of the m imputed data sets separately; (3) pooling of the m sets of estimates thus obtained to give an overall set of estimates and corresponding standard errors [25–31]. The general procedure for MI was described in Supplementary Text A. To identify important covariates in the imputation model, Cramer’s V statistic was used to measure the correlation between the missing variable and covariates [30]. The covariate was included in the imputation model if it correlated with an absolute value of a Cramer’s V greater than 0.05 (all covariates used are summarized in Supplementary Table S1). All statistical analyses, including MI methods, were conducted using SAS version 9.4 (SAS Institute, Cary, NC). Two major approaches in MI exist: joint modeling (JM) and fully conditional specification (FCS) [27]. JM imputations involve specifying a multivariate distribution for the missing data and drawing an imputation from their conditional distributions using Markov Chain Monte Carlo (MCMC) techniques. FCS imputations are generated sequentially variable-by-variable by specifying an imputation model for each missing variable given the other variables. FCS MI is a more flexible approach for creating imputations in large datasets which include both categorical and continuous variables [28, 29]. Simulation study A comprehensive simulation study was performed on the 2018 NEISS-AIP data year to illustrate and to distinguish the performance of various missing data approaches. The missing data pattern can influence the amount of information transferred between variables, so we first investigated the missing pattern in the NEISS-AIP 2018 data to determine all possible intersections between different missing variable sets (Supplementary Table S2, total fifty-four patterns with at least one missing variable were obtained). We then developed a Venn diagram to visualize the intersections and the cumulative missing percentage. Given the complex data structure and the large sample size (over 600,000 cases collected in NEISS-AIP annually), it is impossible to simulate the NEISS-AIP using classic simulations. We developed a new simulation dataset by imposing the missing data patterns on the subset of fully observed data in NEISS-AIP 2018. The missingness in the simulated data was generated using random sampling without replacement to mimic all possible intersections among missing variables. Each observation in the data set had an equal chance of being selected, once selected it couldn’t be chosen again. SAS PROC SURVEYSELECT procedure was applied to generate a variety of random samples for the missing pattens [32]. As the true values of these missing data were already known from the non-missing data, the accuracy of imputed values could be assessed using the non-missing data as the standard control. To evaluate the imputation performance more quantitatively, we developed a new method based on the Brier Skill Score (BSS) to observe the performance difference [33–35]. The detailed algorithm of the BSS based new method was described in the Appendix. BSS is useful for envisioning the difference in imputation performance and for measuring the accuracy improvements of probabilistic predictions. We performed the BSS comparison of the imputation performance for all categorical missing variables by two MI methods (JM and FCS), in which CCA was chosen as the reference strategy. As the key covariate of interest, race/ethnicity information is vital for measuring disparities across groups [8]. To assess the impact of MI on the overall distribution, we determined the distributions of race/ethnicity among the simulation dataset (before imputation), JM and FCS imputed data (after imputation), and the standard control (the non-missing data). For our analysis, race/ethnicity was recoded into four categories to make them compatible with available annual bridged-race population estimates used as denominators for the injury rates: White, non-Hispanic (White NH); Black or African American, non-Hispanic (Black NH); Hispanic; and Other NH. We combined Asian, non-Hispanic (Asian NH); American Indian or Alaska Native, non-Hispanic (AIAN NH); and Pacific Islander, non-Hispanic (PI NH) into one group as Other NH. Race bridging refers to making data collected using one set of race categories consistent with data collected using a different set of race categories, to permit estimation and comparison of race-specific statistics at a point in time or over time. Prior to 2021, reporting injury rates in these four mutually exclusive categories is consistent with mortality reporting from National Center of Health Statistics and incidence reporting from National Cancer Institute [36, 37]. We compared crude nonfatal assault injury rates within the White NH group to illustrate the bias in injury rate estimates when using various missing data approaches. White NH group was selected for illustrative purposes since it had the largest proportion of population in the data. Nonfatal assault injuries were limited to those injuries treated in the ED and resulting from physical violence by one or more persons; sexual assaults and injuries from legal intervention were excluded [13]. The absolute deviations of nonfatal assault injury rate estimates were calculated using the standard control rate as the reference. The 2014–2018 U.S. Census Bureau bridged-race population estimates were used to calculate nonfatal assault injury rates per 100,000 population. Assessing disparities using FCS imputed companion data FCS MI showed the best overall imputation performance based on the simulation study. We then implemented this approach on the NEISS-AIP data to impute the missing data in each year from 2014 to 2018 (The general SAS coding procedure for PROC MI using FCS statement was included in Supplementary Text B). Finally, all years of imputed data were merged to generate an imputed companion dataset to the NEISS-AIP 2014–2018 data. Next, we assessed health disparities by race/ethnicity, location of injury, and sex using imputed companion data. To allow for accurate comparisons between groups with different age distributions, we calculated age-adjusted average annual rates of nonfatal assault injury per 100,000 population among hospital ED visits by RACE, LOC, and SEX. The estimated nonfatal assault injury rates were age-adjusted to the 2000 U.S. standard population. We also displayed trend analysis for age-adjusted nonfatal assault injury rates by different groups in each year from 2014 to 2018. The significant differences in nonfatal assault injury rates across various groups were tested using t-tests, where p-values < 0.05 were considered statistically significant. Analyses were conducted using SAS 9.4 (SAS Institute, Inc, Cary, NC), and 95% CIs and statistical tests accounted for the sampling weights and complex survey design. Data were weighted by the inverse of the probability of selection to provide national estimates. Results Missing data in NEISS-AIP 2014–2018 Table 1 shows the unweighted counts and percentages for all missing variables in NEISS-AIP data from 2014–2018. Due to the cumulative effect of missing data, more than half (57.1%) of records were missing at least one variable and only 42.9% had fully complete (non-missing) data. Figure 1 displays the trend for all missing variables from 2014 to 2018. RACE and LOC had the highest proportions of missing data across years (> 30%).Table 1 Frequency analysis of missingness: unweighted counts and percentages for missing variables in NEISS-AIPa, United States, 2014–2018 Missing Variablesb 2014 2015 2016 2017 2018 2014–2018 n % n % n % n % n % N % LOC 227,655 36.8 215,807 35.2 226,014 36.4 220,506 34.5 193,958 33.4 1,083,940 35.3 RACE 184,732 29.8 210,518 34.4 211,600 34.0 209,781 32.8 188,437 32.4 1,005,068 32.7 CAUSE 17,924 2.9 16,897 2.8 18,557 3.0 19,031 3.0 16,048 2.8 88,457 2.9 BDYPT 7,386 1.2 8,306 1.4 8,876 1.4 8,691 1.4 9,862 1.7 43,121 1.4 TYPE 5,507 0.9 5,359 0.9 4,861 0.8 5,468 0.9 5,450 0.9 26,645 0.9 AGE 199 0.03 254 0.04 251 0.04 238 0.04 198 0.03 1,140 0.04 DISP 16 0.003 6 0.001 7 0.001 204 0.03 15 0.003 248 0.008 SEX 8 0.001 13 0.002 7 0.001 22 0.003 23 0.004 73 0.002 Missing Total c 346,357 55.9 349,875 57.1 366,692 59.0 368,159 57.6 324,396 55.8 1,755,479 57.1 Non-missing Total d 272,986 44.1 262,545 42.9 254,880 41.0 271,355 42.4 256,529 44.2 1,318,295 42.9 Total Observations 619,343 612,420 621,572 639,514 580,925 3,073,774 a NEISS-AIP National Electronic Injury Surveillance System-All Injury Program b LOC location where the injury occurred, RACE race and ethnicity, CAUSE external cause of injury, BDYPT primary body part affected, TYPE work-relatedness, AGE age in years, DISP disposition at emergency department discharge, SEX gender c Missing Total: the cumulative missing where observations had at least one missing variable d Non-missing Total: observations had no missing values Fig. 1 Trends in missing proportions for variables with missingnessa in NEISS-AIPb data from 2014 to 2018. Patient race/ethnicity (RACE) and location of injury (LOC) show the highest proportions of missing data across years (> 30%). aLOC: location where the injury occurred. RACE: race and ethnicity of patient. CAUSE: external cause of injury. BDYPT: primary body part affected. TYPE: work-relatedness. AGE: patient age in year. DISP: disposition at emergency department discharge. SEX: gender of patient. bNEISS-AIP: National Electronic Injury Surveillance System-All Injury Program Simulation study Figure 2 displays the proportions of missingness of data and data patterns in NEISS-AIP for 2018. More than 30% of observations in hospital ED visits were missing information on LOC (33.4%) and RACE (32.4%). Missing data for other key variables ranged from 2.8% to less than 1% (Fig. 2A). In addition, a complex set of overlapping missing data patterns exists among these missing variables (Supplementary Table S2). A Venn diagram (Fig. 2B) was developed to visualize all possible logical relationships among a finite collection of the different missing sets.Fig. 2 Analyzing missing data patterns of NEISS-AIPa 2018 data: A. Bar chart of unweighted counts and proportions for both missing and non-missing datab; B. The Venn diagram for presenting the missing data patternsb. Note: A (Age) and S (Sex) overlay in Fig. 2B and represent small population sizes. A and S both intersect with P (CAUSE) and R (RACE). D (DISP) represents a small population size, and it intersects with L (LOC) only.aNEISS-AIP: National Electronic Injury Surveillance Systems-All Injury Program. bLOC (L): location where the injury occurred. RACE (R): race and ethnicity of patient. CAUSE (P): external cause of injury. BDYPT (B): primary body part affected. TYPE (T): work-relatedness. AGE (A): patient age in year. DISP (D): disposition at emergency department discharge. SEX (S): gender of patient Figure 3 displays the BSS comparison for all the missing categorical variables to visualize the imputation performance difference using two MI methods (JM and FCS). The FCS method far exceeded the JM method in accurately imputing missing data in most instances except for TYPE and SEX, where the two performed almost identically. Overall FCS shows larger BSS than JM, implying that FCS is associated with more accurate predicted probabilities than JM.Fig. 3 Brier Skill Score (BSS)a comparison for evaluating imputation performance on simulation datab by using the different models (JM and FCS). a BSS indicates the degree of skill improvement. A BSS range from 0 to 1: 0 means no improvement in accuracy and 1 means a perfect accuracy of prediction. bSimulation data was developed by imposing the missing data patterns on the subset of fully observed data in National Electronic Injury Surveillance System-All Injury Program (NEISS-AIP) 2018. JM: joint modelling. FCS: fully conditional specification. LOC: location where the injury occurred. RACE: race and ethnicity of patient. CAUSE: external cause of injury. BDYPT: primary body part affected. TYPE: work-relatedness. AGE: patient age in year. DISP: disposition at emergency department discharge. SEX: gender of patient To assess the impact of MI on the overall distribution of race/ethnicity, we determined the distributions before imputation (simulation data) and after imputation (JM or FCS imputed data) and compared them with the true estimates in the standard control data (Figure S1, Supplementary). Before imputation, the race/ethnicity distribution is significantly different from the true proportions of standard control. After imputation, JM tends to underestimate the true proportion for White NH and Other NH, and to overestimate the true proportion for Black NH and Hispanics. Unlike JM, FCS shows the minimal effect on the true overall distribution of race/ethnicity after imputation. Adding the FCS imputed cases of race/ethnicity to the data has little impact on the known overall distribution of the respondents by race/ethnicity. Table 2 shows the comparison of estimated crude rates of nonfatal assault injuries for the White NH group under different approaches for addressing missing racial/ethnic data. Dropping persons with missing race/ethnicity (using CCA) not only causes loss in statistical power but also results in significant bias in rate estimation compared to the standard control rate (32.3% absolute deviation from the true rate). After imputation, the absolute deviations are calculated as 14.1% for JM imputation and only 0.3% for FCS imputation. This simulation provides strong evidence that FCS MI generally produces unbiased estimates when compared with the standard control. FCS MI shows the best overall results for addressing high proportions of missingness in NEISS-AIP data.Table 2 Comparison of the different missing data strategies in the simulation study: estimating crude rate of nonfatal assault injuries treated in EDs (Emergency Departments) per 100,000 population among non-Hispanic white individuals Weighted Number of Injuries Crude Rate per 100,000 Population b 95% CI Absolute Deviation c |Rate-STDSTD| CCA 217,080 244.5 (175.3, 313.7) 32.3% JM MI 275,609 310.4 (223.3, 397.5) 14.1% FCS MI 321,759 362.4 (255.0, 469.8) 0.3% Standard Controla 320,629 361.2 (257.9, 464.5) - The simulation study built on real non-missing data from National Electronic Injury Surveillance System-All Injury Program (NEISS-AIP) 2018 was conducted to identify the appropriate MI model for handling missing data Abbreviations: NH non-Hispanic, CCA complete case analysis, JM joint modeling, MI multiple imputation, FCS fully conditional specification, EDs Emergency Departments a Non-missing data was used as standard control data b Excludes sexual assault cases c Absolute deviation was calculated by using the standard control rate as the reference Assessing disparities using FCS imputed companion data Table 3 displays the estimated age-adjusted average annual rate of nonfatal assault ED visits per 100,000 population by RACE, LOC, and SEX. For the 2014–2018 study period, Black NH persons showed a significantly higher nonfatal assault injury rate per 100,000 population (1306.8) compared to their counterparts (347.8 for White NH persons, 366.0 for Hispanic persons, and 291.2 for Other NH persons). The rate of nonfatal assault injuries was significantly higher in a public setting than at home (286.3 vs. 200.4). Males also had a significantly higher nonfatal assault injury rate compared to females (603.5 vs. 369.5).Table 3 Assessing health disparities using Fully Conditional Specification Imputed Companion Data, NEISS-AIPa, 2014–2018: Estimating Age-adjustedb Average Annual Rate of Nonfatal Assault Injury per 100,000 Population for United States Hospital Emergency Department Visits, by Race/Ethnicity, Location of Injury and Sex Characteristic Categories Unweighted Number of Injuriesd National Estimate (%) Age-adjusted Average Annual Rate (95% CI) T-tests Total ___ 142,876 7,610,896 (100) 486.7 (352.4, 621.1) ___ Race and Ethnicity Black NHc 66,765 3,048,912 (40.1) 1306.8 (660.1, 1953.5) Ref White NH 43,694 3,178,305 (41.8) 347.8 (261.4, 434.1) p = 0.001 Hispanic 24,851 1,046,120 (13.7) 366.0 (136.4, 595.5) p = 0.001 Other NH 7,566 337,560 (4.4) 291.2 (125.1, 457.3) p = 0.001 Location of Injury Public Setting 85,115 4,479,969 (58.9) 286.3 (183.2, 389.4) Ref Home 57,761 3,130,927 (41.1) 200.4 (162.5, 238.3) p = 0.003 Sex Male 90,683 4,754,049 (62.5) 603.5 ( 409.4, 797.5) Ref Female 52,193 2,856,846 (37.5) 369.5 (288.7, 450.4) p = 0.002 a NEISS-AIP: National Electronic Injury Surveillance System-All Injury Program b Age-adjusted to the 2000 U.S. standard population c NH: Non-Hispanic d Excludes sexual assault cases Figure 4 shows the trend for age-adjusted rates per 100,000 persons of nonfatal assault injuries treated in emergency departments by different groups from 2014 to 2018. The significantly higher nonfatal assault injury rates were found for Black NH persons compared with other race/ethnicity categories, regardless of year. In addition, the age-adjusted rates (AAR) for Black NH persons increase significantly from 2014 through 2017 (1147.9 in 2014 vs. 1519.7 in 2017), followed by a significant decline in 2018 (1271.7). Similar trends are also observed for nonfatal assault injuries occurring in public settings and for males. For nonfatal assault injuries occurring in public settings, AAR increased from 2014 through 2017 (264.5 in 2014 vs. 319.9 in 2017) and significantly declined in 2018 (276.8). For males, AAR increased from 2014 to 2017 (592.6 in 2014 vs. 640.1 in 2017) and then declined significantly in 2018 (570.2).Fig. 4 Assessing disparities using imputed NEISS-AIP companion data: trends in age-adjusteda rates per 100,000 population of nonfatal assault injuries treated in emergency departments by (A) race/ethnicity, (B) location of injury, and (C) Sex from 2014 to 2018, United States. aAge-adjusted to the 2000 U.S. standard population. Abbreviations: NEISS-AIP, National Electronic Injury Surveillance System-All Injury Program; AAR, Age-adjusted rate; NH, non-Hispanic Discussion Eliminating health disparities is a central focus of Healthy People 2030 [38]. Injuries are a major public health concern, which cause over 200,000 deaths, and 30 million individuals are treated for injuries in hospitals and emergency departments each year [39]. Significant inequities exist in injury prevention and control in the US as demonstrated by health disparities across age, race, ethnicity, region, sex, etc. Preventing injuries in high-risk groups can have the biggest influence on achieving health equity in injury. To reduce and ultimately eliminate these disparities, the first step is understanding what these disparities are and who is affected by them. Investigating disparities requires an accurate identification and categorization of individuals into different subgroups [3]. Not having key indicators due to missingness, however, is a limitation on the use of NEISS-AIP in investigating disparities in injury. When data are not available, imputation is a method to attribute missing characteristics to specific observations in a data set. To make NEISS-AIP a more useful and reliable data source for the study of health disparities, it is essential to generate imputed companion data that will allow public users to perform analysis on complete datasets. Conducting impactful research on injury disparities requires availability of comprehensive data. Statistical methods for addressing missing values have been actively pursued, including maximum likelihood estimation, Bayesian estimation, and MI. MI is the only technique that is computationally straightforward, versatile, relatively easy to apply, and increasingly available in standard statistical software. MI has arguably been the most popular method for handling missing data in practice [28, 40]. To identify the most appropriate MI model for handling missing data in NEISS-AIP, a comprehensive simulation study built on real non-missing data from NEISS-AIP 2018 was conducted. The FCS model performed better than the JM model for reporting overall racial/ethnic distributions that were closest to that of the standard control and had higher average correct prediction rates. We also developed a new BSS method to assess the accuracy of probabilistic predictions by different approaches for handling missing data. This intuitive BSS comparison clearly showed that FCS MI provided the most accurate imputed data for all missing categorical variables. This is the first application of the developed BSS method for assessing imputation performance quantitatively. Because ignoring the missing race/ethnicity data influences the identification and magnitude of disparities, we further assessed bias by estimating crude rates of nonfatal assault injuries for White NH persons under different approaches for addressing high proportion missingness of race/ethnicity. Our simulation study provides strong evidence that FCS MI yields estimates that are unbiased and provide appropriate coverage. Unlike JM which assumes joint multivariate normality for all variables, FCS specifies the multivariate imputation model on a variable-by- variable basis by a set of conditional densities, one for each incomplete variable. FCS MI permits great flexibility because an appropriate imputation model can be selected for each missing variable [29]. Nonfatal assault injury is an important public health concern, imposing significant health care costs and productivity losses for millions of people each year [3, 13]. However, research on disparities in nonfatal assault injury has not been well characterized, limiting understanding of gaps in research and development of successful interventions. Much of the research on injury disparities in the United States focuses on the differences in injury rates [41]. In this study, we assessed whether disparities exist for age-adjusted average annual rates of nonfatal assault injury for ED visits by race/ethnicity, location of injury, and sex. Results showed that Black NH persons had significantly higher injury rate than other race/ethnicity categories (3.8 times higher than White NH persons, 3.6 times higher than Hispanic persons, and 4.5 times higher than Other NH persons) for the study period (2014–2018). Black NHs persons were at disproportionately high risk for nonfatal assault injuries compared with other race/ethnicity groups. These results underscore the importance of understanding and addressing the underlying inequities, such as limited educational, housing, and occupational opportunities, concentrated poverty, systemic racism, and other aspects of social and economic disadvantage, that contribute to risk for violence [42, 43]. Injuries occurring in public settings had significantly higher average annual rate than injuries occurring at home (1.4 times higher). Males had significantly higher average annual rate than females (1.6 times higher). The trends from 2014 to 2018 in age-adjusted nonfatal assault injury rates by different subgroups were also investigated. Similar trends were observed for Black NH persons, injuries occurring in public settings, and males: AARs of nonfatal assault injury increased significantly from 2014 through 2017, then declined significantly in 2018. Limitations Study limitations exist. First, aggregated racial/ethnic groups were recorded in our analysis. Hispanic origin and race were combined into a single-item format to make them compatible with available annual bridged-race population estimates used as denominators for the injury rates. However, collection and reporting of ethnic and racial identity as two separate constructs is usually preferred, further disaggregating race/ethnicity may assist in better understanding disparities and in development of culturally responsive interventions [4]. Second, the statistical literature has defined three types of missingness mechanisms: missing completely at random (MCAR), missing at random (MAR), and missing not at random (MNAR). MI methods generally assume that the data is at least MAR, and therefore remains valid if observations are MCAR. The MAR assumption is generally considered to be realistic for well-conducted surveys and has been recommended for practical applications [27]. The assumption of MAR becomes more reasonable as more predictors are included in the imputation model [44]. As the NEISS-AIP contain high-quality data with a large amount of predictive information, the MAR assumption can be justified. However, it is impossible to determine whether data are MNAR solely based on observed data. The NEISS-AIP are de‐identified to prevent tracking patients for follow‐up or prior information, so the MNAR assumption cannot be tested. Bias caused by data that are MNAR can be addressed only by sensitivity analyses examining the effect of different assumptions about the missing data mechanism, which is outside the scope of this study. Third, the estimated non-fatal assault injury rates in this study are underestimates of the actual prevalence because data are limited to patients treated in hospital EDs and do not include those who had injuries treated in other health care settings (e.g., physician’s office or urgent care center) or those for whom no treatment was needed or sought. Accordingly, our findings may understate disparities in nonfatal assault injury risk. Conclusions This study is the first to look at health disparities in nonfatal assault injuries using multiply imputed companion data. The developed methods and imputed data sets can also be applied to addressing disparities in other types of injuries. Groups at higher risk of an injury outcome could be identified for local prevention efforts. Health disparities are often viewed through the lens of race and ethnicity, but they occur across a broad range of dimensions. It is necessary to address the underlying social and economic inequities that drive disparities. Communities can make use of the best available evidence to prevent multiple forms of injury [45]. In summary, assessing disparities in injury is crucial for injury prevention and for evaluating injury prevention strategies. We assessed health disparities in nonfatal assault injury by generating multiply imputed companion data. Beyond the methodological insights, this study will also help to advance health disparities research by enhancing efforts to quantify, monitor, and develop solutions for assessing disparities in injury. Supplementary Information Additional file 1. The Supplementary Material for this article can be found. Appendix New BSS method for evaluating imputation performance The Brier Score (BS), which the BSS is developed from, is a measure of the mean-square error of prediction [33]. In the observed events N, let X be a K-level (K > 1) categorical variable with M missing observations x i (i = 1,….M). Denote p ij the predicted probability of a specific level j (j = 1,…. K) of X. For MI with 20 iterations, pij=∑l=120(xil=j)/20, where x il is the imputed value of x i from the lth iteration, l = 1,…20. The BS for MI is given as: 1 BS=1N∑i=1M∑j=1K(Iij-pij)2,(0≤BS≤1) where I ij = 1(0), if the true value of x i is (not) j. BS has a range of 0 to 1, a smaller BS (closer to zero) implies a more precise imputation. For CCA, denote p i, the predicted probability of X. We assume that all the predictions of missing values in the categorical variable X are wrong (xi≠j), which is the worst prediction case. The BS ref for CCA is given as:2 BSref=1N∑i=1M(Ii-pi)2(0≤BSref≤1) where I i = 1(0), if the true value of x i is (not) j. A noted shortcoming of BS is that the score value is often hard to interpret, despite it being a widely used scalar summary of accuracy for probability prediction. Consequently, the BS is frequently converted to a skill score, normalizing the score by that of a reference prediction strategy. BSS indicates the degree of skill improvement. It is designed to range from 1.0 for a perfect prediction strategy, through 0.0 for one that offers no improvement over the reference strategy, to negative values for strategies that are worse than the reference strategy [34, 35]:3 BSS=1-BSBSref,(-∞≤BSS≤1) Negative skill scores often need to be interpreted with caution as they may hide useful information contained in the prediction. However, negative skill scores can be avoided by selecting the appropriate reference strategy. In this study, we chose CCA as the reference strategy (BS ref) to avoid the negative skill scores for the two MI methods. Thus, BSS ranges from 0 to 1, where 0 means no accuracy improvement and 1 means a perfect accuracy improvement. As BSS approaches 1, this implies more accurate predictions for discrete outcomes in missing variables. Acknowledgements We gratefully thank Mark R. Stevens, Charles E. Rose, Andrea Carmichael, Karin Mack, Dana Flanders, Thomas Simon, Christopher J. Earl, Judy Qualters, Sam Caudill, and Tracey Foster–Butler of CDC and Prof. Xu Zhang of University of Texas for their helpful discussion and comments. Disclaimer The findings and conclusions in this paper are those of the authors and do not necessarily represent the official position of the U.S. Centers for Disease Control and Prevention and the U.S. Consumer Product Safety Commission. Authors’ contributions YL: conceptualization, methodology, formal analysis, supervision, and writing original draft. AFW: supervision, funding acquisition, reviewing, and editing. MJK: investigation, reviewing, and editing. TS: data curation, reviewing, and editing. All authors read and approved the final manuscript. Funding No funding. Availability of data and materials The supporting data can be made available upon reasonable request. Declarations Ethics approval and consent to participate This study was approved by the U.S. Centers for Disease Control and Prevention (CDC) Institutional Review Board and was considered a minimal risk study. This manuscript has been gone through and cleared by CDC eClearance system. All participants provide informed written consent to participate in this study. Consent for publication Not applicable. The manuscript does not contain any personal information. Competing Interests The authors declare no competing interests. Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. ==== Refs References 1. CDC. Nonfatal injury data Atlanta, GA: US Department of Health and Human Services, CDC 2017 2. Ballesteros MF Williams DD Mack KA Simon TR Sleet DA The epidemiology of unintentional and violence-related injury morbidity and mortality among children and adolescents in the United States Int J Environ Res Public Health 2018 15 616 635 10.3390/ijerph15040616 29597289 3. Peterson C Miller GF Barnett SB Florence C Economic Cost of Injury — United States, 2019 MMWR 2021 70 1655 1659 34855726 4. Megan M Kelsey MC Molly F Ali R Janessa MG Divya P Research on Injury disparities: a scoping review Health Equity 2019 3 1 504 511 10.1089/heq.2019.0044 31637361 5. Braveman P Health disparities and health equity: concepts and measurement Annu Rev Public Health 2006 27 167 194 10.1146/annurev.publhealth.27.021405.102103 16533114 6. Dehlendorf C Bryant AS Huddleston HG Jacoby VL Fujimoto VY Health disparities: definitions and measurements Am J Obstet Gynecol 2010 202 212 213 10.1016/j.ajog.2009.12.003 20207236 7. Bilheimer LT Klein RJ Data and measurement issues in the analysis of health disparities Health Serv Res 2010 45 1489 1507 10.1111/j.1475-6773.2010.01143.x 21054368 8. Silva G Trivedi AN Gutman R Developing and evaluating methods to impute race/ethnicity in an incomplete dataset Health Serv Outcomes Res Methodol 2019 19 175 195 10.1007/s10742-019-00200-9 9. Brown DP Knapp C Baker K Kaufmann M Using Bayesian imputation to assess racial and ethnic disparities in pediatric performance measures Health Serv Res 2016 51 1095 1108 10.1111/1475-6773.12405 26487321 10. Dembosky JW Haviland AM Haas A Hambarsoomian K Weech-Maldonado R Wilson-Frederick S Indirect estimation of race/ethnicity for survey respondents who do not report race/ethnicity Med Care 2019 57 e28 33 10.1097/MLR.0000000000001011 30520838 11. Ma Y Zhang W Lyman S Huang Y The HCUP SID imputation project: improving statistical inferences for health disparities research by imputing missing race data Health Serv Res 2018 53 1870 1889 10.1111/1475-6773.12704 28474359 12. Klein DJ Elliott MN Haviland AM Morrison P Orr N Gaillot S A comparison of methods for classifying and modeling respondents who endorse multiple racial/ethnic categories Med Care 2019 57 e34 e41 10.1097/MLR.0000000000001012 30439794 13. David-Ferdon CF Haileyesus T Liu Y Simon TR Kresnow M Nonfatal assaults among persons aged 10–24 years – United States, 2001–2015 MMWR 2018 67 141 145 29420463 14. Amanullah S Schlichting LE Linakis SW Steele DW Linakis JG Emergency department visits owing to intentional and unintentional traumatic brain injury among infants in the United States: a population-based assessment J Pediatr 2018 203 259 265 10.1016/j.jpeds.2018.08.023 30266505 15. Ayilara OF Zhang L Sajobi TT Sawatzky R Bohm E Lix LM Impact of missing data on bias and precision when estimating change in patient-reported outcomes from a clinical registry Health Qual Life Outcomes 2019 17 1 9 10.1186/s12955-019-1181-2 30606205 16. Sterne JA White I Carlin JB Spratt M Royston P Kenward MG Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls BMJ 2009 338 2393 2398 10.1136/bmj.b2393 17. Pedersen AB Mikkelsen EM Cronin-Fenton D Kristensen NR Pham TM Pedersen L Missing data and multiple imputation in clinical epidemiological research Clin Epidemiol 2017 9 157 166 10.2147/CLEP.S129785 28352203 18. Huque MH Carlin JB Simpson JA Lee KJ A comparison of multiple imputation methods for missing data in longitudinal studies BMC Med Res Methodol 2018 18 168 184 10.1186/s12874-018-0615-6 30541455 19. Goeij MCM Diepen MV Jager KJ Tripepi G Zoccali C Dekker FW Multiple imputation: dealing with missing data Nephrol Dial Transplant 2013 28 2415 2420 10.1093/ndt/gft221 23729490 20. Thompson CA Boothroyd DB Hastings KG Cullen MR Palaniappan L Rehkopf DH A multiple imputation “forward bridging” approach to address changes in the classification of Asian race/ethnicity on the US death certificate Am J Epidemiol 2018 187 347 357 10.1093/aje/kwx215 29401361 21. Elliott MN Fremont A Morrison PA Pantoja P Lurie N A new method for estimating race/ethnicity and associated disparities where administrative records lack self-reported race/ethnicity Health Serv Res 2008 43 1722 1736 10.1111/j.1475-6773.2008.00854.x 18479410 22. Grundmeier RW Song LH Ramos MJ Fiks AG Elliot MN Fremont A Imputing missing race/ethnicity in pediatric electronic health records: reducing bias with use of U.S. census location and surname data Health Serv Res 2015 50 946 60 10.1111/1475-6773.12295 25759144 23. Xue Y Harel O Aseltine RH Imputing race and ethnic information in administrative health data Health Serv Res 2019 54 957 963 31099021 24. Rubin DB Multiple imputation for nonresponse in surveys 1987 New York John Wiley & Sons, Inc. 25. Nwakuya MT Nwabueze JC Relative efficiency of estimates based on percentages of missingness using three imputation numbers in multiple imputation analysis Eur J Phys Agric Sci 2016 4 63 69 26. Graham JW Olchowski AE Gilreath TD How many imputations are really needed? Some practical clarifications of multiple imputation theory Prev Sci 2007 8 206 213 10.1007/s11121-007-0070-9 17549635 27. Murray JS Multiple imputation: a review of practical and theoretical findings Statist Sci 2018 33 142 159 10.1214/18-STS644 28. Liu Y De A Multiple imputation by fully conditional specification for dealing with missing data in a large epidemiologic study Int J Stat Med Res 2015 4 287 295 10.6000/1929-6029.2015.04.03.7 27429686 29. Pitman JP Wilkinson R Liu Y Finckekstein B Sibinga CTS Lowrance DW Blood component use in a sub-Saharan African country: results of a 4-year evaluation of diagnoses associated with transfusion orders in Namibia Transfus Med Rev 2015 29 45 51 10.1016/j.tmrv.2014.11.003 25573416 30. Harrison KM Kajese T Hall HI Song R Risk factor redistribution of the national HIV/AIDS surveillance data: an alternative approach Public Health Rep 2008 123 618 627 10.1177/003335490812300512 18828417 31. Stuart EA Azur M Frangakis C Leaf P Multiple imputation with large data sets: a case study of the children’s mental health initiative Am J Epidemiol 2009 169 1133 1139 10.1093/aje/kwp026 19318618 32. Lewis, T. PROC SURVEYSELECT as a Tool for Drawing Random Samples. Presented at the annual conference of the Midwest SAS Users Group. Columbus, OH, September 22–24, 2013. http://www.mwsug.org/proceedings/2013/AA/MWSUG-2013-AA02.pdf 33. Brier GW Verification of forecasts expressed in terms of probability Mon Wea Rev 1950 78 1 3 10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2 34. Wilks DS Sampling distributions of the Brier score and Brier skill score under serial dependence R Meteorol Soc 2010 136 2109 2118 10.1002/qj.709 35. Mason SJ. On using “climatology” as a reference strategy in the Brier and ranked probability skill scores. Mon Wea Rev. 2004;132(7):1891–5. 36. Ingram DD, Parker JD, Schenker N, Weed JA, Hamilton B, Arias E, Madans JH. United States Census 2000 population with bridged race categories. Vital Health Stat 2. 2003;135:1–55. 37. U.S. National Cancer Institute, Surveillance, Epidemiology, and End Results Program Race and hispanic ethnicity changes 2022 38. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. Healthy People 2030. 2020. https://www.healthypeople.gov. 39. Centers for Disease Control and Prevention Cost of injuries and violence in the United States—Injury Center 2018 40. Dong Y Peng CY Principled missing data methods for researchers Springerplus 2013 2 222 239 10.1186/2193-1801-2-222 23853744 41. Seabury SA Terp S Boden LI Racial and ethnic differences in the frequency of workplace injuries and the prevalence of work-related disability Health Aff 2017 36 266 273 10.1377/hlthaff.2016.1185 42. Sheats KJ Irving SM Mercy JA Simon TR Crosby AE Ford DC Violence-related disparities experienced by black youth and young adults: opportunities for prevention Am J Prev Med 2018 55 462 469 10.1016/j.amepre.2018.05.017 30139709 43. Bailey ZD Krieger N Agénor M Structural racism and health inequities in the USA: evidence and interventions Lancet 2017 389 1453 1463 10.1016/S0140-6736(17)30569-X 28402827 44. Little RJA Rubin DB Statistical Analysis with Missing Data 2003 New York John Wiley & Son 45. CDC. Technical Packages for Violence Prevention. Atlanta, GA: US Department of Health and Human Services, CDC; 2021. https://www.cdc.gov/violenceprevention/communicationresources/pub/technical-packages.html