
==== Front
Int J Sports Phys Ther
Int J Sports Phys Ther
2159
International Journal of Sports Physical Therapy
2159-2896
NASMI Website: International Journal of Sports Physical Therapy

35136692
31178
10.26603/001c.31178
Original Research
Comparison of Concurrent and Same-Day Balance Measurement Approaches in a Large Sample of Uninjured Collegiate Athletes
Saalfield Jessica 1
Piersol Kelsey L. 1
Monaco Robert 2
Womack Jason 3
Weismiller Scott A 4
Esopenko Carrie 5
Todaro Sabrina M 6
Conway Fiona N 7
Brostrand Kyle 8
https://orcid.org/0000-0002-1898-5499
Buckman Jennifer F. 9
1 Department of Kinesiology and Health Rutgers University, New Brunswick, NJ, USA
2 Atlantic Sports Health, Morristown, NJ, USA
3 Department of Family Medicine & Community Health, Robert Wood Johnson Medical School, Rutgers University, New Brunswick, NJ, USA; Department of Athletics, Rutgers University, New Brunswick, NJ, USA
4 Dept. of Internal Medicine, Penn State Health, Milton S. Hersey Medical Center, Hershey, PA, US
5 Department of Rehabilitation and Movement Sciences Rutgers Biomedical and Health Sciences, Newark, NJ, USA
6 Center of Alcohol and Substance Use Studies Rutgers University, New Brunswick, NJ, USA
7 Steve Hicks School of Social Work University of Texas at Austin, Austin, TX, USA
8 Robert Wood Johnson Barnabas Health – Rutgers Sports Medicine Rutgers University, New Brunswick, NJ, USA
9 Department of Kinesiology and Health, Rutgers University, New Brunswick, NJ, USA; Center of Alcohol and Substance Use Studies, Rutgers University, New Brunswick, NJ, USA
Current affiliation: Department of Psychology, Pennsylvania State University – Schuykill

Corresponding author: Jennifer Buckman, Rutgers University – New Brunswick, Smithers Hall, 607 Allison Road, Piscataway, NJ 08954. 848-445-0793. Email:jbuckman@rutgers.edu
1 2 2022
2022
17 2 228236
18 6 2021
23 11 2021
© The Author(s)
https://creativecommons.org/licenses/by-nc/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial License (4.0) which permits non-commercial use, distribution, and reproduction in any medium, provided the original author and source are credited.

Background

Measures of postural stability are useful in assisting the diagnosing and managing of athlete concussion. Error counting using the Balance Error Scoring System (BESS) is the clinical standard, but has notable limitations. New technologies offer the potential to increase precision and optimize testing protocols; however, whether these devices enhance clinical assessment remains unclear.

Purpose

To examine the relationships between metrics of balance performance using different measurement systems in uninjured, healthy collegiate athletes.

Study Design

Cross-sectional.

Methods

Five hundred and thirty uninjured collegiate athletes were tested using the C3Logix app, which computes ellipsoid volume as a measure of postural stability during the six standard BESS conditions, while concurrently, errors were manually counted during each condition per standard BESS protocols. The association between concurrently measured ellipsoid volumes and error counts were examined with Spearman’s correlations. From this sample, 177 participants also performed two double-leg conditions on the Biodex BioSway force plate system on the same day. This system computes Sway Index as a measure of postural stability. The association of ellipsoid volume (C3Logix) and Sway Index (Biodex) was examined with Spearman’s correlations. Individual-level data were plotted to visually depict the relationships.

Results

C3Logix ellipsoid volume and concurrently recorded error counts were significantly correlated in five of the six BESS conditions (rs:.22-.62; p< 0.0001). C3Logix ellipsoid volume and Biodex Sway Index were significantly correlated in both conditions (rs=.22-.27, p< 0.004). However, substantial variability was shown in postural stability across all three measurement approaches.

Conclusion

Modest correlation coefficients between simultaneous and same-day balance assessments in uninjured collegiate athletes suggest a need to further optimize clinical protocols for concussion diagnosis.

Level of Evidence

2b

postural stability
force plate
balance
accelerometry
This project was funded in part by the NJ Commission on Brain Injury Research (NJCBIR13IRG028) and NIH/NIAAA (K02AA025123) to J.F.B., and NIH Institutional Research and Academic Career Development Award (IRACDA) K12GM093854 to J.S. Financial support was provided to C.E. through the School of Health Professions at Rutgers Biomedical and Health Sciences.
==== Body
pmcINTRODUCTION

Healthcare providers routinely assess postural stability as part of the diagnosis and management of sport-related concussion.1,2 Numerous research tools and protocols have been developed to quantify alterations in postural stability and parse the nature of disruptions in the postural control system;3 however, it remains unclear whether objective measurement systems provide a more comprehensive clinical picture than rater-assessed tests. A critical first step in determining this is to understand the relationship between different measurement systems in a large, healthy sample. The current study assesses three measures of postural stability that were collected on the same day in a large sample of uninjured NCAA Division I collegiate athletes.

The Balance Error Scoring System (BESS) is one of the most used concussion diagnosis assessments due to its ease of administration, portability, and low cost. The BESS uses a series of closed-eye stances on firm and foam testing surfaces to characterize postural stability under conditions of varying difficulty.4 Despite its popularity in athletics for concussion diagnosis and return-to-play judgements, the BESS has notable limitations. The BESS can detect changes in gross postural stability post-injury5–7 but may have limited utility beyond three days post-injury8,9 due to its reliance on subjective ratings and suboptimal interrater reliability.8,10,11 Large changes in BESS scores may be necessary to overcome rater variability and provide meaningful detection of postural stability alterations.10 Additional concerns are its limited sensitivity in detecting postural stability deficits post-injury when compared to an individualized pre-injury baseline measurement12–14 or to matched uninjured controls12,15–17 along with substantial floor and ceiling effects in uninjured samples.18–20

In research settings, force plates are preferred for assessing postural stability due to their precision, robust quantification, and ability to assess a variety of stances and balance protocols. Force plate technologies include, but are not limited to, the BioSway (Biodex Medical Systems, Inc., Shirley, NY), the NeuroCom Balance Master (Cephalon, Norresundby, Denmark), and Bertec (Bertec, Columbus, OH), and have been used to evaluate changes in postural stability following concussion.21–24 Despite providing greater precision and a variety of derived stability measures, force plates are more expensive and less portable than the BESS and therefore may have limited accessibility and feasibility for clinical or sideline assessments. Moreover, a recent study of a large NCAA Division I athlete sample revealed sizable heterogeneity of individual balance performance measured using a force plate system.25 This raises questions of whether the precision of such postural stability measures is necessary for monitoring an athlete’s diagnosis of, and recovery from concussion.

The past decade has seen the development of numerous mobile-based instrumented measurements of postural stability.26 Mobile applications (i.e., apps), such as C3Logix (NeuroLogix Technologies, Inc., Cleveland, OH), use inertial sensors such as accelerometers and gyroscopes to capture accelerations of the total body center of mass across multiple planes of motion.27 These apps, when integrated with existing balance protocols, such as the BESS, hold promise for the diagnosis and management of athlete concussion because they combine the ease of administration of the traditional BESS with the option to augment rater-assessed errors with objective measures using a portable device. Although these apps are touted as being more affordable and portable than force plates, findings regarding reliability and validity are mixed.4,19,26,28–31 Inertial sensors have been shown to augment subjective balance measures, such as error counts using the BESS.19 Instrumenting the BESS, or its modified version, with an inertial sensor improved psychometric value32 and sensitivity to detect differences between concussed and non-concussed individuals14,15,17,33 compared to error counts alone. However, no large studies of balance performance using mobile inertial sensor measurement systems in collegiate athletes exists.

The purpose of this study was to examine the relationships between metrics of balance performance using different measurement systems in uninjured, healthy collegiate athletes. It was hypothesized that there would be significant positive, within-person correlations between ellipsoid volumes, as measured with inertial sensors, and error counts on the BESS when these measurements were collected concurrently. It was further hypothesized significant positive, within-person correlations between ellipsoid volumes, as measured by inertial sensors, and Sway Index scores, as measured using a force plate system when the measurements were collected on the same day, but not concurrently.

METHODS

Participants

Collegiate athletes 17-23 years of age were recruited from a northeastern US university during standard pre-participation physicals that took place during entry into the athletic program (2013 – 2016). All uninjured members of the university’s 22 NCAA Division I athletic teams who received medical clearance for athletic participation were invited to participate. Participation was voluntary and written informed consent was obtained from 703 athletes. Of those, balance data were obtained from 534 (19.4 +/- 1.2 years at time of consent; 47% female). This study was approved by the university’s institutional review board.

Procedures and Variables

All postural stability data were collected in the Department of Sports Medicine as part of standard physical exam and health screening assessments. Participants completed one or two balance assessments depending on the year of recruitment and time constraints of the athletes and clinical staff. Of the full sample that was tested using the C3Logix app (n=534), 177 participants from 21 teams were also tested using the Biodex Biosway force plate system on the same day (18.9 +/- 1.0 years at time of consent; 45% female); Biosway data collected on a different day was not used for the present analyses. In all instances where two balance assessments were performed on the same day, BioSway testing was performed before C3Logix. Prior to beginning balance testing, participants were asked to identify their dominant foot (e.g., “push off or power foot”, “the foot you jump off to dunk”, or “3-pt stance foot”). Balance assessments were performed in socks, took less than five minutes per athlete and were administered by medical staff, certified athletic trainers, or trained graduate-level research assistants. All participants received instructions from the test administrator via a common script.

Demographics. Age, sex, height, and weight were obtained from medical charts completed by the Department of Sports Medicine as part of standard pre-participation physical exam. Medical chart review was a separate component of the larger study that examined factors that predicted concussion risk and recovery rates and some charts were unavailable at the time of review. Data from these clinical records were available to the research staff for approximately 75% of participants (216 men, 192 women). Table 1 reports estimates of athletic team demographics based on available data.

78479 Table 1. Participant demographics by team

SPORT	Total sample (n)	Same day sample (n)	Agea Mean (SD), years	Heighta Mean (SD), inches	Weighta Mean (SD), pounds	
Men’s teamsb	283	98	18.4 (1.0)	72.0 (3.0)	194.6 (38.1)	
Baseball	23	14	18.2 (0.7)	71.9 (2.5)	179.7 (19.7)	
Basketball	18	5	19.0 (1.2)	75.8 (4.1)	202.8 (35.0)	
Football	80	25	18.6 (1.0)	73.2 (2.8)	218.4 (42.3)	
Lacrosse	47	16	18.3 (1.0)	71.6 (2.0)	187.2 (23.1)	
Soccer	33	12	18.4 (1.0)	70.3 (2.0)	163.7 (14.1)	
Track	40	14	18.3 (0.8)	71.9 (2.0)	171.9 (20.1)	
Wrestling	39	9	18.5 (1.2)	69.5 (2.4)	186.2 (44.7)	
						
Women’s teamsb	247	79	18.0 (1.0)	66.3 (3.0)	139.1 (21.0)	
Basketball	18	4	18.2 (0.9)	69.1 (3.7)	159.1 (30.5)	
Crew	14	11	17.9 (0.4)	67.4 (3.2)	146.1 (24.6)	
Field Hockey	25	6	17.8 (0.4)	65.3 (1.4)	132.1 (22.0)	
Gymnastics	16	1	18.3 (3.0)	61.7 (1.8)	125.0 (18.8)	
Lacrosse	35	13	17.8 (0.5)	66.2 (2.5)	140.2 (17.0)	
Soccer	41	10	18.1 (0.8)	65.7 (2.5)	138.6 (16.2)	
Softball	17	6	17.9 (0.8)	67.0 (2.2)	149.4 (17.6)	
Swim/Dive	20	8	17.9 (0.5)	65.9 (2.0)	140.5 (15.0)	
Tennis	4	0	18.5 (1.0)	65.6 (4.2)	124.4 (22.8)	
Track	39	11	18.0 (1.0)	66.6 (2.9)	128.1 (16.5)	
Volleyball	14	5	18.4 (0.8)	70.8 (1.5)	158.3 (16.3)	
a Data were obtained from medical chart records from approximately 75% of participants’ pre-participation physicals; b totals by sex; also include teams (golf and cross-country) with only 1-2 participants that are not shown here.

C3Logix. C3Logix (NeuroLogix Technologies, Inc., Cleveland, OH) is an iPad-based comprehensive concussion management system that combines standard BESS error counting with inertial sensor (accelerometer and gyroscope) data.19,34 Participants were assisted with placing a custom-built belt that securely held the iPad at approximately sacral height, with the screen of the device facing away from the back of the body according to C3Logix instructions. Participants were told to close their eyes and place their hands on their hips. The administrator initiated the test by pressing the button on the C3Logix app screen. Following a countdown, an auditory cue announced the start and end of each of six 20-s conditions that parallel those used by BESS: double leg, single leg, and tandem leg stances, first on a firm surface and then on a standard, six-inch thick Airex foam pad. During each condition, the C3Logix app records all postural movement and calculates ellipsoid volumes19 while the administrator manually counts the number of errors using standard BESS procedures (hands off of the hips; eyes opened; a step, stumble, or fall; hip flexed or abducted beyond 30°; forefoot or heel lifted off of the testing surface; or out of proper test position for > 5 s) and records it in the app.4 Larger ellipsoid volumes and more errors indicate a more unsteady posture.

BioSway. BioSway (Biodex Medical Systems, Inc., Shirley, NY) is a portable force plate system.35,36 Participants were asked to stand on the device with their hands at their sides, look straight ahead, and remain as motionless as possible during measurement. As necessary, heels were repositioned to ensure feet were equidistant and comfortably placed. The administrator pressed the ‘Collect Data’ button to initiate the countdown and start the protocol. Participants completed four 20-s double leg stance conditions per the standard Modified Clinical Test of Sensory Interaction in Balance (mCTSIB) protocol:37 eyes open or eyes closed, on a firm surface (BioSway platform) or a foam surface (standard, six-inch thick Airex foam pad placed on the BioSway platform). The device recorded average movement from center, which is termed Stability Index. The standard deviation of Stability Index was used to compute Sway Index.35 Higher Sway Index is indicative of greater posture instability. The present data are derived from a previously published larger dataset25 and include only those individuals who were tested with C3Logix and BioSway on the same day and only during the double leg, eyes closed, firm surface (double leg/firm surface) and double leg, eyes closed, foam surface (double leg/foam surface) conditions as they parallel those measured by C3Logix.

Statistical Analysis

Univariate analyses were performed using SAS 9.4 (SAS Institute, Cary, NC) to determine the balance characteristics of the whole sample and assess distributional assumptions for analyses. From C3Logix, data from each of the six conditions (double leg/firm surface, tandem leg/firm surface, single leg/firm surface, double leg/foam surface, tandem leg/foam surface, single leg/foam surface) were assessed separately. Raw ellipsoidal volumes of motion data were downloaded from the C3Logix app, a constant (+1) was added for ease of graphical interpretation, and data were log transformed to eliminate violations of homogeneity of variance. Ellipsoidal volume data from four individuals were excluded because they exceeded realistic expectations of a normal baseline test (i.e., >3 standard deviations from next highest score; final n = 530). Spearman’s rank-order correlational analyses were used to evaluate the relationship of concurrent error counts and ellipsoid volumes for each condition. From BioSway, Sway Index data from two conditions (double leg/firm surface and double leg/foam surface) were downloaded because they were the only conditions for which C3Logix collected parallel data. Only data from individuals who completed the BioSway and C3Logix protocols on the same day were included in the present analyses (n = 177). Sway Index scores were log transformed and their relationship to C3Logix ellipsoid volumes during parallel conditions was tested using Spearman’s rank-order correlations. These data were then normalized using z-score transformations for graphical interpretation.

RESULTS

Table 2 presents normative data from the C3Logix app, including average number of errors, percent of participants showing no errors, and raw ellipsoid volumes for each condition. Errors were uncommon in the double leg/firm surface condition (1%). Errors were more common in all other conditions, and 20% of the sample demonstrated maximal error counts (10+) in the single leg/foam surface condition. Substantial individual variability in ellipsoid volumes was noted across all conditions except the double leg/firm surface condition. The wide distribution of ellipsoid volumes calculated by C3Logix is also evident in Figure 1, which shows ellipsoid volumes by error counts for each of the six conditions.

78480 Table 2. C3Logix Sample Averages: Error counts and raw ellipsoid volumes for each BESS condition from 530 uninjured prospective collegiate athletes.

Condition	Errors	% with 0 errors	Raw Ellipsoid Volume	
Double leg/firm surface	0.0 (0.1)	99	0.01 (0.02)	
Tandem leg/firm surface	1.1 (1.4)	44	0.77 (1.54)	
Single leg/firm surface	2.9 (2.3)	14	4.19 (11.85)	
Double leg/foam surface	0.3 (0.9)	84	0.22 (0.66)	
Tandem leg/foam surface	3.8 (2.5)	8	13.23 (21.34)	
Single leg/foam surface	6.8 (2.3)	<1	22.79 (45.82)	
Errors and raw ellipsoid volumes are presented as Mean (SD).

78481 Figure 1. C3Logix Balance Assessments.

Log-transformed ellipsoid volumes of motion from a sample of 530 uninjured athletes were plotted by the number of BESS errors recorded during each of the 20-s conditions. (A) Double Leg/Firm Surface condition. (B) Double Leg/Foam Surface condition. (C) Tandem Leg/Firm Surface condition. (D) Tandem Leg/Foam Surface condition. (E) Single Leg/Firm Surface condition. (F) Single Leg/Foam Surface condition. Circles represent individual data points.

C3Logix: Comparison of error counts vs. ellipsoid volumes of motion

Spearman correlation analyses of error counts and log-transformed ellipsoid volumes, collected concurrently with C3Logix, revealed significant correlations in the tandem leg/firm surface, rS (526) = .68, p < 0.0001, and single leg/firm surface rS (526) = .58, p < 0.0001, conditions, but not in the double leg/firm surface condition, rS (526) = -.02, p= 0.7139. Errors and log ellipsoid volume were also significantly correlated in all three stances completed on the foam pad: double leg, rS (526) = .22, p < 0.0001, tandem leg, rS (526) = .62, p < 0.0001, and single leg, rS (526) =.22, p < 0.0001. Visual inspection of Figure 1 confirms these relationships with trend lines, but also illustrates the magnitude of sample variance, especially on the harder stances. To further characterize the nature of the relationships, the two single leg and tandem leg correlational data were also graphed by sex (Figure 2) and by team, using five teams with large samples (women’s lacrosse n = 35, men’s lacrosse n = 47, women’s soccer n = 41, men’s soccer n = 33, football n = 80; Figure 3).

78786 Figure 2. C3Logix balance assessment correlations separated by sex.

Log-transformed ellipsoid volumes of motion from men (open circles) and women (closed circles) were plotted by the number of BESS errors recorded. (A) Tandem Leg/Firm Surface condition. (B) Tandem Leg/Foam Surface condition. (C) Single Leg/Firm Surface condition. (D) Single Leg/Foam Surface condition. Circles represent individual data points.

78787 Figure 3. C3Logix balance assessment correlations from five teams separated by sport.

Log-transformed ellipsoid volumes of motion from men’s and women’s soccer, men’s and women’s lacrosse, and football were plotted by the number of BESS errors recorded. (A) Tandem Leg/Firm Surface condition. (B) Tandem Leg/Foam Surface condition. (C) Single Leg/Firm Surface condition. (D) Single Leg/Foam Surface condition. Markers represent individual data points.

C3Logix vs BioSway: Comparison of ellipsoid volumes of motion to Sway Index scores

Data from the subset of the sample who completed the C3Logix and BioSway protocols on the same day were then analyzed to determine whether the two technologies provide similar rankings of postural stability. Spearman correlation analyses of log-transformed ellipsoid volumes (C3Logix) and Sway Index scores (BioSway) revealed significant correlation in the double leg/firm surface condition, rS (175) = .27, p= 0.0003, and the double leg/foam surface condition, rS (175) = .22, p= 0.0032. Although statistically significant, the relationship of the two same-day balance measurements showed substantial variability. Therefore, to visualize the nature of these correlations, Figure 4 presents data from the foam surface condition after normalization with z-score transformations. In Figure 4, each participant’s Sway Index (black circles), which were measured first, were ranked and plotted in ascending order on the x-axis. Ellipsoid volume z-scores (gray crosses) were plotted to align vertically with the Sway Index z-scores (i.e., ellipsoid volumes were plotted in order of Sway Index z-scores). Several outliers are evident among the Sway Index z-scores, but removal of these values did not substantively change the correlation results.

78482 Figure 4. Association of same-day objective balance assessments from C3Logix and BioSway collected during the Double Leg/Foam Surface condition.

Individual BioSway Sway Index scores were z-score transformed and plotted in ascending order (from best balance [lowest z-score] to worst balance [highest z-score]) across the x-axis. C3Logix ellipsoid volumes were transformed into z-scores and plotted in order of the individual’s Sway Index score to align each participant’s two data points vertically. A negative z-score implies better than average balance. Several outliers on the BioSway protocol are evident.

DISCUSSION

The present study assessed postural stability in a large sample of uninjured collegiate athletes using different measurement systems. Statistically significant correlations were observed but many of the correlation coefficients were modest (rS < .30) and varied by condition and across modalities. Graphical illustration of individual data offer insights into how and why this may be the case.

C3Logix: Comparison of error counts vs. ellipsoid volumes of motion

This is the first large dataset available in uninjured collegiate athletes from which the nature of an inertial sensor-based balance measurement and its relation to rater-assessed BESS error counts can be considered. These data may be valuable as a normative dataset for C3Logix balance assessments in collegiate athletes. However, Figure 1 reveals that the use of normative averages for ellipsoid volume as proxy measures of baseline performance may be problematic due to the large sample variance, which was evident across nearly all error count levels in the tandem and single leg conditions. This is paralleled by large sample variance in error counts which ranged from none to maximal for the three more difficult stances. Furthermore, in many conditions, the relationship between errors and average ellipsoid volumes appears non-linear across the range of error counts. For example, in the tandem leg/foam surface condition (Figure 1), average ellipsoid volumes do not substantively vary across four to nine errors. Thus, in a sample of age-restricted, young, fit, and uninjured adults, there is substantial baseline heterogeneity on both measures of postural stability. Although there were no a priori hypotheses about sex differences or sport differences, graphs were created to visually assess patterns by sex (Figure 2) or specific teams (Figure 3); none were evident. It may therefore be speculated that the non-linear relationship between measures may reflect subtle differences in balance strategies or adjustments used among individuals.19

Rank order of individual ellipsoid volumes and errors from C3Logix were significantly positively correlated, particularly during the moderately difficult, firm surface conditions; this is in line with Simon et al.31 These correlations were hypothesized because both measurement modalities exhibit construct validity for postural stability and because an acute postural adjustment, such as a step, stumble, or fall, would count as an error and simultaneously increase ellipsoid volume. However, even the strongest correlation, observed in the tandem leg/firm surface condition (rS = .68), was lower than would be expected when assessing the same construct concurrently, especially considering the age and health of this sample. This further supports that individuals utilize different strategies to maintain postural stability19 and that objective measures may provide more insight into these patterns than subjective observations.

In the double leg conditions, which are considered easier, a “floor” effect in error counts and ellipsoid volumes is clear. This effect has been shown to negatively impact reliability of the BESS, particularly during the double leg conditions,20 but does not have the same impact on C3Logix reliability.31 While floor effects are less than ideal from a statistical perspective due to their restriction of sample variance, they may be clinically useful. Based on the results of this study, a clinician should reasonably expect that during the double leg stances, an athlete or young adult would show no errors and have very small ellipsoid volumes if they are uninjured; any deviation from this “floor” may indicate clinically relevant alterations in postural stability. This aligns with a recent study that reported greater ellipsoid volumes in athletes after concussion compared to pre-injury, but only in the double leg/firm surface condition.14

The C3Logix app provides potential advantages for concussion diagnosis and recovery beyond clinician-rated BESS error counts, including precise quantification less prone to interrater variability and long-term data storage, without the need to add additional balance protocols to concussion assessment batteries. This may be especially notable if ellipsoid volume is sensitive enough to detect clinically relevant disturbances in postural stability using only the double leg, firm surface condition. Securing an iPad around the waist adds very little burden to the clinician and patient within a controlled environment; however, the utility of an iPad during sideline testing should be assessed. Special considerations including testing surface (i.e., turf or court), shoe type (i.e., cleats, barefoot, or sneakers), personal padding or equipment, and the clinician-patient burden of securing the iPad quickly and effectively during a high stress and time sensitive situation remain to be investigated.

C3Logix vs BioSway: Comparison of ellipsoid volumes and Sway Index

This study also assessed postural stability measured with two objective balance measurement systems (C3Logix and BioSway) at different time points on the same day. Although statistically significant, the magnitude of the correlations (rs’s < .30) was surprisingly low. Previous studies have supported the validity of inertial sensors for postural stability assessments, but agreement may be dependent on the parameters measured and sensor location on the body.27 The weak correlations in the current study appear to be partially due to differences in calculated parameters between the devices as opposed to sensor location (i.e., sacral placement of iPad vs. underfoot center of pressure from force plate). For example, the C3Logix app, placed at the sacrum, computes ellipsoid volume using the acceleration of the center of mass along anterior-posterior, medial-lateral, and trunk rotational planes of motion.19 Thus, ellipsoid volume considers the rate of change in position and speed over time. Contrary to the weak correlations between C3Logix and the BioSway force plate in the current study, the VSR Sport force plate sway velocity (NeuroCom, Clackamas, OR) demonstrated strong correlations with C3Logix ellipsoid volume.30 Similar to the accelerations captured by ellipsoid volume, sway velocity measures changes in position over time. The BioSway, however, computes Sway Index by taking the standard deviation of the person’s average position relative to center,35 but does not consider rate of change over time. It is reasonable to suggest that this may partly explain the strong correlations shown by Miyashita et al.30 and the weak correlations shown in the current study. Further, the differences in results may be due to concurrent assessment in a small, single sport sample versus non-concurrent assessment analyzed in the current, large, multi-sport sample.

Limitations and Future Directions

Despite the strengths of this study, including the use of a large and multi-sport sample assessed on three balance modalities, there are several limitations. The current study was a component of a larger study designed to prospectively track concussion; therefore, the balance protocols were not designed to provide concurrent assessment of C3Logix and BioSway, nor were tester reliability indices assessed. Data are from Division I athletes from a single university and while including athletes from 22 sports, results may not be generalizable to all collegiate athletes. Graphs were created to allow visual inspection of whether correlations may have systematically varied by sex or sport, but none were observed. Corresponding statistical analyses of sex and sport differences were not performed due to a lack of a priori hypotheses and, in the case of sport, insufficient power. Future studies that are designed and powered to assess such correlational patterns are thus still needed. Subsequent psychometric testing should be performed to comprehensively characterize the relationship between balance measurement approaches. In addition, future research should weigh parameter sensitivity for detecting postural stability deficits against clinician-patient burden to optimize clinical protocols. Such research should further determine the measurement modality that is the most appropriate for real-time sideline concussion assessment.

CONCLUSION

Substantial inter-individual variability in postural stability was observed in this sample of young, uninjured athletes, regardless of the assessment method used. The lower-than-expected correlation coefficients between simultaneous and same-day assessments of balance raise questions about the reliability of normative or individual baseline balance measurements for use in “change from baseline” approaches to injury diagnosis. Postural stability is a complex construct and different measurement systems may be providing unique information about the strategies or postural adjustments that individuals utilize to maintain balance. Further research is needed in order to determine and recommend the most optimal postural stability measurement system and metric for use in concussion sideline assessments, diagnoses, and recovery.

Conflict of Interest

None of the authors declare a conflict of interest.
==== Refs
What domains of clinical function should be assessed after sport-related concussion? A systematic review. British journal of sports medicine Feddermann-Demont Nina Echemendia Ruben J Schneider Kathryn J Solomon Gary S Hayden K Alix Turner Michael Dvořák Jiří Straumann Dominik Tarnutzer Alexander A 6 2017
51 11 903 918 1473-0480 10.1136/bjsports-2016-097403 29098983
The Sport Concussion Assessment Tool 5th edition (SCAT5): Background and rationale British journal of sports medicine Echemendia Ruben J. Meeuwisse Willem McCrory Paul Davis Gavin A. Putukian Margot Leddy John Makdissi Michael Sullivan S. John Broglio Steven P. Raftery Martin Schneider Kathryn Kissick James McCrea Michael Dvořák Jiří Sills Allen K. Aubry Mark Engebretsen Lars Loosemore Mike Fuller Gordon Kutcher Jeffrey Ellenbogen Richard Guskiewicz Kevin Patricios Jon Herring Stanley 2017
51 11 848 850 1473-0480 10.1136/bjsports-2017-097506 28446453
Challenging concussed athletes: The future of balance assessment in concussion QJM Johnston William Coughlan Garrett F. Caulfield Brian 2017
110 12 779 783 1460-2393 10.1093/qjmed/hcw228 28040709
Relationship between clinical and forceplate measures of postural stability Journal of Sport Rehabilitation Riemann B L Guskiewicz K M Shields E W 1999
8 2 71 82 10.1123/jsr.8.2.71
Comparison of the balance accelerometer measure and balance error scoring system in adolescent concussions in sports Am J Sport Med Furman G R Lin C C Bellanca J L Marchetti G F Collins M W Whitney S L 2013
41 6 1404 1410 10.1177/0363546513484446 1552-3365 Furman, Gabriel R Lin, Chia-Cheng Bellanca, Jennica L Marchetti, Gregory F Collins, Michael W Whitney, Susan L P30 AG024827/AG/NIA NIH HHS/United States Comparative Study Journal Article Research Support, Non-U.S. Gov't Am J Sports Med. 2013 Jun;41(6):1404-10. doi: 10.1177/0363546513484446. Epub 2013 Apr 12. 23585486
Effects of mild head injury on postural stability as measured through clinical balance testing Journal of Athletic Training Riemann B L Guskiewicz K M 2000
35 1 19 25 16558603
Postural stability and neuropsychological deficits after concussion in collegiate athletes Journal of Athletic Training Guskiewicz K M Ross S E Marshall S W 2001
36 3 263 273 12937495
Reliability and validity evidence of multiple balance assessments in athletes with a concussion Journal of Athletic Training Murray Nicholas Salvatore Anthony Powell Douglas Reed-Jones Rebecca 2014
49 4 540 549 1062-6050 10.4085/1062-6050-49.3.32 24933431
Assessing postural stability in the concussed athlete: what to do, what to expect, and when Sports Health Ruhe A Fejer R Gänsslen A Klein W 2014
6 5 427 433 1941-7381 (Print) 1941-0921 10.1177/1941738114541238 1941-0921 Ruhe, Alexander Fejer, René Gänsslen, Axel Klein, Wolfgang Journal Article Sports Health. 2014 Sep;6(5):427-33. doi: 10.1177/1941738114541238. 25177420
Intrarater and interrater reliability of the Balance Error Scoring System (BESS) Pm r Finnoff J T Peterson V J Hollman J H Smith J 2009
1 1 50 54 1934-1482 (Print) 1934-1482 10.1016/j.pmrj.2008.06.002 Finnoff, Jonathan T Peterson, Valerie J Hollman, John H Smith, Jay Journal Article Validation Study United States PM R. 2009 Jan;1(1):50-4. doi: 10.1016/j.pmrj.2008.06.002. Epub 2008 Dec 10. 19627872
Systematic review of the balance error scoring system Sports Health Bell D R Guskiewicz K M Clark M A Padua D A 2011
3 3 287 295 1941-7381 (Print) 1941-0921 10.1177/1941738111403122 1941-0921 Bell, David R Guskiewicz, Kevin M Clark, Micheal A Padua, Darin A Journal Article Sports Health. 2011 May;3(3):287-95. doi: 10.1177/1941738111403122. 23016020
Determining sensitivity and specificity of the Sport Concussion Assessment Tool 3 (SCAT3) components in university athletes Brain Inj Downey R I Hutchison M G Comper P 2018
32 11 1345 1352 0269-9052 10.1080/02699052.2018.1484166 1362-301x Downey, Rachel I Orcid: 0000-0001-7045-5121 Hutchison, Michael G Comper, Paul Journal Article Research Support, Non-U.S. Gov't England Brain Inj. 2018;32(11):1345-1352. doi: 10.1080/02699052.2018.1484166. Epub 2018 Jun 14. 29902070
Sensitivity and specificity of the Modified Balance Error Scoring System in concussed collegiate student athletes Clin J Sport Med Buckley T A Munkasy B A Clouse B P 2018
28 2 174 176 10.1097/jsm.0000000000000426 1536-3724 Buckley, Thomas A Munkasy, Barry A Clouse, Brandy P Journal Article Observational Study United States Clin J Sport Med. 2018 Mar;28(2):174-176. doi: 10.1097/JSM.0000000000000426. 28454123
Assessing the effects of concussion using the C3Logix Test Battery: An exploratory study Appl Neuropsychol Adult Bernstein J P K Calamia M Pratt J Mullenix S 2019
1 8 2327-9109 (Electronic) 2327-9095 (Linking) 10.1080/23279095.2017.1416471 29308917
Instrumenting the Balance Error Scoring System for use with patients reporting persistent balance problems after mild traumatic brain injury Archives of Physical Medicine and Rehabilitation King Laurie A Horak Fay B Mancini Martina Pierce Donald Priest Kelsey C Chesnutt James Sullivan Patrick Chapman Julie C 2 2014
95 2 353 359 0003-9993 10.1016/j.apmr.2013.10.015 1532-821x King, Laurie A Horak, Fay B Mancini, Martina Pierce, Donald Priest, Kelsey C Chesnutt, James Sullivan, Patrick Chapman, Julie C KL2TR000152/TR/NCATS NIH HHS/United States UL1 TR000128/TR/NCATS NIH HHS/United States UL1TR000128/TR/NCATS NIH HHS/United States KL2 TR000152/TR/NCATS NIH HHS/United States R24HD065703/HD/NICHD NIH HHS/United States R21 HD080398/HD/NICHD NIH HHS/United States R24 HD065703/HD/NICHD NIH HHS/United States Journal Article Research Support, N.I.H., Extramural Arch Phys Med Rehabil. 2014 Feb;95(2):353-9. doi: 10.1016/j.apmr.2013.10.015. Epub 2013 Nov 5. 24200875
Sub-concussive trauma, acute concussion, and history of multiple concussions: Effects on quiet stance postural control stability Int J Psychophysiol Dierijck J K Wright A D Smirl J D Bryk K van Donkelaar P 2018
132 Pt A 74 80 0167-8760 10.1016/j.ijpsycho.2018.03.005 1872-7697 Dierijck, J K Wright, A D Smirl, J D Bryk, K van Donkelaar, P Journal Article Research Support, Non-U.S. Gov't Netherlands Int J Psychophysiol. 2018 Oct;132(Pt A):74-80. doi: 10.1016/j.ijpsycho.2018.03.005. Epub 2018 Mar 8. 29526776
Quantification of postural control deficits in patients with recent concussion: An inertial-sensor based approach Clin Biomech Doherty C Zhao L Ryan J Komaba Y Inomata A Caulfield B 2017
42 79 84 10.1016/j.clinbiomech.2017.01.007 1879-1271 Doherty, Cailbhe Zhao, Liang Ryan, John Komaba, Yusuke Inomata, Akihiro Caulfield, Brian Journal Article England Clin Biomech (Bristol, Avon). 2017 Feb;42:79-84. doi: 10.1016/j.clinbiomech.2017.01.007. Epub 2017 Jan 16. 28110244
Normative performance on the Balance Error Scoring System by youth, high school, and collegiate athletes J Athl Train Ozinga S J Linder S M Koop M M Dey T Figler R Russman A N So R Rosenthal A H Cruickshank J Alberts J L 2018
53 7 636 645 10.4085/1062-6050-129-17 1938-162x Ozinga, Sarah J Linder, Susan M Koop, Mandy Miller Dey, Tanujit Figler, Richard Russman, Andrew N So, Richard Rosenthal, Alan H Cruickshank, Jason Alberts, Jay L Journal Article J Athl Train. 2018 Jul;53(7):636-645. doi: 10.4085/1062-6050-129-17. Epub 2018 Aug 15. 30109948
Quantification of the Balance Error Scoring System with mobile technology Med Sci Sport Exerc Alberts J L Thota A Hirsch J Ozinga S Dey T Schindler D D Koop M M Burke D Linder S M 2015
47 10 2233 2240 10.1249/mss.0000000000000656 1530-0315 Alberts, Jay L Thota, Anil Hirsch, Joshua Ozinga, Sarah Dey, Tanujit Schindler, David D Koop, Mandy M Burke, Daniel Linder, Susan M R01 NS073717/NS/NINDS NIH HHS/United States 1R01NS073717-01/NS/NINDS NIH HHS/United States Journal Article Research Support, N.I.H., Extramural Validation Study Med Sci Sports Exerc. 2015 Oct;47(10):2233-40. doi: 10.1249/MSS.0000000000000656. 26378948
The reliability of the modified Balance Error Scoring System Clin J Sport Med Hunt T N Ferrara M S Bornstein R A Baumgartner T A 2009
19 6 471 475 1050-642x 10.1097/JSM.0b013e3181c12c7b 1536-3724 Hunt, Tamerah N Ferrara, Michael S Bornstein, Robert A Baumgartner, Ted A Evaluation Study Journal Article United States Clin J Sport Med. 2009 Nov;19(6):471-5. doi: 10.1097/JSM.0b013e3181c12c7b. 19898074
Recovery of static stability following a concussion Gait Posture Powers K C Kalmar J M Cinelli M E 2014
39 1 611 614 0966-6362 10.1016/j.gaitpost.2013.05.026 1879-2219 Powers, Kaley C Kalmar, Jayne M Cinelli, Michael E Journal Article Research Support, Non-U.S. Gov't England Gait Posture. 2014;39(1):611-4. doi: 10.1016/j.gaitpost.2013.05.026. Epub 2013 Jun 25. 23810088
Recovery of postural control after cerebral concussion: new insights using approximate entropy Journal of Athletic Training Cavanaugh James T Guskiewicz Kevin M Giuliani Carol Marshall Stephen Mercer Vicki S Stergiou Nicholas 2006
41 3 305 17043699
Detecting altered postural control after cerebral concussion in athletes with normal postural stability British journal of sports medicine Cavanaugh James T Guskiewicz Kevin M Giuliani Carol Marshall Stephen Mercer V Stergiou Nicholas 2005
39 11 805 811 16244188
The effects of repetitive head impacts on postural control: A systematic review J Sci Med Sport Bonke E M Southard J Buckley T A Reinsberger C Koerte I K Howell D R 2020
1878-1861 10.1016/j.jsams.2020.09.003 1878-1861 Bonke, Elena M Southard, Julia Buckley, Thomas A Reinsberger, Claus Koerte, Inga K Howell, David R Journal Article Review Australia J Sci Med Sport. 2020 Sep 9:S1440-2440(20)30747-7. doi: 10.1016/j.jsams.2020.09.003. 32948449
Individual baseline balance assessments in a large sample of incoming NCAA Division I athletes using a force plate system International Journal of Sports Physical Therapy Weismiller Scott A. Monaco Robert Womack Jason Alderman Brandon Esopenko Carrie Conway Fiona N. Brostrand Kyle Brown Allison de Souza Nicola L. Buckman Jennifer F. 1 2 2021
16 1 126 133 2159-2896 10.26603/001c.18713 33604142
Reliability, validity and utility of inertial sensor systems for postural control assessment in sport science and medicine applications: A systematic review Sport Med Johnston W O'Reilly M Argent R Caulfield B 2019
49 5 783 818 10.1007/s40279-019-01095-9 1179-2035 Johnston, William Orcid: 0000-0003-0525-6577 O'Reilly, Martin Orcid: 0000-0003-2425-5393 Argent, Rob Orcid: 0000-0002-3522-9409 Caulfield, Brian Orcid: 0000-0003-0290-9587 SFI/12/RC/2289/Science Foundation Ireland/Ireland CF/2017/0739/Enterprise Ireland/ 676201/H2020 Marie Skłodowska-Curie Actions/ Journal Article Systematic Review New Zealand Sports Med. 2019 May;49(5):783-818. doi: 10.1007/s40279-019-01095-9. 30903440
Can we rely on mobile devices and other gadgets to assess the postural balance of healthy individuals? A Systematic Review Sensors (Basel) Pinho A S Salazar A P Hennig E M Spessato B C Domingo A Pagnussat A S 2019
19 13 10.3390/s19132972 1424-8220 Pinho, Alexandre S Orcid: 0000-0003-4818-8244 Salazar, Ana P Hennig, Ewald M Orcid: 0000-0002-2799-8590 Spessato, Barbara C Domingo, Antoinette Pagnussat, Aline S Orcid: 0000-0001-7837-5855 88881.135564/2016-01/Coordenação de Aperfeiçoamento de Pessoal de Nível Superior/ Finance Code 001/Coordenação de Aperfeiçoamento de Pessoal de Nível Superior/ Journal Article Systematic Review Sensors (Basel). 2019 Jul 5;19(13):2972. doi: 10.3390/s19132972. 31284455
A comparison of accelerometry and center of pressure measures during computerized dynamic posturography: A measure of balance Gait Posture Whitney S L Roche J L Marchetti G F Lin C C Steed D P Furman G R Musolino M C Redfern M S 2011
33 4 594 599 10.1016/j.gaitpost.2011.01.015 21333541
Reliability and validity of an accelerometry based measure of static and dynamic postural stability in healthy and active individuals Gait Posture Heebner N R Akins J S Lephart S M Sell T C 2015
41 2 535 539 0966-6362 10.1016/j.gaitpost.2014.12.009 1879-2219 Heebner, Nicholas R Akins, Jonathan S Lephart, Scott M Sell, Timothy C Journal Article England Gait Posture. 2015 Feb;41(2):535-9. doi: 10.1016/j.gaitpost.2014.12.009. Epub 2014 Dec 15. 25544692
Detecting changes in postural sway J Biomech Miyashita T L Cote C Terrone D Diakogeorgiou E 2020
107 109868 0021-9290 10.1016/j.jbiomech.2020.109868 1873-2380 Miyashita, Theresa L Cote, Christopher Terrone, Douglas Diakogeorgiou, Eleni Journal Article United States J Biomech. 2020 Jun 23;107:109868. doi: 10.1016/j.jbiomech.2020.109868. Epub 2020 Jun 1. 32517863
Reliability and concurrent validity of select C3Logix test components Dev Neuropsychol Simon M Maerlender A Metzger K Decoster L Hollingworth A Valovich McLeod T 2017
42 7-8 446 459 10.1080/87565641.2017.1383994 1532-6942 Simon, Madeline Maerlender, Arthur Metzger, Katelyn Decoster, Laura Hollingworth, Amy Valovich McLeod, Tamara Journal Article England Dev Neuropsychol. 2017;42(7-8):446-459. doi: 10.1080/87565641.2017.1383994. Epub 2017 Oct 25. 29068702
Cleveland Clinic postural stability index norms for the Balance Error Scoring System Med Sci Sport Exerc Linder S M Ozinga S J Koop M M Dey T Figler R Cruickshank J Alberts J L 2018
50 10 1998 2006 10.1249/mss.0000000000001660 1530-0315 Linder, Susan M Ozinga, Sarah J Koop, Mandy Miller Dey, Tanujit Figler, Richard Cruickshank, Jason Alberts, Jay L Journal Article Research Support, Non-U.S. Gov't United States Med Sci Sports Exerc. 2018 Oct;50(10):1998-2006. doi: 10.1249/MSS.0000000000001660. 29794620
Sensor-based balance measures outperform modified balance error scoring system in identifying acute concussion Annals of biomedical engineering King Laurie A Mancini Martina Fino Peter C Chesnutt James Swanson Clayton W Markwardt Sheila Chapman Julie C 2017
45 9 2135 2145 28540448
Development and implementation of a multi-disciplinary technology enhanced care pathway for youth and adults with concussion Journal of Visualized Experiments Alberts Jay L. Modic Michael T. Udeh Belinda Dey Tanujit Cherian Kay Lu Xiaoyang Figler Richard Russman Andrew Linder Susan M. 20 1 2019
143 1940-087X 10.3791/58962
BioSway Portable Balance System. Biodex Shirley, NY: Biodex Medical Systems, Inc. 2014

Biodex BioSway for Balance Assessment and Training [Video] Biodex 2019
https://www.youtube.com/watch?v=nJuj-5kCe_0
Use of clinical and impairment-based tests to predict falls by community-dwelling older adults Physical Therapy Boulgarides Lois K. McGinty Susan M. Willett Jayne A. Barnes Carole W. 2003
83 4 328 339 0031-9023 10.1093/ptj/83.4.328 12665404
