- Research article
- Open access
- Published:
An interrater reliability study of gait analysis systems with the dual task paradigm in healthy young and older adults
European Review of Aging and Physical Activity volume 18, Article number: 17 (2021)
Abstract
Background and aims
One reason for the controversial discussion of whether the dual task (DT) walking paradigm has an added value for diagnosis in clinical conditions might be the use of different gait measurement systems. Therefore, the purpose was 1) to detect DT effects of central gait parameters obtained from five different gait analysis devices in young and old adults, 2) to assess the consistency of the measurement systems, and 3) to determine if the absolut and proportional DT costs (DTC) are greater than the system-measurement error under ST.
Methods
Twelve old (72.2 ± 7.9y) and 14 young adults (28.3 ± 6.2y) walked a 14.7-m distance under ST and DT at a self-selected gait velocity. Interrater reliability, precision of the measurement and sensitivity to change were calculated under ST and DT.
Results
An age effect was observed in almost all gait parameters for the ST condition. For DT only differences for stride length (p < .029, ɳ2p = .239) as well as single and double limb support (p = .036, ɳ2p = .227; p = .034, ɳ2p = .218) remained. The measurement systems showed a lower absolute agreement compared to consistency across all systems.
Conclusions
When reporting DT effects, the real changes in performance and random measurement errors should always be accounted for. These findings have strong implications for interpreting DT effects.
Introduction
It is well accepted that walking outside of clinical settings requires dual tasking (DT) or multiple-task performance, where walking is combined with cognitive or motor tasks, for example crossing the street while reading signs or observing traffic [1]. Paul, Ada and Canning [2] proposed that there are two reasons why older adults (OA) show decreased performance in multiple-task condition compared to young adults (YA). First, usual physiological changes associated with ageing (decreased muscle mass, visual acuity, changes in proprioception, the vestibular- and somatosensory system) as well as accompanying alterations (postural adjustments, attentional capacity, increased reaction time, etc.) could interfere with DT performance. Second, decrements in physical activity at this age means that multiple-task performance may no longer be a prominent feature of everyday activities [3, 4] and therefore, with the lack of practice, performance declines. Thus, for example, changes in the gait pattern while dual tasking can lead to injourious falls [5] or serious traffic accidents [6], if the attentional resources are not sufficient to process environmental conditions (e.g., a car coming up to cross the road [7];). Dual tasking describes the simultaneous processing of two tasks. In research and clinical settings, the aim of DT paradigms is to calculate proportional dual task costs (DTC) as evidence for the limitation of the information processing system. When calculating DTC, performance in each task under DT condition is related to the respective performance under single task (ST) condition [8]. These proportional DTCs are expressed as a percentage decrease in performance compared to performance in the ST. The term DTC implies that under DT conditions there is an interfering interaction and a deterioration in the processing of the individual tasks, i.e. ST. However, DTs do not always and in all situations lead to performance declines compared to STs, therefore the term “dual task effect” (DTE) or “cognitive-motor interference (CMI)” is more commonly used. We use the term DTC to emphasize the performance decline and DTE to compare the accuracy of different measurement systems.
There are several models that try to explain age related drecrements in DT performance [9, 10]. With the most common resource-theoretical conception of the attention construct [11, 12], it can be assumed that especially in OA with reduced resources for cognitive and motor control, the challenges of dealing with DT are greater [13]. Lindenberger et al. [14] were able to show that the DTC become larger with increasing age. Thus, the cognitive-motor DT gait paradigm can be used to detect gait deficits that would otherwise remain hidden during normal walking without additional tasks. Based on the assumed interrelation of motor- and cognitive function for gait, the DT paradigm is used for diagnosis, prevention and treatment of falls or cognitive impairment (e.g., intervention measures) and there is a controversial discussion of whether such paradigms have an added value [15, 16]. The heterogeneity of the study results can be explained primarily by the choice of cognitive tasks. To address this problem, Al-Yahya and colleagues [17] have published a task classification and were able to show that mental tracking tasks in particular (internal disturbing factors such as counting backwards or verbal fluency tasks) cause significant DTCs on gait. This effect is emphasized in old age and already impaired cognitive abilities.
Regarding walking performance and gait kinematics, most studies currently focus on about eight gait parameters and their variability (gait velocity, cadence, step width, single and double limb support phase, step length, gait cycle length, step duration and gait cycle duration; cf. [18]). These parameters can be classified into parameters of rhythm (e.g., cadence, single and double support) and pace (e.g., gait velocity and step length) [19]. However, different gait analysis systems are used in the various studies to measure these gait parameters, which might limit direct comparability. Only few studies deal with the measurement accuracy of these systems in comparison to established reference systems [20]. Also, regarding the DT gait paradigm, recommendations on methodical procedures regarding walking distance, walking condition (self-selected gait velocity in a slow or fast gait conditions), etc. are rarely provided [16]. Klotzbier and Schott [21] were able to show that especially walking with directional changes is sensitive to the production of DTC. Straight walking does not sufficiently address real-life gait [16]. However, in most studies, walking straight ahead is used as a motor task, as most gait analysis systems are constrained to a straight walkway due to the design of the system (e.g., pressure plates [GAITrite; Zebris] or LED photoelectric switches [OptoGait]). In addition, the algorithms for calculating the gait parameters from the acceleration data of the inertial sensors (GaitUp; MobilityLab) are explicitly and exclusively designed for conditions with straight walking. The different studies use a range of walking conditions, and the measurement range is not always identical [22,23,24]. With Zebris, for example, it is only possible to cover a range of two meters (OptoGait and GAITrite also have limits). Moreover, one must reflect the algorithms in inertial sensor systems like the MobilityLab that only allow the detection of so-called “steady-state” walking. The question remains unanswered to what extent the common gait parameters of the different gait analysis systems agree despite different measuring principles or walking conditions (ST vs. DT conditions) [24]. Overall, mobile gait analysis systems show excellent agreement for spatiotemporal variables (gait velocity, cadence, gait cycle time, double step time) compared to more elaborate “gold-standard” systems [25,26,27]. Less agreement has usually been observed for stance-, swing- and double stance phase [25, 27,28,29]. Although the first direct comparisons of GAITrite and OptoGait [30, 31] as well as GAITrite and MobilityLab [20, 32] resulted in good agreement between systems, no data is available; neither comparisons of other systems, nor for a simultaneous data collection on all systems.
It is crucial that the change of gait parameters from ST to DT is higher than the random measurement error between the systems, especially when retrospectively viewing the effect of DT on gait parameters in meta-analyses or intervention studies. One way to differentiate between real change and random measurement error is through the utilization of the standard error of measurement (SEM) and the minimal detectable change (MDC). Hence, in this study we compared five different gait measurement systems regarding their reliability – in terms of agreement – in a DT paradigm thereby providing an indication of the minimum amount of the DT effect that is necessary to be sure not to consider this as a measurement error.
Therefore, the purpose of the present study was 1) to investigate the average DT effects in a cohort of YA and OA, (i.e., the change in gait parameters from ST to DT), 2) to compare the obtained gait parameters between the measurement systems in YA and OA under ST condition, and 3) to investigate if the DT effects are greater than the measurement error of the systems measured under ST condition. We assumed that DTCs influencing gait parameters would be particularly evident in OA and, that the comparison of the different gait measuring systems indicate no systematic or random differences. Furthermore, we predicted that the DTCs are greater than the average difference of the measurement systems, otherwise the DT effect may be due to measurement error.
Methods
Participants
A total of 26 participants were recruited. Community dwelling OA (n = 12) who participated in regular fall prevention programs and sports activities for senior citicens at the University of Hamburg and YA (sport students, n = 14) were recruited for this study (see Table 1 for group characteristics). All participants had normal or corrected-to-normal vision and no known neurologic or orthopaedic disorder affecting their gait. The study, approved by the local ethics of the University of Hamburg (registration number 2020_2077; 12.2.2020), followed the Declaration of Helsinki [33].
Measurement systems
Five different commercially available systems for performing gait analysis in clinical and research settings were compared. We included systems that used external hardware to measure ground contact either through pressure sensors or via optoelectronic devices (body-detached), as well as systems composed of inertial measurement units (body-attached sensors).
In analogy to the study procedure of Rudisch and colleagues [34] we used the same systems. Rudisch et al. compared different outcomes for the overlapping gait phases, during which all systems measured the same steps. The present study focused on the mean values and standard deviation for all walking conditions (see Experimental Setup and Procedure). In the PROCARE multicenter study our group collected data with five different mobile gait measurement systems, according to different institutional resources (see study protocol [35]). The PROCARE project was conducted to develop a training intervention to increase mobility and psychological well-being of nursing home residents. To show effects of the intervention on DT performance (as the DT paradigm is also used in the PROCARE study), it is necessary to secure that training effects exceed the measurement error.
Overground walking systems
The OptoGait (Microtgate, Bolzano, Italy) system is an optoelectronic measurement system using parallel bars that are positioned on the ground with 0.6 m distance (adjusted to the width of the Zebris plate) and has a spatial and temporal resolution of 1.041 cm (distance between diodes) and 1 kHz respectively. Ground contacts are measured when the photoelectronic bridge between an LED and photodiode is interrupted. We used an OptoGait system of 6 m length. The system showed a high level of correlation with all spatio-temporal parameters (ICCs: 0.79–0.95) [31]. The GAITrite (CIR Systems, New Jersey, USA) system is an electronic walkway containing a matrix of pressure sensors. We used an 8.7 m GAITrite walkway with an active measuring range of 7.93 m × 0,75 m and with a spatial and temporal resolution of 1.27 cm (length/width of sensors) and 120 Hz respectively. It is well accepted that the GAITrite mat exhibits excellent reliability for most temporal-spatial gait parameters in both YA (ICCs: 0.83–0.94) and OA (ICCs: 0.82–0.91) [36]. The Zebris (zebris Medical GmbH, Isny, Germany) plantar pressure system is, like GAITrite, an electronic walkway containing a matrix of pressure sensors. We used a 2 m × 0.6 m Zebris walkway with a spatial and temporal resolution of 0.85 cm (length/width of sensors) and 100 Hz respectively. Reliability was excellent for gait velocity, cadence, gait cycle time, step and double step length (ICC: 0.93–0.99) and poor for relative stance, swing and double stance phases (ICC: 0.24–0.47) [27].
Body-attached inertial sensors
The GaitUp is a six-channel inertial sensor system (Physiolog. Lausanne, Switzerland), which is worn on each foot. It is attached to the MobilityLab straps and positioned lateral to them on each foot (see Fig. 1). Data was recorded over 14.7 m operating at a sampling frequency of 128 Hz. Moderate to excellent agreement was shown for temporal parameters (ICCs: 0.72–0.97) [29]. The MobilityLab (Opal from APDM Inc., Portland, USA) for gait analysis consists of three inertial sensors that are bilaterally attached to both feet with straps and to the fifth lumbar vertebrae. The data recording lasted 14.7 m and sampling at a frequency of 128 Hz. Compared to a treadmill integrated force measuring plate, MobilityLab revealed excellent (ICC: 0.99; range or CI were not reported) agreement for gait velocity, cadence, gait cycle time and double stride length, but only moderate to weak (ICC: 0.50; range or CI were not reported) correlations for stance and swing phase [20].
Experimental setup and procedure
Figure 2 shows the measurement setup of the systems, illustrating that the gait paths of the different systems overlap only partially. The overall length of the walkway setup was 14.7 m. This is the sum of the distances of the overground walking systems GAITrite (8.7 m) and Zebris (2 m), as well as two mats (each of 2 m length) positioned on both ends of the walkway with the same height as GAITrite, to consider gait initiation and gait termination on an even surface. The walkway (between OptoGait bars) was limited to a width of 0.6 m, corresponding to the width of the Zebris system. Upon arrival in the gym of the Institute of Sports Sciences at the University of Hamburg, where the study was conducted, the participants were informed about the content of the study and signed a declaration of consent. Afterwards the height, weight, leg length (left and right) and shoe size were measured. Then the acceleration sensors were attached (see Fig. 1). Waiting at the starting position the test person was instructed and the walking conditions were described.
Single task and dual task walking conditions
The subjects had to walk the 14.7 m distance (see Fig. 2) two times without a cognitive task in order to become familiar with the body-attached inertial sensors and another two times (one trial in each condition) for data collection in ST (walking only) and DT condition (walking plus verbal fluency task) in randomized order. In the ST condition the participants were instructed to walk through the walkway at a comfortable, self-selected gait velocity, where in the DT condition the participants should additionally name as many words with a pre-defined letter (B, D, S or A in random order given just before the start signal [35]) as they could think of. The DT condition with an additional verbal fluency task was performed after a short explanation. Participants were allowed to name any word except for proper nouns (such as Bernd or Berlin), numbers, or words that start with the same sound but have a different ending, e.g., love, lover, lovers. These instructions were given and, using a letter that was not assigned by randomization, some examples (3–5 words) were given to ensure that the task was understood. Gait parameters were recorded, and the number of words was counted while walking straight forward. After each trial, the participants were asked to stand still behind the 2 m mat (intended for the deceleration phase) for 5 s so that the accelerometers could transmit their data without interference. Participants were then asked to return to the starting position for the next trial. Data collection for the ST and DT walking conditions was about 10 min.
Statistical analysis
The mean values and standard deviations of the gait parameters and the respective condition (ST and DT) were considered, using individual data acquisition and analysis software of the respective systems. Six outcome variables were analyzed as they were recorded by every system: velocity (m/s); cadence (steps/min); stride length ([m], distance either foot moves forward); single limb support ([%], time of only 1 foot supporting the body weight); double limb support phase ([%]; ground contact time for both feet); stance phase ([%], duration of ground contact [heel-strike to toe-off]).
Absolute motor DTCs were calculated as follows: (−(STperformance - DTperformance)), negative values indicate decreases from ST to DT. Proportional motor DTCs were calculated as follows: [((DTperformance - STperformence)/STperformance) *100] expressed in % [8, 37]. Since we did not perform cognitive performance under ST condition, it was not possible to calculate cognitive DTCs.
The interrater reliability (ICC) for the comparison within and between the various systems was calculated with the ICC (two-way random model for absolute agreement and for consistency), if an ICC of < 0.5 is bad, 0.5–0.75 is moderate, between 0.75 and 0.90 is good, and greater than 0.90 is excellent [38]. Using the ICC, the standard error of measurement (SEM) and the minimal detectable change (MDC) can be calculated (as preferred statistics according to the COSMIN standards [39]. SEM is an indicator of absolute reliability and precision of the measurement in the same units as the original measurement (SEM = SD × √1 – ICC). Measurement error was expressed as a percentage of the mean, which was defined as SEM% = (SEM / mean) × 100. A SEM% smaller than 10% indicates excellent agreement or reliability [40]. The MDC (MDC95 = SEM × 1.96 × √(2)) can be calculated, where 1.96 derives from the 95% confidence interval of no change and √2 is included because two measurements are involved in measuring change (ST and DT). The MDC is interpreted as the smallest amount of change required to designate a change as real and beyond the bounds of measurement error [41,42,43], also referred to as the sensitivity to change. Also, the MDC95 was expressed as a percentage, which was defined as MDC95% = (MDC95 / mean) × 100. The mean is the average for all the parameter values in ST [43]. While the ICC ranges from 1 to 0, with 1 being perfect and 0 being no correlation, for good instruments the SEM/SEM% and MDC/MDC95% should be as small as possible.
Power analysis (using G*Power3; a statistical power analysis program [44];) was conducted to estimate the necessary sample size. With a sample size of 16 in one group, an ANOVA with repeated measures would have 80% power to detect the interaction effect size of 0.403 at the 0.05 level of significance. To detect significant group differences (MANOVA between factor: OA vs. YA) of 0.5 or larger (p < 0.05) and a power of 80%, twelve participants in each group are necessary. With twelve OA and 14 YA we achieved a total number of 26.
Data were analyzed using SPSS, version 25.0 (SPSS Inc., Chicago, Illinois). To compare the different systems an ANOVA with measurement repetition with the systems as measurement repetition factor was calculated for each gait parameter. To calculate the differences between YA and OA a 6 (gait parameter) × 2 (group) MANOVA was calculated for ST and DT. To calculate the differences between ST and DT, post hoc analyses were calculated for each individual parameter. The mean values of the five systems were used as the basis for the calculation. There were no missing values. If the result of the ANOVAs was significant, post-hoc tests (Bonferoni) were used to analyze which factor levels significantly differed from each other (p values set to .05 [45]. Effect sizes for all ANOVAs were reported using the partial Eta2 (η2p).
Results
Participants
Table 1 shows the characteristics of the sample. The sex distribution did not differ between the groups. With 1.79 m YA were significantly taller than OA (1.69 m) and had a significantly lower BMI (22.6 ± 2.75) compared to OA (25.1 ± 3.11).
Age-related differences in gait parameters under single and dual task condition
Overall, an average of 7.39 (SD = 5.75) steps were detected in YA under ST condition and across all systems (GaitUp = 18.1; OptoGait = 5.14; GAITrite = 7.43; Zebris 1.07; MobilityLab = 5.17). Under DT, an average of 10.1 (SD = 4.97) steps was detected (GaitUp = 19.21; OptoGait = 5.64; GAITrite = 8.29; Zebris = 1.29; MobilityLab = 6.08). In OA, an average of 8.89 (SD = 6.10) steps could be detected in the ST (GaitUp = 20.3; OptoGait = 6.33; GAITrite = 8.83; Zebris = 2.25; MobilityLab = 6.71) and an average of 9 (SD = 6.04) steps was detected in the DT condition (GaitUp = 20.1; OptoGait = 6.92; GAITrite = 9.5; Zebris = 2.00; MobilityLab = 6.50).
The 6 × 2 MANOVA showed that YA and OA differ under ST conditions in gait velocity, F(1,20) = 9.11, p = .007, ɳ2p = .313, stride length, F(1,20) = 11.4, p = .003, ɳ2p = .364, single limb support, F(1,20) = 9.99, p = .019, ɳ2p = .268, double limb support, F(1,20) = 10.3, p = .004, ɳ2p = .340, and in the stance phase, F(1,20) = 4.82, p = .040, ɳ2p = 192. Most gait parameters deteriorated under DT conditions, while differences between YA and OA were found in stride length, F(1,20) = 5.66, p < .029, ɳ2p = .239, single limb support, F(1,20) = 4.12, p = .036, ɳ2p = .22, double limb support, F(1,18) = 5.29, p = .034, ɳ2p = .227, and no significant differences in gait velocity, F(1,29) = 3.36, p = .082, ɳ2p = .144 (see Fig. 3).
Multiple comparisons revealed that differences in gait parameters between ST and DT in YA could only be observed in stride length, p = .016. In OA, differences were observed for single limb support, p = .014, and double limb support, p = .017. In all other gait parameters analyzed, no difference between ST and DT were observed.
Reliability and minimal detectable changes
The mean values of the different measurement systems under ST condition were compared (cf. Table 2). The relative and absolute reliability measures (ICCa; c, SEM, MDC95) are shown in Table 2. The absolut agreement (ICCa) between the systems was poor to excellent for all groups and parameters, with values between .255 and .992 [47]. The phase parameters single limb support (.255–.310), double limb support (.272–.309) and stance phase (−.448–.475) in particular showed poor absolute agreement between the systems. The consistency of measurement across all systems (ICCc) was moderate to excellent, with values between 0.708 and 0.993. The SEM% was low in all conditions and groups (0.771–4.52%). In 100% of the observations a SEM% ≤ 10% was found. The SEM% varied between 1.09–4.52% for YA and between 0.77–46.4% for OA. The MDC95% was between 2.09–17.8% for all goups and parameters. The MDC95% fluctuated around 17.1% for the total sample. In a variance-analytical comparison of the systems, differences can be reported for almost all parameters.
Comparison between real modification and random measurement error
Table 3 shows the motor DTC of the six gait parameters for the two groups separately as well as the smallest amount of change required to designate a change as real and beyond the bounds of measurement error. It can be observed that the percentage DTC was lower than the MDC in percentage for most of the gait parameters in both YA and OA. Especially the low sensitivity of change detection for gait velocity in OA with MDC95% of 17.8% is noticeable.
Discussion
The aim of the study was to detect the amount for DT decrements for OA and YA across five gait analysis systems and to determine wheter the DT effect is greater than the measurement error between these systems. This is important in order to interpret the DTC for example in age comparisons or future training studies.
The main findings for the age comparison of this study were that OA and YA differ under ST conditions in gait velocity, stride length, single and double limb support as well as the stance phase. OA walk slower with shorter stride lengths and lower times in the single limb support phase, but with higher times in the double limb support phase and stance phase. Regarding changes from ST to DT, YA only demonstrated reductions in stride length and OA demonstrated longer single and double limb support times.
Overall, our results show the expected differences in walking performance between OA and YA as ageing is associated with many changes in the locomotor system [48, 49]. It is well described that neural reflexes, visual and vestibular feedback decrease with age [50] and in combination or interaction, these age-related changes lead to decrements of the locomotor coordination and have an impact on walking performance because of decreasing gait stability [51]. We found consistent results with previous studies for reduced gait velocity [52], reduced step length [49] as well as increased double limb support [53] for OA in comparison to YA. Also, most of the studies focusing on falls prevention reported higher decrements of gait parameters for fallers in comparison to non fallers including gait velocity, step length, step width and double limb support time over several years [53] or under DT conditions [54, 55]. Consistent with the literature and according to our results only single and double limb support phase show significant changes. Interestingly, following the classification by Beauchet and colleagues [19], YA only showed DT decrements for parameters of pace whereas OA showed DTC for relevant parameters of pace and rhythm (e.g., velocity and step length; rhythm: double support time). The DTC for both aspects of gait quality might be one explanation for greater gait instabilities of OA.
On the other hand, some studies showed that there is not always a deterioration in performance under DT conditions [54, 56]. According to the “Constrained-Action” hypothesis [57], focusing attention on a highly automated movement (internal focus) leads to performance limitations. In contrast, an external focus of attention towards the cognitive task leads to a self-organized and automated motion sequence and improved performance. As cognitive demands increase, the negative effect of competition for limited attention resources and the beneficial effect of an external attention focus overlap. A comparison between different age groups shows a decreasing positive effect of an additional cognitive task in older persons [58, 59]. Since we neither manipulated the difficulty level of the cognitive task nor calculate proportional cognitive DTC, we cannot confirm the predictions of the “Constrained-Action” hypothesis [57].
The second aim of our study was to analyze the effect of different measurement conditions. Within this study, the variables of rhythm that described the main significant differences between OA and YA for ST conditions (single and double limb support as well as stance phase) showed the poorest absolute agreements between the systems. Therefore, a direct comparison of these parameters of different studies with different systems is only possible to a limited extent. The SEM% was low (0.76–6.43%) in all conditions and both age groups. In 100% of the observations a SEM% ≤ 10% was found. Overall, the MDC95% values ranged from 2.09 to 17.8%. In line with previous results the SEM values of basic spatiotemporal parameters (step length and gait velocity) were lower than values of relative phase parameters (i.e., double support time) [30, 34, 60]. The accuracy of the measurement of spatiotemporal gait parameters of rhythm depends on the precision of the heel strike and toe off detection [61]. A greater variance in the section of these two parameters might also lead to a greater variance of the calculations with the implemented algorhythms. This might be an explanation for the higher SEM values in the gait parameters of rhythm.
Thirdly, we wanted to investigate the minimum required magnitude of change between ST and DT performance to ensure that the gait systems detect a real modification and to be 95% certain that it is not a measurement error. The main results showed that for the relative phase parameters single limb support, double limb support and stance, the DTE is lower than the minimum required magnitude of change according to the MDC95 (calculated based on the SEM). The relatively low agreement in the values for the phase parameters was already observed by Rudisch and colleagues [34], who were able to show that the basic spatiotemporal parameters (i.e., stride length, cadence, and gait velocity) showed better agreement than measures of relative phase parameters (i.e., single support phase, double support phase, stance; see also [20, 27, 30, 31]).
Thus, when interpreting a change in DT studies with walking and under consideration of the different measuring systems, a change in velocity of 0.21 m/s in OA may be considered a real change and indicates that change is not the result of measurement error. It is possible to state with 95% certainty that the change is reliable rather than measurement error, if the absolute and propotional motor DTC for gait velocity are at least 17.8%. These findings have particularly strong implications for the interpretation of study results or to describe training effects on DT performance. Therefore, in line with recommendations by Wollesen and colleagues [16] meta-analysis that deals with gait parameters, the results must consider that the different systems measure with different accuracy.
Limitations
A limitation in the context of this study is that the setup and positioning of the five measuring systems prevent the overlapping areas being maintained over the entire walking distance. This is especially the case with the overground walking systems, as they have different measuring ranges. We consider the Zebris with a length of two meter as comparatively short, which limits its suitability for overground gait analysis (on a treadmill, the two-meter system can be quite useful). OptoGait and GAITrite are limited by constraints including the length of the walkway, and the suitability for only flat surfaces, however these devices deliver very accurate results. MobilityLab and GaitUp are ecologically valid as they do not constrain the gait of participants and the entire walking distance could be recorded, even though a participant has to get used to the sensors. They do provide good accuracy for basic spatiotemporal parameters but are limited with respect to parameters of relative phase. When comparing MobilityLab and GaitUp, the former filters all steps that are not representative of a “steady-state” walking, which makes accurate step detection impossible.
The study meets the standards for excellent quality according to COSMIN (COnsensus-based Standards for the selection of health Measurement Instruments [39];). The general requirements for studies that use item response theory (IRT) models, the general design issues, and questions regarding reliability (with its measurement properties: reliability and measurement error) are fulfilled. However, the COSMIN recommendations that advise a sample size of 50 ([39], see also [62]) were not met in this study. Thus, the results on the consistency of the measurement systems and the results regarding the comparison between DTE and system-measurement error under ST condition must be interpreted with caution. No firm conclusion can be made for these aims of the study, due to the small sample size.
In addition to the two trials under ST condition to get used to the attached sensors, further DT familiarization trials would have been useful to get used to this condition (specifically related to the additional verbal fluency task). Multiple trails in both conditions could quite possibly increase the validity of the study. Since the performance of the cognitive task under ST condition was not recorded, a conclusion about the cognitive DTC is not possible. It can be assumed that differences in the DTCs are more pronounced in persons with impairments [62]. In this respect, it is uncertain whether a reliable detection of the steps is possible for persons with severe locomotion problems. Especially with overground walking systems it can be difficult to detect a gait characteristic with small shuffling as we see for example in people with Parkinson’s disease or fragile OA.
Conclusions
It seems important that studies on gait parameters in motor-cognitive DTs provide information not only on the significance and statistical DTC, but also on the probable cause of all reported changes in performance, i.e., on the contribution of both real changes in performance and random measurement errors to the reported changes.
For studies which are to be compared directly with each other and in those where different systems are used, the comparability of the gait parameters must be queried due to the low absolute agreement (absolute reliability). If, on the other hand, intervention effects on gait parameters from different studies are compared with each other, the “acceptable” consistency across the measurement systems ensures comparability and is less problematic. When it comes to the choice of an appropriate measurement system, this must always be seen in relation to the research question, the walking task to be performed and the respective setting in which the systems are used, clinical routine or scientific interest.
Availability of data and materials
Data can be obtained from the corresponding author upon reasonable request.
Change history
05 October 2022
A Correction to this paper has been published: https://doi.org/10.1186/s11556-022-00301-4
References
Faulkner KA, Redfern MS, Cauley JA, Landsittel DP, Studenski SA, Rosano C. Multitasking: association between poorer performance and a history of recurrent falls. J Am Geriatr Soc. 2007;55(4):570–6. https://doi.org/10.1111/j.1532-5415.2007.01147.x.
Paul SS, Ada L, Canning CG. Automaticity of walking–implications for physiotherapy practice. Phys Ther Rev. 2005;10(1):15–23. https://doi.org/10.1179/108331905X43463.
Takagi D, Nishida Y, Fujita D. Age-associated changes in the level of physical activity in elderly adults. J Phys Ther Sci. 2013;27(12):3685–7. https://doi.org/10.1589/jpts.27.3685.
Sun F, Norman IJ, While AE. Physical activity in older people: a systematic review. BMC Public Health. 2013;13(1):449. https://doi.org/10.1186/1471-2458-13-449.
Tomas-Carus P, Biehl-Printes C, Pereira C, Veiga G, Costa A, Collado-Mateo D. Dual task performance and history of falls in community-dwelling older adults. Exp Geronto. 2019;120:35–9. https://doi.org/10.1016/j.exger.2019.02.015.
Nasar JL, Troyer D. Pedestrian injuries due to mobile phone use in public places. Accid Anal Prev. 2013;57:91–5. https://doi.org/10.1016/j.aap.2013.03.021.
Palmiero M, Piccardi L, Boccia M, Baralla F, Cordellieri P, Sgalla R. Neural correlates of simulated driving while performing a secondary task: a review. Front Psychol. 2019;10:1045. https://doi.org/10.3389/fpsyg.2019.01045.
Doumas M, Smolders C, Krampe RT. Task prioritization in aging: effects of sensory information on concurrent posture and memory performance. Exp Brain Res. 2008;187(2):275–81. https://doi.org/10.1007/s00221-008-1302-3.
Lacour M, Bernard-Demanze L, Dumitrescu MM. Posture control, aging, and attention resources: models and posture-analysis methods. Neurophysiol Clin. 2008;38(6):411–21. https://doi.org/10.1016/j.neucli.2008.09.005.
Wollesen B, Voelcker-Rehage C, Regenbrecht T, Mattes K. Influence of a visual–verbal Stroop test on standing and walking performance of older adults. Neuroscience. 2016;318:166–77. https://doi.org/10.1016/j.neuroscience.2016.01.031.
Kahneman D. Attention and effort. Englewood Cliffs: Prentice-Hall; 1973.
Wickens CD. Processing resources and attention. Multiple-task performance; 1991. p. 3–34.
Schaefer S, Schumacher V. The interplay between cognitive and motor functioning in healthy older adults: findings from dual-task studies and suggestions for intervention. Gerontology. 2011;57(3):239–46. https://doi.org/10.1159/000322197.
Lindenberger U, Marsiske M, Baltes PB. Memorizing while walking: increase in dual-task costs from young adulthood to old age. Psychol Aging. 2000;15(3):417–36. https://doi.org/10.1037/0882-7974.15.3.417.
Menant JC, Schoene D, Sarofim M, Lord SR. Single and dual task tests of gait speed are equivalent in the prediction of falls in older people: a systematic review and meta-analysis. Ageing Res Rev. 2014;16:83–104. https://doi.org/10.1016/j.arr.2014.06.001.
Wollesen B, Wanstrath M, Van Schooten KS, Delbaere K. A taxonomy of cognitive tasks to evaluate cognitive-motor interference on spatiotemoporal gait parameters in older people: a systematic review and meta-analysis. Eur Rev Aging Phys Act. 2019b;16(1):12. https://doi.org/10.1186/s11556-019-0218-1.
Al-Yahya E, Dawes H, Smith L, Dennis A, Howells K, Cockburn J. Cognitive motor interference while walking: a systematic review and meta-analysis. Neurosci Biobehav Rev. 2011;35(3):715–28. https://doi.org/10.1016/j.neubiorev.2010.08.008.
Gschwind Y, Bridenbaugh S. The role of gait analysis. Early detection of dementia and risk of falling. Der Informierte Arzt. 2011;6:39–41 Available from: https://www.tellmed.ch/include_php/previewdoc.php?file_id=8223.
Beauchet O, Allali G, Sekhon H, Verghese J, Guilain S, Steinmetz JP, et al. Guidelines for assessment of gait and reference values for spatiotemporal gait parameters in older adults: the biomathics and Canadian gait consortiums initiative. Front Hum Neurosci. 2017 Aug;11(353):1–14. https://doi.org/10.3389/fnhum.2017.00353.
Washabaugh EP, Kalyanaraman T, Adamczyk PG, Claflin ES, Krishnan C. Validity and repeatability of inertial measurement units for measuring gait parameters. Gait Posture. 2017;55:87–93. https://doi.org/10.1016/j.gaitpost.2017.04.013.
Klotzbier TJ, Schott N. Cognitive-motor interference during walking in older adults with probable mild cognitive impairment. Front Aging Neurosci. 2017;9:350. https://doi.org/10.3389/fnagi.2017.00350.
Gomes GDC, Teixeira-Salmela LF, Freitas FASD, Fonseca MLM, Pinheiro MDB, Morais VADC. Gait performance of the elderly under dual-task conditions: review of instruments employed and kinematic parameters. Rev Bras Geriatr Gerontol. 2016;19(1):165–82. https://doi.org/10.1590/1809-9823.2016.14159.
Smith E, Cusack T, Cunningham C, Blake C. The influence of a cognitive dual task on the gait parameters of healthy older adults: a systematic review and meta-analysis. J Aging Phys Act. 2017;25(4):671–86. https://doi.org/10.1123/japa.2016-0265.
Wollesen B, Mattes K, Rönnfeldt J. Influence of age, gender and test conditions on the reproducibility of dual-task walking performance. Aging Clin Exp Res. 2017;29(4):761–9. https://doi.org/10.1007/s40520-016-0664-9.
Webster KE, Wittwer JE, Feller JA. Validity of the GAITRite® walkway system for the measurement of averaged and individual step parameters of gait. Gait Posture. 2005;22(4):317–21. https://doi.org/10.1016/j.gaitpost.2004.10.005.
Cutlip RG, Mancinelli C, Huber F, DiPasquale J. Evaluation of an instrumented walkway for measurement of the kinematic parameters of gait. Gait Posture. 2000;12(2):134–8. https://doi.org/10.1016/S0966-6362(00)00062-X.
Lee M, Song C, Lee K, Shin D, Shin S. Agreement between the spatio-temporal gait parameters from treadmill-based photoelectric cell and the instrumented treadmill system in healthy young adults and stroke patients. Med Sci Monit. 2014;20:1210. https://doi.org/10.12659/MSM.890658.
Mariani B, Hoskovec C, Rochat S, Büla C, Penders J, Aminian K. 3D gait assessment in young and elderly subjects using foot-worn inertial sensors. J Biomech. 2010;43(15):2999–3006. https://doi.org/10.1016/j.jbiomech.2010.07.003.
Bourgeois AB, Mariani B, Aminian K, Zambelli PY, Newman CJ. Spatio-temporal gait analysis in children with cerebral palsy using, foot-worn inertial sensors. Gait Posture. 2014;39:436–42. https://doi.org/10.1016/j.gaitpost.2013.08.029.
Lienhard K, Schneider D, Maffiuletti NA. Validity of the Optogait photoelectric system for the assessment of spatiotemporal gait parameters. Med Eng Phys. 2013;35(4):500–4. https://doi.org/10.1016/j.medengphy.2012.06.015.
Lee MM, Song CH, Lee KJ, Jung SW, Shin DC, Shin SH. Concurrent validity and test-retest reliability of the OPTOGait photoelectric cell system for the assessment of spatio-temporal parameters of the gait of young adults. J Phys Ther Sci. 2014;26(1):81–5. https://doi.org/10.1589/jpts.26.81.
Schmitz-Hübsch T, Brandt AU, Pfueller C, Zange L, Seidel A, Kühn AA. Accuracy and repeatability of two methods of gait analysis–GaitRite™ und mobility lab™–in subjects with cerebellar ataxia. Gait Posture. 2016;48:194–201. https://doi.org/10.1016/j.gaitpost.2016.05.014.
World Medical Association. Declaration of Helsinki, ethical principles for medical research involving human subjects. 64 nd WMA General Assembly, Fortaleza, Brazil. 2013.. https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects. Accessed 1 Apr 2021.
Rudisch J, Jöllenbeck T, Vogt L, Cordes T, Klotzbier TJ, Vogel O. Agreement and consistency of five different clinical gait analysis systems in the assessment of spatiotemporal gait parameters. Gait Posture. 2021;85:55–64. https://doi.org/10.1016/j.gaitpost.2021.01.013.
Cordes T, Bischoff LL, Schoene D, Schott N, Voelcker-Rehage C, Meixner C. A multicomponent exercise intervention to improve physical functioning, cognition and psychosocial well-being in elderly nursing home residents: a study protocol of a randomized controlled trial in the PROCARE (prevention and occupational health in long-term care) project. BMC Geriatr. 2019;19(1):369. https://doi.org/10.1186/s12877-019-1386-6.
Menz HB, Latt MD, Tiedemann A, San Kwan MM, Lord SR. Reliability of the GAITRite® walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait Posture. 2004;20(1):20–5. https://doi.org/10.1016/S0966-6362(03)00068-7.
Plummer P, Eskes G. Measuring treatment effects on dual-task performance: a framework for research and clinical practice. Front Hum Neurosci. 2015;9:225. https://doi.org/10.3389/fnhum.2015.00225.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016 Jun;15(2):155–63. https://doi.org/10.1016/j.jcm.2016.02.012.
Mokkink LB, Terwee CB, Gibbons E, Stratford PW, Alonso J, Patrick DL, et al. Inter-rater agreement and reliability of the COSMIN (COnsensus-based standards for the selection of health status measurement instruments) checklist. BMC Med Res Methodol. 2010 Sep;10(82):1–11. https://doi.org/10.1186/1471-2288-10-82.
Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26(4):217–38. https://doi.org/10.2165/00007256-199826040-00002.
Hollman JH, Beckman BA, Brandt RA, Merriwether EN, Williams RT, Nordrum JT. Minimum detectable change in gait velocity during acute rehabilitation following hip fracture. J Geriatr Phys Ther. 2008;31(2):53–6. https://doi.org/10.1519/00139143-200831020-00003.
Hollman JH, Childs KB, McNeil ML, Mueller AC, Quilter CM, Youdas JW. Number of strides required for reliable measurements of pace, rhythm and variability parameters of gait during normal and dual task walking in older individuals. Gait Posture. 2010;32(1):23–8. https://doi.org/10.1016/j.gaitpost.2010.02.017.
Schwenk M, Gogulla S, Englert S, Czempik A, Hauer K. Test–retest reliability and minimal detectable change of repeated sit-to-stand analysis using one body fixed sensor in geriatric patients. Physio Meas. 2012;33(11):1931–46. https://doi.org/10.1088/0967-3334/33/11/1931.
Faul F, Erdfelder E, Lang AG, Buchner A. G* power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91. https://doi.org/10.3758/BF03193146.
Tabachnick BG, Fidell LS. Using multivariate statistics 6th edn. Pearson Education Limited: New International Edition; 2013.
Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–40. https://doi.org/10.1519/15184.1.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8. https://doi.org/10.1037/0033-2909.86.2.420.
Kerber KA, Ishiyama GP, Baloh RW. A longitudinal study of oculomotor function in normal older people. Neurobiol Aging. 2006;27(9):1346–53. https://doi.org/10.1016/j.neurobiolaging.2005.07.009.
Seidler RD, Bernard JA, Burutolu TB, Fling BW, Gordon MT, Gwin J. Motor control and aging: links to age-related brain structural, functional, and biochemical effects. Neurosci Biobehav Rev. 2010;34(5):721–33. https://doi.org/10.1016/j.neubiorev.2009.10.005.
Verdú E, Ceballos D, Vilches JJ, Navarro X. Influence of aging on peripheral nerve function and regeneration. J Peripher Nerv Syst. 2000;5:91–208. https://doi.org/10.1111/j.1529-8027.2000.00026.x.
Hausdorff JM, Rios DA, Edelberg HK. Gait variability and fall risk in community-living older adults: a 1-year prospective study. Arch Phys Med Rehabil. 2001;82(8):1050–6. https://doi.org/10.1053/apmr.2001.24893.
Morrison S, Colberg SR, Parson HK, Neumann S, Handel R, Vinik EJ. Walking-induced fatigue leads to increased falls risk in older adults. J Am Med Dir Assoc. 2016;17(5):402–9. https://doi.org/10.1016/j.jamda.2015.12.013.
Scott D, McLaughlin P, Nicholson GC, Ebeling PR, Stuart AL, Kay D. Changes in gait performance over several years are associated with recurrent falls status in community-dwelling older women at high risk of fracture. Age Ageing. 2015;44(2):287–93. https://doi.org/10.1093/ageing/afu169.
Wollesen B, Voelcker-Rehage C. Differences in cognitive-motor interference in older adults while walking and performing a visual-verbal Stroop task. Front Aging Neurosci. 2019;10:426. https://doi.org/10.3389/fnagi.2018.00426.
Muhaidat J, Kerr A, Evans JJ, Skelton DA. The test–retest reliability of gait-related dual task performance in community-dwelling fallers and non-fallers. Gait Posture. 2013;38(1):43–50. https://doi.org/10.1016/j.gaitpost.2012.10.011.
Stoffregen TA, Hove P, Bardy BG, Riley M, Bonnet CT. Postural stabilization of perceptual but not cognitive performance. J Mot Behav. 2007;39(2):126–38. https://doi.org/10.3200/JMBR.39.2.126-138.
Wulf G, McNevin N, Shea CH. The automaticity of complex motor skill learning as a function of attentional focus. Q J Exp Psychol [A]. 2001;54:1143–54. https://doi.org/10.1080/713756012.
Huxhold O, Li SC, Schmiedek F, Lindenberger U. Dual-tasking postural control: aging and the effects of cognitive demand in conjunction with focus of attention. Brain Res Bull. 2006;69(3):294–305. https://doi.org/10.1016/j.brainresbull.2006.01.002.
Verrel J, Lövdén M, Schellenbach M, Schaefer S, Lindenberger U. Interacting effects of cognitive load and adult age on the regularity of whole-body motion during treadmill walking. Psychol Aging. 2009;24(1):75–81. https://doi.org/10.1037/a0014272.
Bilney B, Morris M, Webster K. Concurrent related validity of the GAITRite® walkway system for quantification of the spatial and temporal parameters of gait. Gait Posture. 2003;17(1):68–74. https://doi.org/10.1016/S0966-6362(02)00053-X.
Kobsar D, Charlton JM, Tse CT, Esculier JF, Graffos A, Krowchuk NM, et al. Validity and reliability of wearable inertial sensors in healthy adult walking: a systematic review and meta-analysis. J Neuroeng Rehabilitation. 2020;17(62):1–21. https://doi.org/10.1186/s12984-020-00685-3.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012.
Acknowledgements
The authors thank the volunteers who participated in the study.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
We confirm that all authors were fully involved in the study and preparation of the manuscript and all authors have approved the manuscript and agree with its submission to European Journal of Aging. All authors fulfill the ICMJE (International Comitee of Medical Journal Editors) recommendations on authorship. Credit taxonomy: T.J.K.: Conceptualization, Methodology, Validation, Formal analysis, Investigation, Writing - Original Draft, Writing - Review & Editing, Visualization, Project administration; J.R.: Conceptualization, Methodology, Validation, Formal analysis, Investigation, Review & Editing; Thomas Cordes: Conceptualization, Methodology, Investigation, Review & Editing; O.V.: Formal analysis, Investigation, Resources, Review & Editing; L.V.: Conceptualization, Methodology, Supervision, Writing - Review & Editing; T.J.: Conceptualization, Methodology, Validation, Formal analysis, Investigation, Review & Editing; B.W.: Conceptualization, Methodology, Writing – Original draft together with Thomas Klotzbier, Review & Editing, Project administration.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All assessments were conducted in accordance with ethical rules for research in human subjects following the Declaration of Helsinki (Fortalenza 2013). The study protocol (AZ 2020_2077) was approved by the ethics committee of the Hamburg University.
All participants received written and verbal information about the study and signed informed consent prior to their participation.
Competing interests
The authors have no financial or personal relationships with any other person or organization that could improperly influence or otherwise influence their work in this study. On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was revised: false statements “[…] the algorithms of GaitUp are difficult to comprehend because the raw data cannot be accessed” (page 2) and “[…] GaitUp does not allow access to the raw data, so the data cannot be extracted or analyzed independently (page 9) have been deleted as requested by the authors.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Klotzbier, T.J., Wollesen, B., Vogel, O. et al. An interrater reliability study of gait analysis systems with the dual task paradigm in healthy young and older adults. Eur Rev Aging Phys Act 18, 17 (2021). https://doi.org/10.1186/s11556-021-00271-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s11556-021-00271-z