Skip to main content

Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab

Abstract

Background

Falls are common in older adults and can result in serious injuries. Due to demographic changes, falls and related healthcare costs are likely to increase over the next years. Participation and motivation of older adults in fall prevention measures remain a challenge. The iStoppFalls project developed an information and communication technology (ICT)-based system for older adults to use at home in order to reduce common fall risk factors such as impaired balance and muscle weakness. The system aims at increasing older adults’ motivation to participate in ICT-based fall prevention measures. This article reports on usability, user-experience and user-acceptance aspects affecting the use of the iStoppFalls system by older adults.

Methods

In the course of a 16-week international multicenter study, 153 community-dwelling older adults aged 65+ participated in the iStoppFalls randomized controlled trial, of which half used the system in their home to exercise and assess their risk of falling. During the study, 60 participants completed questionnaires regarding the usability, user experience and user acceptance of the iStoppFalls system. Usability was measured with the System Usability Scale (SUS). For user experience the Physical Activity Enjoyment Scale (PACES) was applied. User acceptance was assessed with the Dynamic Acceptance Model for the Re-evaluation of Technologies (DART). To collect more detailed data on usability, user experience and user acceptance, additional qualitative interviews and observations were conducted with participants.

Results

Participants evaluated the usability of the system with an overall score of 62 (Standard Deviation, SD 15.58) out of 100, which suggests good usability. Most users enjoyed the iStoppFalls games and assessments, as shown by the overall PACES score of 31 (SD 8.03). With a score of 0.87 (SD 0.26), user acceptance results showed that participants accepted the iStoppFalls system for use in their own home. Interview data suggested that certain factors such as motivation, complexity or graphical design were different for gender and age.

Conclusions

The results suggest that the iStoppFalls system has good usability, user experience and user acceptance. It will be important to take these along with factors such as motivation, gender and age into consideration when designing and further developing ICT-based fall prevention systems.

Background

Digital gaming by and for older adults has become a popular area of research within the wider field of game studies and gerontology. There is an increasing awareness in medical and gerontology research that digital games, especially whole-body movement games, have the potential to reduce falls and increase overall health and quality of life (QoL) [1, 2]. Information and communication technology (ICT)-based programs offer a promising alternative method to reduce fall risk factors in older adults in their own home, using digital game-based systems and unobtrusive sensoring [3]. The main advantage is that these serious games for health, exergames in particular, can combine exercise and entertainment for older adults [4].

Long-term motivation and sustainable usage of exercise and health games by older adults remains unclear [5]. The factors which influence whether older adults accept or reject technologies in their lives are complex and diverse, include factors like gender and age [68], and differ greatly from younger technology users [9]. It is important to understand the technological requirements of older adults when designing high-quality systems [10, 11]. Ideally, older adults should be involved as “co-designers” in the process [12] to enable more detailed insights on day-to-day life aspects and interactions with digital technologies ([11] p.1199). This allows for the best possible approach to negotiate between design and user needs.

In order to successfully design such ICT-based systems for older adults, it is crucial to understand the users’ values, behaviours, attitudes, practices and technical experiences [13] regarding digital technologies and games. Usability, user experience and user acceptance play an important role in order to collect and interpret values, behaviours and practices of users for the design of such ICT-based systems. Using a combination of qualitative and quantitative data material, this paper aims to identify factors influencing usability, user experience and user acceptance of older adults engaging with an ICT-based fall prevention system (iStoppFalls).

Methods

Study setup

This paper is using data from an international, multicenter study designed as a single-blinded, two-group randomized clinical trial (RCT) with a total of 153 community-dwelling older adults (n = 78 intervention group, n = 75 control group) aged 65+ from Cologne, Germany (n = 59), Valencia, Spain (n = 37) and Sydney, Australia (n = 57) [3]; and a more qualitative-oriented Living Lab (LL) study with a total of 15 community-dwelling older adults aged 65+ from Siegen, Germany.

The iStoppFalls system used in this study consists of several technical components: 1) a set-top box with controller, 2) a mini personal computer (PC) with exergames, 3) a Microsoft-Kinect for movement detection, gesture and voice control, 4) a Senior Mobility Monitor (SMM) for mobility and activity tracking worn around the neck, 5) a tablet PC as an alternative input and output device for the interactive television (iTV) system, and 6) an iTV. A more detailed description can be found in [14].

In the RCT, the system’s effectiveness in terms of fall risk reduction and supplementary facets such as physical, cognitive and health related variables [15] were quantitatively analysed. The LL [16] qualitatively examined the systems’ suitability for integration into daily routines of older adults’, aspects of usability, user experience and user acceptance. Both, the RCT and LL, were conducted simultaneously. RCT group participants conducted a 16-week exercise program using the iStoppFalls system through the TV set in their own home [14]. LL participants conducted the same exercise program and setup for 24 weeks. The extended study period of the latter was based on the LL approach which requires long-term evaluation of qualitative aspects such as the integration into daily routines [17, 18]. Nevertheless, all participants used the exact same system including exergames and assessments.

Study protocol

Predefined inclusion and exclusion criteria were applied to screen subjects [15]. Ethical approval was granted by the ethics committees of the German Sport University Cologne, the Polytechnic University of Valencia and the Human Research Ethics Committee of the University of New South Wales. The most relevant requirements for participation were a broadband internet connection, a high definition TVwith HDMI port and at least three meters space in front of the TV. For the LL study, an interest in preventive training (a weekly balance and strength training together with a monthly fall risk assessment) and the willingness to attend assessments or workshops at the different study centres had to be expressed. No financial compensation was offered to participants.

Data collection

Data from different paper-based questionnaires relating to usability, user experience and technology acceptance were collected during the respective study periods. Feasibility of the questionnaires was pretested with 10 participants and revisions were conducted according to participants’ feedback. All questionnaires were distributed among the RCT and LL participants (at week 4, week 8 and week 16). In addition to quantitative questionnaires, qualitative data was collected by conducting face-to-face semi-structured interviews with a more detailed focus on usability, user experience and user acceptance. These interviews lasted between 30 and 120 min. For LL participants, face-to-face interviews were supplemented by observations regarding the interaction behaviour of participants with the iStoppFalls system and workshops with participants providing a platform to exchange and discuss ideas concerning the system.

Measures

In total, 60 participants completed paper-based questionnaires (50 RCT and 10 LL). The sample constisted of 23 male and 37 female participants with an average age of 73 years. Table 1 provides an overview of participants’ characteristics.

Table 1 Participants’ characteristics

The System Usability Scale (SUS) measures the usability of a product and consists of 10 items which are evaluated on a 5-point Likert scale ranging from 1 “strongly disagree” to 5 “strongly agree”. The results are distributed on a specific scale ranging from 0 for “worst imaginable” to 100 for “best imaginable” [19]. SUS is an appropriate and robust usability measure with easy application for the user [20, 21]. It is frequently applied in design studies evaluating the application of interfaces [22]. Recent publications illustrate a meaningful application of the SUS in evaluation settings with older adults and within a fall prevention context [23, 24].

The Physical Activity Enjoyment Scale (PACES) is frequently applied to measure the enjoyment of physical activities. Since physical activity is a core feature of the iStoppFalls system, the PACES was deemed appropriate to measure user experience. In this study, the 8-item PACES version was applied [25, 26]. All items are evaluated on a 6-point Likert scale. The responses from each participant are added up and averaged. A high score implies high enjoyment while being phyiscally active. The maximum enjoyment score for this scale is 48.

The Dynamic Acceptance Model for the Re-evaluation of Technologies (DART) is an instrument to analyze and evaluate the user acceptance of products or services without statistical analyses [27]. It provides a meta structure with four dimensions: perceived usefulness, perceived ease of use, perceived network effects and perceived costs. For each dimension individual acceptance indicators (AI) such as ease of use or attractiveness of design are defined to measure the importance and implementation perceptions of users in regard to the tested system. The definition of AI’s is based on literature review and user research in the field of ICT for older adults [28]. The users’ perceived importance to an AI and the users’ perceived implementation of an AI within the system are rated on a 6-point Likert scale for each indicator, with 1 “being very unimportant/totally unfulfilled” and 6 “being very important/totally fulfilled”. For each AI all ratings are averaged. Figure 3 in the results section illustrates the described method via spider charts using one line for the importance and one line for the implementation. Subtracting the importance ratings from the implementation ratings provide the degree of discrepancy between the users’ perception of importance and implementation within the tested system. This calculation gives a measure to explain the fulfillment of user expectations by the tested system. Values close to zero represent a high rate of acceptance from a users’ perspective.

Interviews

Additional semi-strucutured interviews with a focus on health, mobility, system and technology use were conducted with 40 participants. We used open ended questions in order to obtain more detailed insights on participants’ perceptions. All interview participants were selected randomly, considering the predefined inclusion and exclusion criteria described above.

Statistical analysis

A combination of qualitative and quantitative methods was used [29]. Descriptive analyses were conducted in SPSS version 22. The SUS and PACES were applied for the whole iStoppFalls system, whilst the DART was seperately applied for those participants performing the exergames and wearing the SMM. Therefore, DART data will also be presented for the exergame and SMM. All data was structured into two different perspectives, namely age (mean = 72) and gender.

Qualitative data analyses were conducted to further enhance our understanding of users’ attitudes and practices. Qualitative data analysis used a content analytic approach using MaxQDA version 12 [30]. Coding and codes which were formed based on the interview guides were supplemented by an open inductive coding based on the overall material [31]. Coding was undertaken by researchers who worked closely with the participants and were present during the intervention at the LL. They were supported by additional researchers who were not part of the LL. Empirical data was analyzed in respect of substantive data, coded interviews, transcripts, usability tests and workshops which were triangulated with additional observation notes taken right after every visit.

Results

Usability

Participants evaluated the iStoppFalls system’s usability with an overall score of 62 (SD 15,58) which is good (See Fig. 1). In terms of gender, there was no noticable difference for the perception of usability. Male participants evaluated the usability of the system with a score of 61 (SD 19,17), while female participants evaluated the usability with a score of 62 (SD 23,46). In regard to participants’ age, our results illustrate that participants younger than the mean age (72 years) assessed the system’s usability with a score of 72 (SD 16,22) while participants older than the mean age assessed the usability with a score of 53 (SD 23,64). Figure 1 provides an overview of the SUS results.

Fig. 1
figure 1

Overall System Usability Scale score. The SUS score is located on a scale ranging from 0 to 100. Adjective ratings provide interpretation of the SUS score. The acceptability range indicates whether the evaluated interface of the system is acceptable or not. Quartile ranges illustrate the average SUS score of all SUS studies (average SUS score of all SUS studies lies around 68), meaning that values around the 2nd quartile represent an average result, based on all SUS studies

During the interviews, participants reported technical issues with the system: “In the beginning there were situations (…) I could have thrown the computer against the wall (…) but then, after new software has been uploaded, it worked much better, and I enjoyed playing the games again.” (Siegen, Living Lab, 64 years, female).

Apart from the technical issues participants also stated that they perceived the system as user-friendly: “The system, in its current state, can almost be described as ‘consumer-friendly’; especially for older adults. You always have to start from the premise that, especially older adults, struggle learning new technology - not concerning the exercises but rather pertaining to all the button pressing.” (Siegen, Living Lab, 67 years, male). However, some older participants noted that the system was too complex to use without any help: “However, when I was left alone in home to use it, I realised that there were many more things than what I was able to remember. I found it a bit overwhelming, and I was afraid of not using it right. I appreciated the instructions that helped me to go through the games.” (Valencia, RCT, 73 years, male).

User experience

The overall enjoyment of using the iStoppFalls system was evaluated with a score of 31 (SD 8,03), which means enjoyable (see Fig. 2). In regard to gender, male participants evaluated the enjoyment of using the system with a score of 29 (SD 7,26), while their female counterparts evaluated the enjoyment with a score of 32 (SD 8,44). Younger participants (<72 years) assessed the enjoyment of using iStoppFalls with a score of 32 (SD 7,98). Older participants (>72 years) assessed the enjoyment with a score of 29 (SD 7,90). Figure 2 presents the PACES results.

Fig. 2
figure 2

Overall Physical Activity Enjoyment Scale score. The scale ranges from 0 to 48. PACES scores below 24 are interpreted as lower enjoyment while being physically active. PACES scores above 24 are considered as higher enjoyment while being physically active

The qualitative content analysis showed that participants’ enjoyment using the system was quite distinct. Some participants enjoyed playing the games: „Overall I enjoyed the games, even though they were quite challenging and the Kinect didn’t work properly sometimes.“(Siegen, Living Lab, 77 years, female). Over time, other participants found the games to become boring: “Actually, I didn’t enjoy the games after some time. It just repeats over and over and gets a little boring then. If there would be an increase in the training (difficulty) then I could do it this way.” (Siegen, Living Lab, 74 years, male).

User acceptance

The participants’ evaluation of the acceptance of iStoppFalls is illustrated in Fig. 3. The overall acceptance rate of the iStoppFalls system (SMM and exergame) was 0.87 (SD 0,26), which indicates a good user acceptance. Considering the exergame and SMM separately, the acceptance rate for the exergame was evaluated with a score of 0.96 (SD 0,28), whereas the acceptance rate for the SMM was rated with a score of 0.78 (SD 0,27). In terms of age, evaluations of participants younger than the mean age of 72 years resulted in an acceptance rate for the exergame of 0.44 (SD 0,18). Older participants’ evaluations resulted in an acceptance rate of 0.36 (SD 0.40). For the SMM, the acceptance rate evaluated by younger participants was 0.78 (SD 0,51), while older participants evaluated the acceptance for the SMM with 0.04 (SD 0,29). In regard to gender, male participants rated the acceptance of the exergame with 0.92 (SD 0.54), while female participants’ acceptance rate was 1.01 (SD 0.22). The acceptance of the SMM was 0.65 (SD 0.30) for male participants and 0.87 (SD 0.43) for female participants.

Fig. 3
figure 3

Overall evaluations for exergame and SMM (mean values). The dotted line represents the importance ratings for the acceptance indicators, while the solid line represents the implementation ratings for the acceptance indicators. Importance and implementation of all indicators are evaluated on a 6-point likert scale

In addition, the interviews revealed specific factors influencing the acceptance of the system. For instance, some participants did not like the appearance of the SMM: “Well, it [the SMM] just does not look good. Others may think - what does she have?! And the lights as well! I used it once in my gymnastics group and immediately turned the lamp to the body to disguise it.” (Valencia, RCT, 73 years, female).

However, other participants reported liking the visualization of results: “The pendant [SMM] was something that I wore in the beginning just because you told me: I wanted to contribute to your study, but I didn’t see the motivation of wearing that thing, until I saw the graphs with the results, the map, and so on. It was funny to see, and even tried to walk more outside to see if I could beat my record.” (Valencia, RCT, 70 years, male). With regard to intentions to use the system after the study a participant stated: Yes, I could imagine to keep on using the system for three times a week. But the system has to be improved. Technical failures occur too frequently and loading times are too long.” (Cologne, RCT, 79 years, male). In terms of the exergame participants mainly responded in a positive way, aside from some technical issues: “I really liked the variety of the games, especially the different forms of sport. The games were presented in a beautiful graphic. What I really liked on top of that was the ranking of results achieved while playing the games. I really got ambitious here. I couldn’t imagine becoming so ambitious about that before the study.” (Cologne, RCT, 68 years, female).

Discussion

In this paper, data from a home-based study on ICT-based fall prevention across different countries were investigated on usability, user experience and user acceptance. For the iStoppFalls system, age seemed to be an important factor for the perception and evaluation of the system’s usability. In respect to user experience, the findings suggest that game design should consider gender differences in order to make the use of such systems enjoyable for male and female users. Regarding user acceptance results, the study identified activity tracking devices like the applied SMM as an important component, because it may considerably motivate older adults to continuously use the system and be more active.

Usability

Overall, participants perceived the usability of the iStoppFalls system as “good”. In respect to gender, there were no noticable differences in the evaluation of the system’s usability. However, regarding age, younger participants assessed the usability of the system better than older participants. As previously noted by participants during the interviews, malfunctions, long loading times or complex tasks prevented the appropriate use of the system. Referring to the results in our sample it seems that such usability issues had a stronger impact on older participants than on younger participants. These findings correspond to research investigating usability of ICT for older adults. [32] mentioned the importance of reducing malfunctions and providing easy solutions for older adults. In a different study, [33] found that complexity is a crucial factor regarding usability for older adults and should be reduced as much as possible.

User experience

In general, the participants enjoyed using the iStoppFalls system. The results do not show any noticable differences for the enjoyment of the system regarding gender and age. However, the interviews revealed that there seems to be a gender difference regarding the enjoyment of the system. Some male participants stated that they found the games unchallenging or that the games became boring after some time. Such statements were not made by female participants, indicating that the user experience for male and female participants differs in the case of ICT-based fall prevention systems like iStoppFalls. This coincides with the current literature on gender differences in user experience of video games [8, 34]. Age differences with regard to user experience were not found in the qualitative data material. Considering gender differences for the design of exergames therefore seems to be an important factor in order to ensure good user experience for the target group.

User acceptance

In terms of user acceptance our quantitative results showed that the iStoppFalls system was generally accepted by the target group, as all acceptance rates were close to zero. However, Fig. 3 shows some indicators for improvements of the tested prototype. The most noticable descrepancies between participants’ importance and implementation evaluation were: (1) the fun factor in exergames and (2) the wearing comfort of the SMM. With regard to age and gender, there were no additional noticable differences.

The qualitative analysis was able to depict a more detailed and distinct picture of user acceptance for the exergame and SMM.

According to the interview statements participants were satisfied with the exergames. Apart from some technical issues critizised by most participants, visual aspects such as the exergame graphics seemed to be an important aspect to young older participants. [35] reported similar findings in their study, suggesting that graphical design should be considered as a relevant acceptance factor for older adults. Fun in exergames might be an important factor as well, as reported by the participants during the interviews. [36] investigated the importance of fun in exergames for older adults. In the respective study, the researchers ascertained fun as a major factor for older adults in terms of exergames. They also revealed that when exergames were fun, older adults were more likely to replay the exergames than younger people [36].

In regard to the SMM, participants pointed out that they disliked the design of the device. They described it as appearing old and dated. Some participants even stated that they would try to avoid using it in public for that reason. Male participants in particular mentioned that they did not like wearing the SMM device like a necklace. These findings indicate that visual design and novelty of ICT technologies seem to be important acceptance factors. [37] found the desire to stay up-to-date as one of the most important factors for acceptance in his study. According to our analysis, this might be also relevant in the case of ICT-based fall prevention, since the SMM device (research prototype) did not seem to provide a “being up-to-date feeling” for study participants, due to its appearance. Besides feeling up-to-date the analysis indicated that gender specific aspects (wearing the SMM like a necklace) might have had an influence on the acceptance of the SMM as well. On the other hand, participants were very keen on the functionalities of the SMM device such as visualizing results based on tracked movement data. Such functionalities enabled participants to follow their own physical development and compare their results and achievements to others. These functionalities were mentioned as being very motivating by the participants. Studies investigating motivational aspects for the use of technology for physical activity by older adults illustrate that tracking and feedback of physical activity are important factors for that target group [3840].

Design implications

The analysis, presented in this article, showed that the design of ICT-based fall prevention systems for older adults should consider specific aspects with regard to usability, user experience and user acceptance. In general our quantitative and qualitative analysis revealed following design implications for exergames and activity trackers listed in Table 2.

Table 2 Design implications

In addition to the design implications summarized in Table 2, observations and qualitative interviews revealed that graphical and fun aspects of exergames are more important for younger old adults than older old adults. With regard to gender, the design of exergames may consider different contents. Combination with wearable devices like the SMM increases the motivation of older adults to use ICT-based fall prevention systems and therefore constitute an important factor for a sustainable design of fall prevention systems.

Limitations

The questionnaires used in this study were applied in a way that the SUS and PACES covered the iStoppFalls system as a whole, while the DART differentiated between exergame and SMM allowing participants to make more distinct and accurate evaluations of system components. The SUS and PACES results therefore do not give insight into how usability and user experience were perceived for the exergame or the SMM. However, our results provided valuable qualitative information about usability and user experience aspects from participants in regard to the exergame and the SMM. Finally, the sample size of this study was too small to allow for detailed statistical analyses in terms of user acceptance. Therefore, our results can not provide significances or correlations within the collected data set.

Conclusions

The results suggest that the iStoppFalls system has good usability, user experience and user acceptance and discuss the importance of taking into account age and gender. This paper provides important information regarding motivational and sustainable use aspects, which can be used when designing usable and enjoyable ICT-based fall prevention systems. In order to achieve sustainable system use, it will be important to consider these aspects and providing motivational factors will facilitate the acceptance of ICT-based fall prevention systems by the target group.

References

  1. Gillespie LD, Robertson MC, Gillespie WJ, Sherrington C, Gates S, Clemson LM, et al. Interventions for preventing falls in older people living in the community. In: The Cochrane Collaboration, Gillespie LD, editors. Cochrane Database Syst. Rev. [Internet]. Chichester, UK: John Wiley & Sons, Ltd; 2012 [cited 2013 Jul 19]. Available from: http://doi.wiley.com/10.1002/14651858.CD007146.pub3.

  2. Smith ST, Sherrington C, Studenski S, Schoene D, Lord SR. A novel Dance Dance Revolution (DDR) system for in-home training of stepping ability: basic parameters of system use by older adults. Br J Sports Med. 2011;45:441–5.

    Article  CAS  PubMed  Google Scholar 

  3. Gschwind YJ, Eichberg S, Ejupi A, de Rosario H, Kroll M, Marston HR, et al. Main Results - ICT-based system to predict and prevent falls (iStoppFalls): study protocol for an international multicenter randomized controlled trial. Eur. Rev. Aging Phys. Act. 2015;in press.

  4. Bleakley CM, Charles D, Porter-Armstrong A, McNeill MDJ, McDonough SM, McCormack B. Gaming for Health: A Systematic Review of the Physical and Cognitive Effects of Interactive Computer Games in Older Adults. J Appl Gerontol. 2015;34:NP166–89.

    Article  PubMed  Google Scholar 

  5. Wiemeyer J. Serious Games-The challenges for computer science in sport. Int. J. Comput. Sci. Sport. 2010;9.

  6. Czaja SJ, Charness N, Fisk AD, Hertzog C, Nair SN, Rogers WA, et al. Factors predicting the use of technology: Findings from the center for research and education on aging and technology enhancement (create). Psychol Aging. 2006;21:333–52.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Fazeli PL, Ross LA, Vance DE, Ball K. The Relationship Between Computer Experience and Computerized Cognitive Test Performance Among Older Adults. J Gerontol B Psychol Sci Soc Sci. 2013;68:337–46.

    Article  PubMed  Google Scholar 

  8. Sheikh JA, Abbas A. The Invisible User: Women in DUXU. Des. User Exp. Usability Users Interact. Springer; 2015. p. 243–51.

  9. Wilkowska W, Ziefle M. Which Factors Form Older Adults’ Acceptance of Mobile Information and Communication Technologies? In: Holzinger A, Miesenberger K, editors. HCI Usability E-Incl. [Internet]. Berlin, Heidelberg: Springer Berlin Heidelberg; 2009 [cited 2013 Aug 14]. p. 81–101. Available from: http://www.springerlink.com/index/10.1007/978-3-642-10308-7_6.

  10. Keith S, Whitney G. Bridging the gap between young designers and older users in an inclusive society. Proc Good Bad Challenging User Future ICT. 1998.

    Google Scholar 

  11. Lindsay S, Jackson D, Schofield G, Olivier P. Engaging older people using participatory design. ACM Press; 2012 [cited 2014 Nov 7]. p. 1199. Available from: http://dl.acm.org/citation.cfm?doid=2207676.2208570.

  12. Hartswood M, Rouncefield M, Procter R, Slack R, Voß A, Buscher M, et al. Co-realisation: Towards a Principled Synthesis of Ethnimethodology and Participatory Design. Scand J Inf Syst. 2002;14(2):2003.

    Google Scholar 

  13. Wulf V, Rohde M, Pipek V, Stevens G. Engaging with practices: design case studies as a research framework in CSCW. Proc. ACM 2011 Conf. Comput. Support. Coop. Work. ACM; 2011. p. 505–12.

  14. Marston HR, Woodbury A, Gschwind YJ, Kroll M, Fink D, Eichberg S, et al. The design of a purpose-built exergame for fall prediction and prevention for older people. Eur Rev Aging Phys Act. 2015;12:13.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Gschwind YJ, Eichberg S, Marston HR, Ejupi A, de Rosario H, Kroll M, et al. ICT-based system to predict and prevent falls (iStoppFalls): study protocol for an international multicenter randomized controlled trial. BMC Geriatr. 2014;14:91.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Ogonowski C, Aal K, Vaziri D, von Rekowski T, Wieching R, Wulf V. A Fall Prevention Exergame for Community-Dwelling Older Adults: Results from a Long-Term Living Lab Study, under review. 2014.

    Google Scholar 

  17. Almirall E, Wareham J. Living Labs and open innovation: roles and applicability. Electron J Virtual Organ Netw. 2008;10:21–46.

    Google Scholar 

  18. Schaffers H, Sällström A, Pallot M, Hernandez-Munoz JM, Santoro R, Trousee B. Integrating Living Labs with Future Internet experimental platforms for co-creating services within Smart Cities. 17th Int. Conf. Concurr. Enterprising ICE 2011 20–22 June 2011 Aachen Ger. [Internet]. Aachen: IEEE; 2011 [cited 2013 Jul 19]. Available from: http://ieeexplore.ieee.org/servlet/opac?punumber=6030110.

  19. Brooke J. SUS: a quick and dirty usability scale. PW Jordan PW Thomas B Weerdmeester BA McClelland IL Eds Usability Eval. Ind. Taylor Francis Lond. 1996.

  20. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Intl J Human-Computer Interact. 2008;24:574–94.

    Article  Google Scholar 

  21. Borsci S, Federici S, Lauriola M. On the dimensionality of the System Usability Scale: a test of alternative measurement models. Cogn Process. 2009;10:193–7.

    Article  PubMed  Google Scholar 

  22. Raptis D, Tselios N, Kjeldskov J, Skov MB. Does size matter?: investigating the impact of mobile phone screen size on users’ perceived usability, effectiveness and efficiency, Proc. 15th Int. Conf. Hum.-Comput. Interact. Mob. Devices Serv. ACM. 2013. p. 127–36.

    Google Scholar 

  23. Grindrod KA, Li M, Gates A. Evaluating User Perceptions of Mobile Medication Management Applications With Older Adults: A Usability Study. JMIR Mhealth Uhealth. 2014;2:e11.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Nawaz A, Helbostad JL, Skj\a eret N, Vereijken B, Bourke A, Dahl Y, et al. Designing Smart Home Technology for Fall Prevention in Older People. HCI Int. 2014-Posters’ Ext. Abstr. Springer; 2014. p. 485–90.

  25. McArthur LH, Raedeke TD. Race and sex differences in college student physical activity correlates. Am J Health Behav. 2009;33:80–90.

    Article  PubMed  Google Scholar 

  26. Raedeke TD. The relationship between enjoyment and affective responses to exercise. J Appl Sport Psychol. 2007;19:105–15.

    Article  Google Scholar 

  27. Amberg M, Fischer S, Schröder M. An evaluation framework for the acceptance of web-based aptitude tests. Electron J Inf Syst Eval. 2005;8:151–8.

    Google Scholar 

  28. Chen K, Chan AHS. A review of technology acceptance by older adults. Gerontechnology [Internet]. 2011 [cited 2015 Dec 16];10. Available from: http://gerontechnology.info/index.php/journal/article/view/1464.

  29. Brannen J. Mixing Methods: The Entry of Qualitative and Quantitative Approaches into the Research Process. Int J Soc Res Methodol. 2005;8:173–84.

    Article  Google Scholar 

  30. Mayring P. Qualitative Content Analysis. Forum Qual. Sozialforschung Forum Qual. Soc. Res. [Internet]. 2000;1. Available from: http://www.qualitative-research.net/index.php/fqs/article/view/1089

  31. Corbin J, Strauss A. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage Publications; 2014.

  32. UNHCR. UNHCR Global Appeal 2015 Update - Populations of concern to UNHCR [Internet]. UNHCR Glob. Appeal 2015 Update - Popul. Concern UNHCR. 2015. Available from: http://www.unhcr.org/5461e5ec3c.html.

  33. Phiriyapokanon T. Is a big button interface enough for elderly users. User Interface Guidel. Elder. Users Swed. Mälardalen Univ. Thesis Master Comput. Eng. 2011.

    Google Scholar 

  34. Kari T, Makkonen M, Moilanen P, Frank L. The habits of playing and the reasons for not playing exergames: Gender differences in Finland. 25th Bled EConference EDependability Reliab. Trust. EStructures EProcesses EOperations Eser. Future Res. Vol.-17-206 2012 Bled Slov. Pp 512–526 Ed. U Lechner Wigand Pucihar ISBN 978-961-232-256-4. 2012.

  35. Smeddinck J, Gerling KM, Tiemkeo S. Visual complexity, player experience, performance and physical exertion in motion-based games for older adults. ACM Press; 2013 [cited 2015 Dec 16]. p. 1–8. Available from: http://dl.acm.org/citation.cfm?doid=2513383.2517029.

  36. Brauner P, Calero Valdez A, Schroeder U, Ziefle M. Increase Physical Fitness and Create Health Awareness through Exergames and Gamification. In: Holzinger A, Ziefle M, Hitz M, Debevc M, editors. Hum. Factors Comput. Inform. [Internet]. Berlin, Heidelberg: Springer Berlin Heidelberg; 2013 [cited 2016 Jan 25]. p. 349–62. Available from: http://link.springer.com/10.1007/978-3-642-39062-3_22.

  37. Selwyn N. The information aged: A qualitative study of older adults’ use of information and communications technology. J Aging Stud. 2004;18:369–84.

    Article  Google Scholar 

  38. Consolvo S, Everitt K, Smith I, Landay JA. Design requirements for technologies that encourage physical activity. ACM Press; 2006 [cited 2015 Apr 8]. p. 457. Available from: http://portal.acm.org/citation.cfm?doid=1124772.1124840.

  39. Gerling KM, Masuch M. Exploring the potential of gamification among frail elderly persons, Proc. CHI 2011 Workshop Gamification Using Game Des. Elem. Non-Game Contexts. 2011.

    Google Scholar 

  40. Uzor S, Baillie L, Skelton D. Senior designers: empowering seniors to design enjoyable falls rehabilitation tools. ACM Press; 2012 [cited 2014 Aug 11]. p. 1179. Available from: http://dl.acm.org/citation.cfm?doid=2207676.2208568.

Download references

Acknowledgement

The iStoppFalls project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no [287361]. The Australian arm was funded by an Australian National Health and Medical Research Council (NHMRC) EU collaboration grant (#1038210). The content of the manuscript does not represent the opinion of the European Community or NHMRC. The funding sources had no influence in any aspects of this study. Yves J. Gschwind was financially supported by a research grant from the Margarete and Walter Lichtenstein Foundation, Basel, Switzerland. Stephen R. Lord was supported by NHMRC as a Senior Principal Research Fellow. Kim Delbaere was supported by a NHMRC as a Career Development Fellow. The other authors were supported by the European Community Grant Agreement 287361. We would like to thank all the technical engineers, software developers and research staff who contributed to the iStoppFalls project as well as the participants who took part in the study.

Authors’ contributions

Funding for the study was obtained by KD and RW. All authors were involved in the design and conduct of the trial. All authors contributed to writing the manuscript. DDV, KA, CO, TVR and RW drafted the manuscript. All authors critically revised and approved the final manuscript. The authors declare that the submitted paper, the data, and the results have not been published anywhere before.

Competing interests

The authors declare that they have no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daryoush D. Vaziri.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vaziri, D.D., Aal, K., Ogonowski, C. et al. Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab. Eur Rev Aging Phys Act 13, 6 (2016). https://doi.org/10.1186/s11556-016-0165-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s11556-016-0165-z

Keywords