The impact of data from remote measurement technology on the clinical practice of healthcare professionals in depression, epilepsy and multiple sclerosis: survey
BMC Medical Informatics and Decision Making volume 21, Article number: 282 (2021)
A variety of smartphone apps and wearables are available both to help patients monitor their health and to support health care professionals (HCPs) in providing clinical care. As part of the RADAR-CNS consortium, we have conducted research into the application of wearables and smartphone apps in the care of people with multiple sclerosis, epilepsy, or depression.
We conducted a large online survey study to explore the experiences of HCPs working with patients who have one or more of these conditions. The survey covered smartphone apps and wearables used by clinicians and their patients, and how data from these technologies impacted on the respondents' clinical practice. The survey was conducted between February 2019 and March 2020 via a web-based platform. Detailed statistical analysis was performed on the answers.
Of 1009 survey responses from HCPs, 1006 were included in the analysis after data cleaning. Smartphone apps are used by more than half of responding HCPs and more than three quarters of their patients use smartphone apps or wearable devices for health-related purposes. HCPs widely believe the data that patients collect using these devices impacts their clinical practice. Subgroup analyses show that views on the impact of this data on different aspects of clinical work varies according to whether respondents use apps themselves, and, to a lesser extent, according to their clinical setting and job role.
Use of smartphone apps is widespread among HCPs participating in this large European survey and caring for people with epilepsy, multiple sclerosis and depression. The majority of respondents indicate that they treat patients who use wearables and other devices for health-related purposes and that data from these devices has an impact on clinical practice.
The easy availability and reduced cost of mobile and wearable technologies is enabling individuals to record more data about their physical and mental health than ever before. Digital health smartphone apps (software installed and run on smartphones) are known to be used for a variety of healthcare-related purposes by both patients and clinicians. For example, a multi-national online survey found that diabetes apps are used by over half of those with type 1 and one third of those with type 2 diabetes . In a recent US study, just under half of survey respondents living with hypertension reported using apps to help manage it . In relation to central nervous system disorders, their use has been explored in the management of depressive and bipolar disorders for mood monitoring and contextual prompting (‘THINC-IT’ , ‘True Colours’ , ‘Wear-IT’ ), and systematic reviews of depression apps in 2015 and 2020 identified digitized therapeutic intervention, symptom tracking and psychoeducation as main functions of apps available for this market [6, 7]. In epilepsy, apps are available for a range of purposes, including to enter details of seizures to create a record (e.g. ‘Seizure Tracker’) and to notify an emergency contact if a person living with epilepsy does not respond to a daily prompt (‘Snug Safety’ app). A systematic review of the Apple app store for epilepsy or seizure-related apps also identified education and seizure trigger recording as functions of the available apps . Smartphone apps for multiple sclerosis include functions such as medication reminders and symptom trackers, in addition to assessment of function through games and questionnaires .
There are also a wide variety of apps available which are targeted at health care professionals (HCPs) , including apps providing clinical guidelines , apps with clinical task specific calculators , prescribing apps , and apps providing the ability for HCPs to communicate with each other and/or with patients and to inform decision-making. Both digital health apps aimed at patients and apps aimed at HCPs can be subject to regulation, depending on their intended purpose, as they may be designated ‘software as a medical device’ .
A large variety of off-the-shelf wearable sensing devices are commercially available, aimed at the public for the purpose of monitoring health and wellbeing. These include electronic wristbands, pedometers and devices designed for specific conditions such as epilepsy seizure detection wristbands. Many of these interface with smartphone apps to provide greater functionality. Wearable sensing devices allow their wearers to monitor many aspects of their daily lives, including steps taken, heart rate, sleep quality and duration, and exercise. As such, their use is generally for the ‘passive’ collection of data, without the user’s active input. Recently, their use as tools for monitoring patients with central nervous system disorders has garnered interest . Prior work has shown that connected digital products are used increasingly in clinical trials , demonstrating their value as tools to accurately record aspects of patient functioning. Patients themselves have a variety of views on the use of apps and wearables for monitoring specific conditions, including both benefits and challenges [17, 18].
When wearable devices and smartphone apps are used to collect data on human behaviour and physical parameters, these information-gathering tools are collectively described as remote measurement technology (RMT). The RADAR-CNS project, funded by Horizon 2020 and the Innovative Medicines Initiative, explores the potential of RMT in the clinical management of epilepsy, MS and depression. The consortium consists of a team of researchers, clinicians and a patient advisory board of individuals with lived experience of epilepsy, multiple sclerosis (MS), or depression (www.radar-cns.org). Project outputs to date have provided insight into the potential benefits of incorporating RMT in clinical pathways, via qualitative surveys of patients and healthcare professionals within the consortium  and interviews with HCPs outside the consortium . In these small studies, HCPs and patients envisaged multiple ways that RMT could permit both ‘active’ (direct user input of data, such as mood diaries) and ‘passive’ (collection of data without the requirement of the user to input data, e.g. step count, GPS location) collection of data to remotely assess patients with these conditions.
This paper adds to this body of work by exploring the experiences of a much larger number of HCPs working with patients with epilepsy, MS, or depression outside the consortium. In studies relating to health care technology, exploring views from a wide range of health care professionals working across different job roles has the benefit of reducing bias in the self-selection of research participants with a particular interest in or positive disposition toward health care technology . As such, the present research study aimed to elicit opinions and experiences from a broad sample of HCPs working in the care of patients with epilepsy, MS or depression.
The Covid-19 pandemic has seen the typical organisation of healthcare in England change to increase remote consultations in both primary  and secondary care  to reduce the risk of infection between patients and staff. It is therefore timely to explore opinions and experiences of HCPs on the use of smartphone apps and RMT.
Surveys are often used to elicit data from large populations and have been used to capture the views of clinicians [24, 25]. Since they require a short amount of time to administer and provide the opportunity to collect both quantitative and qualitative data, a survey was considered to be the most appropriate tool to learn more about HCP experiences, where these individuals have busy schedules and value the ability to complete these at a time of their choosing.
We conducted a large-scale, online survey, administered using the JISC Online Surveys platform . Informed consent was gathered through an information sheet and consent form at the beginning of the survey form. Ethical approval for this study was granted by the University of Nottingham research ethics committee (ref 277-1802) and by the UK Health Research Authority (ref 19/HRA/5041). Inclusion criteria were that respondents should be currently working in the care of people with epilepsy, MS or depression, within adult services.
Our main objectives in the present work were: (i) to determine the extent of smartphone app usage among health care professionals; (ii) to determine the extent of HCP experience of their patients’ use of RMT (including smartphone apps and wearables); and (iii) to understand the impact of patient RMT usage on HCPs’ work, including how this may vary by demographic factors.
There were nine pages of questions in the survey (see Additional file 1), in two broad sections. Textbox 1 shows a breakdown of sections of the survey. Survey questions were designed by the research team to reflect the goals of the research programme. Questions 1–7 concerned participant consent. Questions 8–16 were developed through consultation with expert clinicians from each of the three specialties, together with consideration of existing literature, in order to measure the value of various parameters for target conditions. Questions 17–26 were developed with consideration of potential scenarios of use between patients and clinicians and considering key challenges highlighted by clinical and HCI researchers. Early questions prompted respondents to think about their existing use of apps in their work role before continuing with more focused aspects relevant to making RMT work in clinical practice. The survey was designed pragmatically to elicit data whilst ensuring an accessible survey to encourage participation by busy healthcare professionals.
The survey respondents took a mean of 12 minutes to complete the survey, and were required to do so in a single sitting. In addition to collecting demographic information (questions 3–7), the focus of the first section of the survey was on current and past experience of HCPs’ use of smartphone apps and their patients’ use of RMT (smartphone apps and wearables). The second section had a different focus, exploring the future potential of RMT and the requirements for its future implementation. In this paper, we present results relating only to HCPs’ current/past experience of using smartphone apps and the impact of their patients’ use of RMT on their clinical role.
Textbox 1. Survey overview
Page 1: Participant Information and Consent
Page 2: Demographics/Healthcare Professional Role
Page 3: Current use of digital services and devices in your role as a Health Care Professional
Page 4: Your thoughts about using digital devices for long term monitoring of medical conditions
Page 5: Value of RMT
Page 6: Accessing and using the data
Page 7: Technical Support requirements
Page 8: Closing remarks
Demographic questions in the survey consisted of respondent age group; specialism; job role; clinical setting; and country of employment. Job role was collected by free text box and during data analysis, participant-provided job roles were sorted into the seven categories reported here. Ambiguous terms were categorised as ‘not specified’.
Question 8 required respondents to indicate whether they had used any kind of smartphone apps in their daily clinical practice (and if so, what genre of app). Question 9 asked respondents to indicate whether they had experienced their patients using different types of RMT devices (smartphone apps, wearable sensing devices or other devices) to improve or increase awareness of their health across six categories of purpose. Question 10 invited respondents to evaluate to what extent the data from patient’s RMT devices had an impact on the respondent’s clinical practice in five areas, each scored on a five-point Likert-style scale. The survey instrument is provided in Additional file 1.
The survey was disseminated via multiple routes:
The UK National Institute for Health Research (NIHR) Clinical Research Network
A targeted social media campaign across multiple European countries
Through the stakeholder group of the Innovative Medicines Institute (IMI)
Snowballed through professional contacts of the RADAR-CNS consortium members working in five European countries.
The survey was translated from English into five European languages spoken in the countries where the research consortium for the project operated. The first response was received on the 4th February 2019 and the last was received on the 30th March 2020.
Data were analysed using SPSS v.26 and Stata SE 16.1. We used descriptive statistics to understand the rates of responses from different demographic groups. Chi-squared tests were used to compare the rate of reported app usage (question 8) between different job roles and age groups, as well as to compare reported use of apps and devices by respondents’ patients. Responses to items in question 10, on the impact of patient RMT data on five aspects of clinical work, were dichotomised as 1 for responses of ‘definitely’ or ‘sometimes’, and 0 for responses of ‘unsure’, ‘hardly’, and ‘never’. ‘Unsure’ was grouped with the negative polarity items since respondents may have responded in this way if they did not have experience of using these technologies. Dichotomising the data rather than treating it as a 5-point scale had the benefit of resolving this ambiguity. For question 10 on the impact of RMT data on respondents’ clinical practice, univariate, then multivariate logistic regression was used to explore the effect of demographic variables and app usage on views of the impact of RMT data. A p-value of 0.05 was considered significant. For each categorical variable, the reference category chosen was the category with the largest number of responses. Missing responses were accounted for using multiple imputation, also conducted in STATA. 83 imputations were calculated for each missing entry, as the highest fraction of missing information (FMI) found in the analysis was 0.83 . A sensitivity analysis was used to examine the influence of missingness on parameter estimates by comparing the consistency of parameters estimates between models with imputed and observed datasets.
Survey responses were received from 1009 HCPs. The greatest proportion of these were completed as a result of efforts to recruit via the UK National Institute for Health Research (NIHR) Clinical Research Network: 21 National Health Service (NHS) healthcare trusts and Clinical Commissioning Groups (CCGs) across the UK advertised the survey to healthcare staff working with patients with epilepsy, MS or depression in their area. These trusts and CCGs reported that 650 staff had notified them that they had completed the survey, however it is likely a greater proportion of the total survey responses were obtained via this recruitment method, as it was not compulsory for respondents to notify their trust of their involvement. We did not include a survey item to ask where respondents had heard about the survey to preserve anonymity, so it is not possible to further attribute respondents to different recruitment methods.
Despite the survey being available in 5 European languages in addition to English, and efforts made to disseminate the survey to clinicians working in other countries (via social media, LinkedIn groups, contacts of the consortium, and via the Innovative Medicines Initiative steering group), the number of respondents reporting to be working in countries outside the UK was small (n = 30, 3% of total). These were analysed together with the UK responses as there were too few from each individual country to viably compare them statistically against the UK responses.
Of the 1009 completed surveys, 1006 were retained for analysis. Reasons for exclusion were insincere completion of the survey (n = 1) and improper completion of the consent form (n = 2). Figure 1 shows a STROBE flow diagram.
Table 1 shows a breakdown of the included survey responses by demographics. Age group categories followed a normal distribution, with the largest number of respondents in the middle category (ages 41–50, n = 293, 29% of respondents) and progressively fewer in older and younger age groups. The most frequently selected item under specialism was ‘mental health’ (n = 587, 38%), with the fewest selecting ‘social care’ (n = 32, 2%). Although relatively few respondents reported a specialism of ‘multiple sclerosis’ (n = 55, 4%) or ‘epilepsy’ (n = 73, 5%), a larger number reported working in neurology (n = 112, 7%), which is a specialism covering both these conditions. Among job roles, ‘nursing’ was the category with the largest proportion of responses. Doctors would have been the second most numerous category, however doctors were split into two categories of ‘GPs’ (n = 118, 12%) and ‘Doctor (excluding GP)’, (n = 138, 14%). ‘Clinical psychology professionals’ were therefore the second most numerous category, with 157 responses (16%). There was good representation from all clinical settings, with fewest (5%) from ‘specialist tertiary care’ settings, which might be expected due to their specialised nature. Most responses (97%) were from HCPs working in the UK. The second most reported country was Portugal, with 21 survey completions (2%).
Use of smartphone apps by clinicians
559 respondents (56%) indicated that they use digital health smartphone apps for at least one purpose in their clinical role. Figure 2 shows the percentages of respondents who reported using smartphone apps of each of the five types listed in this question. Guidelines apps were the most used (25%), while calculation apps were least used (11%). There was a spread of responses across all app types, with no app type receiving fewer than 10% of total responses.
Figure 3 shows the percentage of respondents in each job category who reported using smartphone apps in their daily clinical practice. A chi-squared test showed that there were significant differences between job roles for this question (χ2 = 106.348, p < 0.01). Pharmacists and medical students were most likely to report using any apps, although there were fewer survey completions overall from these job roles. Further analysis revealed that of the different types of app listed, pharmacists were most likely to report using prescribing/dosing apps (87% of pharmacist respondents), and medical students were most likely to use guidelines apps (80% of student respondents). 40% of GP respondents and 38% of doctors excluding GPs reported using guidelines apps. Clinical psychology professionals and allied health professionals were least likely to report using smartphone apps of any kind.
Question 8a invited respondents to provide examples of other types of app that they used in their daily clinical practice. Table 2 provides a random subsample of the responses, with information on the publisher, category, cost and target condition of these, where relevant. Responses covered apps published by the NHS, charities, commercial organisations, and public bodies. Apps mentioned included a large number targeting mental health, with fewer focussed on neurological conditions, which could be expected given the larger proportion of responses from mental health specialists in the sample. Many of these apps are either patient-facing or have a focus on wellbeing and it is possible that respondents understood this question to mean apps they recommend to their patients, rather than apps they use themselves to facilitate their job role.
Across all age categories, between 50 and 60 percent of respondents reported using apps. The highest percentage was reported by those in the over-60 category. However, a chi-squared test on these age groupings was non-significant (χ2 = 1.848, p = 0.76).
Patient use of RMT for health-related purposes
78% of respondents indicated that their patients used RMT (one or more of smartphone apps, wearables, or other type of device) to improve or increase awareness of their health. Figure 4 shows the relevant percentages for different purposes. Activity monitoring was selected by the largest proportion of respondents (62%). Sleep monitoring was also selected by more than half of respondents (53%). Of the given categories, monitoring for a specific condition was least selected (31%).
Figure 5 shows the split of these responses across different device types. Further to the above, this shows that wearable sensing devices are most commonly reported to be used for passive monitoring of activity and sleep, while smartphone apps were used more often than wearable devices for monitoring mood, setting personal health goals and weight management.
A sub-group analysis by job role showed that there were significant differences between job roles for this question (χ2 = 154.952, p < 0.01). This is shown in Fig. 6. A greater proportion of GPs than other types of health professional had experienced their patients using devices to monitor activity (88% of GP respondents), monitor sleep (66%) and manage weight (66%).
Impact of RMT data on respondents’ clinical work
Sub-questions 10.1–10.5 asked respondents about the impact of the data from patients’ RMT devices on different aspects of respondents’ clinical work. Figure 7 shows these results. Across all sub-questions, the mean percentage of respondents indicating that the data from RMT ‘definitely’ or ‘sometimes’ had an impact on their work was 62%. The mean percentage of those indicating that it ‘hardly’ or ‘never’ had an impact was 27%. A greater proportion of respondents selected ‘definitely’ or ‘sometimes’ for sub-question 10.4 (Does RMT data impact patients’ awareness of their own health?) than for any of the other sub-questions.
Results from univariate and multivariate logistic regression analyses with multiple imputation and using questions 3–8 as independent variables and sub-questions 10.1–10.5 as dependent variables are provided in Tables 3, 4, 5, 6 and 7. An analysis for multicollinearity revealed no variance inflation factor (VIF) greater than 3.5, suggesting that multicollinearity did not affect the results. Results from multiple imputation and observed datasets were consistent in term of the parameter estimate and its precision.
Across all five sub-questions in question 10, the independent variable on HCP use of smartphone apps (question 8), gave a significant result in the multivariate logistic regression models, indicating that those respondents who reported using apps were more likely to respond with ‘definitely’ or ‘sometimes’ to the items discussing the impact of data from RMT on their work.
In relation to clinical setting, the reference category across all regression analyses in sub-questions 10.1 to 10.5 was ‘primary care’. The univariate analyses showed that in all 5 sub-questions, respondents from at least one category of setting gave responses which were significantly different to those in primary care. The odds ratios in these cases were below one, indicating that respondents working in multiple settings outside of primary care were less likely than those in primary care to respond positively (choose ‘definitely’ or ‘sometimes’ rather than ‘unsure’, ‘hardly’ or ‘never’) concerning the impact of RMT on their work. However, in the multivariate regression analyses, only 4 out of 5 sub-questions (10.1, 10.2, 10.4 and 10.5) showed significant differences between primary care and other settings, when other variables were controlled for.
With regard to job role, the reference category was ‘doctors (excluding GPs)’. In 3 out of the 5 question items, the general practitioner job role was significantly different to the reference category (doctors excluding GPs) in the univariate regression analysis, however this was not sustained in the multivariate models for these sub-questions where other variables were controlled for.
In relation to age, only sub-question 10.5, concerning the impact of RMT data on decision-making processes in consultations, showed any difference between age groups. Here, according to both univariate and multivariate models, respondents in the 18–30 age category were less likely than those in the reference category (ages 41–50) to indicate that patients’ RMT data had an impact on their decision-making processes during consultation. There was no significant difference between any specialism and the reference category (mental health) in the regression models for any of the question items.
This study achieved its aim of eliciting views from a large sample of healthcare staff working in the care of patients with epilepsy, MS or depression. The results from this study have added to prior work in this area [19, 20] by showing that smartphone apps are used by more than half (56%) of HCPs and that more than three quarters (78%) report that their patients use RMTs for health-related purposes. These figures are greater than in previous research studies that surveyed the use of apps in treatment by healthcare professionals working in epilepsy, where 45% of respondents previously reported using apps with their patients , and in depression, where 21.2% of respondents in a prior study stated they used apps in treatment for depression . Our findings thus may indicate their growing use in clinical practice (no prior evidence is available on clinicians’ use of apps in MS).
HCPs reported that their patients use smartphone apps for the purposes of: managing weight; setting personal health goals; and monitoring sleep, activity and mood. Wearable sensing devices are used by their patients for sleep and activity monitoring, and a smaller percentage report patient use of these devices for weight management and monitoring a specific condition (Fig. 5). The majority of HCPs (mean average 62%) indicated that the data from these RMTs impacts their clinical practice and also indicated that RMT data has an impact on their patients’ awareness of their own health (see Fig. 7). Specifically, RMT data was found to impact on communication with patients, on HCPs’ understanding of patient health state, and on HCPs’ decision-making processes. Regression analyses show that HCP views on the impact of RMT data vary according to whether respondents use apps themselves. This adds to recent research in the area of depression care indicating an association between level of technology experience and consideration of use of apps in clinical practice . Views on the impact of RMT data were also found to vary according to clinical setting, job role and age.
Our results suggest RMT is currently having a greater impact in primary care than in other healthcare sectors. A higher proportion of general practitioner respondents reported their patients used devices to monitor activity and sleep and manage weight than in other job roles. This suggests a greater awareness among GPs than among other health care professionals concerning the devices patients use, and the purposes for which they may use them. In addition, GPs were significantly more likely than other kinds of doctor to indicate that RMT data had an impact on their work, on 3 out of 5 questions on this topic (see Tables 3, 4, 5, 6 and 7). Furthermore, those working in primary care were significantly more likely than those in secondary care (mental health outpatient), community care and ‘other’ settings to report that RMT data impacted their work, on all five questions on this topic. This may be because patients are more likely to discuss the data from devices they have bought themselves with primary care practitioners, who they see more regularly, and for whom relational aspects of their work are considered more important. While prior work in both Denmark  and the UK  has shown that general practitioners recognise benefits to patient use of wearables and apps, the present study has demonstrated more precisely how the attitudes of primary care professionals differ from those in other areas of care.
Our sub-group analysis of job roles that use apps in their clinical practice revealed that a larger proportion of pharmacists (100%) and medical students (90%) use apps in their clinical practice than those in other job categories. The most commonly used app types by these groups were prescribing/dosing apps and guidelines apps, respectively. However, it is important to note that these job roles were only represented by a small number of respondents relative to other job roles (15 pharmacists and 10 medical students), meaning it is possible that only those very most interested in the application of technology chose to take part in this study.
Our data on the type of RMT device used by patients for each health-related purpose (Fig. 6) showed that use of wearables was less prevalent than use of smartphones for certain purposes (weight management, setting personal health goals, monitoring mood). Recalling that this survey was conducted with HCPs rather than patients, it is possible that HCPs are unaware that their patients use wearables in these ways where patients do not deem it relevant to inform clinicians of this, and thus their use may be under-represented in these survey results. Wearables are not as ubiquitous as smartphones, and this may also explain the lower reported use of these for health-related purposes. Another possible explanation is that wearable devices have smaller screens and lack the space to incorporate an easy method for manual data entry and are thus better suited to ‘passive’ means of data collection than ‘active’ means.
In comparison to other health conditions, this survey, targeting HCPs working in the care of people with MS, epilepsy or depression, demonstrated a higher proportion of respondents reporting patients using RMT for health related purposes (78%) than was the case in studies on diabetes (type 1: < 60%, type 2: ~ 33%)  and hypertension (< 50%) . Given the recency of these prior studies, it is unlikely that this is simply a result of technologies becoming more widespread, and may reflect a difference in how these conditions are managed, with both blood pressure and blood sugar being measured using bespoke (non-wearable) devices, and therefore not requiring a smartphone app to be able to measure the symptoms of these conditions.
Our work is novel in exploring views on the application of these technologies in the care of people with epilepsy, MS, or depression, from a large sample. This evidence adds to a growing body of work understanding the relationships between healthcare technology use, competence and adoption by healthcare professionals. Recent work by Vallo et al.  indicates that adoption and use of digital technology are “related to perceived performance, social influence and organisational context” and the role of ICT [Information and Communication Technology] in clinical professional development. This work highlights the need for a holistic service design approach  to reduce external and internal barriers to adoption and optimise the benefits and professional competence of use of these technologies in practice .
Recommendations for future work
While HCPs reported using apps, some of the app names they reported appear to be patient-facing, and it is not clear from our data whether they are using these apps themselves or are recommending these to their patients. We cannot tell from our study the extent to which apps and wearables are prescribed or recommended to patients by healthcare professionals. In the UK, some smartphone apps are now highlighted in the NHS apps library , and the National Institute for Health and Care Excellence (NICE) has issued guidance that HCPs consider digital mobile health interventions, including smartphone apps, for behaviour change . However, the present study has not been able to ascertain how many HCPs actively recommend these to their patients and this is an interesting question for future work. In other European countries including Germany and Sweden, governments incentivise HCPs to recommend digital solutions to their patients . Further work could also usefully compare use of treatment pathways involving apps and wearables in countries with different incentivisation policies to understand the benefits of these approaches. There are also questions around the regulation of apps and the effect of regulation on their adoption that could be usefully explored.
Recently, NHS guidance has been aimed at primary and secondary care services reducing face-to-face appointments during the COVID-19 pandemic [23, 36] and there is some suggestion that healthcare professionals may have become more favourably disposed to the use of digital technologies to support their clinical practice during this period . However, this evidence relates largely to the use of video conferencing software and telephone consultations rather than the use of wearables and apps to generate data on behavioural and physiological aspects of health, although these are beginning to be evaluated in practice. Given that clinicians would be required to review the data from such RMT on a digital device (e.g. computer) even if patients were present at a face-to-face appointment, it is not clear whether the recent reduction in face-to-face appointments would cause a change of attitudes towards the use of this data in practice. Further work would be required to understand precisely how views on these specific areas may have changed or not because of the reorganisation of care for non-COVID-19 patients during the pandemic.
Strengths and limitations
A key strength of this study is the large sample size, with over 1000 respondents. Another is the exploration of the impact that RMT data has on patient care. The application of regression techniques has enabled us to control for demographic factors when exploring the variation in these views. Despite a coordinated effort to facilitate responses from clinicians working outside of the UK (translation into multiple European languages, advertisement via social media, network connections), the proportion of those working in other countries among respondents to the survey was small. However, we were able to reach a representative sample of respondents from different age groups, job roles and clinical settings, which has enabled sub-group analyses of the views and experiences presented. There is some risk that the self-selecting sample for this study were those most interested in the use of technology and this may mean that views expressed are more positive than is the case across all healthcare professionals. A small percentage of respondents (6%) were from management or healthcare science roles where their contact with patients, and therefore their understanding of factors relevant to the application of RMT, may be more limited. As an exploratory study, the data were analysed without multiplicity adjustment and results were mainly interpreted for exploratory and not confirmatory purposes .
This survey study achieved its aim of eliciting opinions and experiences from a large sample of HCPs working in the care of patients with epilepsy, MS or depression. Our main objectives in the present work were: (i) to determine the extent of smartphone app usage among health care professionals; (ii) to determine the extent of HCP experience of managing patients’ use of RMT; and (iii) to understand the impact of patient RMT usage on HCPs’ work, including how this may vary by demographic factors. The results show that prior to the COVID-19 pandemic, smartphone apps were already widely used by more than half of HCPs (objective i), and RMT was used by more than three quarters of their patients (objective ii). HCPs widely believed that the data from RMT impacted their clinical practice, although there is some evidence that their views vary according to demographic and technology usage factors (objective iii). We consider it unlikely that views on the usefulness of the data from RMT will be substantially different after the pandemic, given similar practical requirements for its application in both face-to-face and remote consultations, although further research would be needed to test this hypothesis. We do expect that more HCPs will become more familiar with RMT and that adoption of mobile platforms will become more prevalent in routine health and social care settings in the aftermath of COVID-19.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Coronavirus Disease 2019
Clinical Commissioning Group
Fraction of Missing Information
Information Communication Technology
Global Positioning System
National Health Service
National Institute for Health and Care Excellence
National Institute for Health Research
Remote Assessment of Disease and Relapse – Central Nervous System
Remote Measurement Technology
Strengthening the Reporting of Observational Studies in Epidemiology
Kebede MM, Schuett C, Pischke CR. The role of continuous glucose monitoring, diabetes smartphone applications, and self-care behavior in glycemic control: results of a multi-national online survey. J Clin Med. 2019;8(1):66. https://doi.org/10.3390/jcm8010109.
Langford AT, Solid CA, Scott E, Lad M, Maayan E, Williams SK, et al. Mobile phone ownership, health apps, and tablet use in US adults with a self-reported history of hypertension: cross-sectional study. JMIR Mhealth Uhealth. 2019;7(1): e12228. https://doi.org/10.2196/12228.
McIntyre RS, Best MW, Bowie CR, Carmona NE, Cha DS, Lee Y, et al. The THINC-Integrated Tool (THINC-it) Screening Assessment for cognitive dysfunction: validation in patients with major depressive disorder. J Clin Psychiatry. 2017;78(7):873–81. https://doi.org/10.4088/JCP.16m11329.
Goodday SM, Atkinson L, Goodwin G, Saunders K, South M, Mackay C, et al. The true colours remote symptom monitoring system: a decade of evolution. J Med Internet Res. 2020;22(1): e15188. https://doi.org/10.2196/15188.
Brick TR, Mundie J, Weaver J, Fraleigh R, Oravecz Z. Low-burden mobile monitoring, intervention, and real-time analysis using the wear-IT framework: example and usability study. JMIR Form Res. 2020;4(6): e16072. https://doi.org/10.2196/16072.
Qu C, Sas C, Dauden Roquet C, Doherty G. Functionality of top-rated mobile apps for depression: systematic search and evaluation. JMIR Ment Health. 2020;7(1): e15321. https://doi.org/10.2196/15321.
Shen N, Levitan MJ, Johnson A, Bender JL, Hamilton-Page M, Jadad AA, et al. Finding a depression app: a review and content analysis of the depression app marketplace. JMIR Mhealth Uhealth. 2015;3(1): e16. https://doi.org/10.2196/mhealth.3713.
Escoffery C, McGee R, Bidwell J, Sims C, Thropp EK, Frazier C, et al. A review of mobile apps for epilepsy self-management. Epilepsy Behav. 2018;81:62–9. https://doi.org/10.1016/j.yebeh.2017.12.010.
Stoll S, Litchman T, Wesley S, Litchman C. Multiple sclerosis apps: the dawn of a new era: a comprehensive review (P3.2–021). Neurology. 2019;6:66.
Mosa ASM, Yoo I, Sheets L. A systematic review of healthcare applications for smartphones. BMC Med Inform Decis Mak. 2012;12(1):67. https://doi.org/10.1186/1472-6947-12-67.
Holcroft J. Clinical Guidelines App. http://guidelinesapp.com/. Accessed 29 Sept 2020.
Bierbrier R, Lo V, Wu RC. Evaluation of the accuracy of smartphone medical calculation apps. J Med Internet Res. 2014;16(2): e32. https://doi.org/10.2196/jmir.3062.
Haffey F, Brady RR, Maxwell S. Smartphone apps to support hospital prescribing and pharmacology education: a review of current provision. Br J Clin Pharmacol. 2014;77(1):31–8. https://doi.org/10.1111/bcp.12112.
Gordon WJ, Landman A, Zhang H, Bates DW. Beyond validation: getting health apps into clinical practice. NPJ Digit Med. 2020;3:14. https://doi.org/10.1038/s41746-019-0212-z.
Ranjan Y, Rashid Z, Stewart C, Conde P, Begale M, Verbeeck D, et al. RADAR-base: open source mobile health platform for collecting, monitoring, and analyzing data using sensors, wearables, and mobile devices. JMIR Mhealth Uhealth. 2019;7(8): e11734. https://doi.org/10.2196/11734.
Marra C, Chen JL, Coravos A, Stern AD. Quantifying the use of connected digital products in clinical research. NPJ Digit Med. 2020;3(1):50. https://doi.org/10.1038/s41746-020-0259-x.
Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrao J, et al. Barriers to and facilitators of engagement with remote measurement technology for managing health: systematic review and content analysis of findings. J Med Internet Res. 2018;20(7): e10480. https://doi.org/10.2196/10480.
Simblett S, Matcham F, Siddi S, Bulgari V, di San Barattieri, Pietro C, HortasLopez J, et al. Barriers to and facilitators of engagement with mHealth technology for remote measurement and management of depression: qualitative analysis. JMIR Mhealth Uhealth. 2019;7(1):e11325. https://doi.org/10.2196/11325.
Craven MP, Andrews JA, Lang AR, Simblett SK, Bruce S, Thorpe S, et al. Informing the development of a digital health platform through universal points of care: qualitative survey study. JMIR Form Res. 2020;4(11): e22756. https://doi.org/10.2196/22756.
Andrews JA, Craven MP, Jamnadas-Khoda J, Lang AR, Morriss R, Hollis C, et al. Health care professionals’ views on using remote measurement technology in managing central nervous system disorders: qualitative interview study. J Med Internet Res. 2020;22(7): e17414. https://doi.org/10.2196/17414.
Eysenbach G, Wyatt J. Using the Internet for surveys and health research. J Med Internet Res. 2002;4(2):E13. https://doi.org/10.2196/jmir.4.2.e13.
Majeed A, Maile EJ, Bindman AB. The primary care response to COVID-19 in England’s National Health Service. J RSoc Med. 2020;113(6):208–10. https://doi.org/10.1177/0141076820931452.
NHS England, NHS Improvement. Clinical guide for the management of remote consultations and remote working in secondary care during the coronavirus pandemic. 2020. Accessed 27 March 2020.
Kuek A, Hakkennes S. Healthcare staff digital literacy levels and their attitudes towards information systems. Health Inform J. 2020;26(1):592–612. https://doi.org/10.1177/1460458219839613.
Kerst A, Zielasek J, Gaebel W. Smartphone applications for depression: a systematic literature review and a survey of health care professionals’ attitudes towards their use in clinical practice. Eur Arch Psychiatry Clin Neurosci. 2020;270(2):139–52. https://doi.org/10.1007/s00406-018-0974-3.
JISC. The online survey tool designed for academic research, education and public sector organisations. www.onlinesurveys.ac.uk.
White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011;30(4):377–99. https://doi.org/10.1002/sim.4067.
Bruno E, Simblett S, Lang A, Biondi A, Odoi C, Schulze-Bonhage A, et al. Wearable technology in epilepsy: the views of patients, caregivers, and healthcare professionals. Epilepsy Behav. 2018;85:141–9. https://doi.org/10.1016/j.yebeh.2018.05.044.
Brandt CJ, Sogaard GI, Clemensen J, Sndergaard J, Nielsen JB. General practitioners’ perspective on ehealth and lifestyle change: qualitative interview study. JMIR Mhealth Uhealth. 2018;6(4): e88. https://doi.org/10.2196/mhealth.8988.
Vallo Hult H, Hansson A, Gellerstedt M. Digitalization and physician learning: individual practice, organizational context, and social norm. J Contin Educ Health Prof. 2020;40(4):220–7. https://doi.org/10.1097/CEH.0000000000000303.
Shaw J, Agarwal P, Desveaux L, Palma DC, Stamenova V, Jamieson T, et al. Beyond “implementation”: digital health innovation and service design. NPJ Digit Med. 2018;1:48. https://doi.org/10.1038/s41746-018-0059-8.
Mesko B, Gyorffy Z. The rise of the empowered physician in the digital health era: viewpoint. J Med Internet Res. 2019;21(3): e12490. https://doi.org/10.2196/12490.
NHS. NHS Apps Library. 2021. https://www.nhs.uk/apps-library/. Accessed 19 Feb 2021.
National Institute for Health and Care Excellence (NICE). NICE Guideline [NG183] Behaviour change: digital and mobile health interventions. 2020.
Brinkmann-Sass C, Richter L, Silberzahn T, Somauroo A. The European path to reimbursement for digital health solutions. McKinsey & Company, 2020. Accessed 17 Sept 2020.
NHS England, NHS Improvement. Coronavirus guidance for clinicians and NHS managers. 2020.
Intelligence DH. NHS IT leadership Survey 2020. 2020.
Bender R, Lange S. Adjusting for multiple testing–when and how? J Clin Epidemiol. 2001;54(4):343–9. https://doi.org/10.1016/s0895-4356(00)00314s-0.
We would like to acknowledge the support of all members of the RADAR-CNS consortium, who are named on the RADAR-CNS webpage (http://www.radar-cns.org/). The RADAR-CNS project has received funding from the Innovative Medicines Initiative (IMI) 2 Joint Undertaking under Grant Agreement No 115902 (http://www.imi.europa.eu/). This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and the European Federation of Pharmaceutical Industries and Associations (EFPIA). This communication reflects the views of the RADAR-CNS consortium, and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein. The funding body has not been involved in the design of the study, the collection or analysis of data, or the interpretation of data. This research was supported by the NIHR MindTech MedTech Co-operative, NIHR Nottingham Biomedical Research Centre, and NIHR Applied Research Collaboration East Midlands. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care.
The RADAR-CNS project has received funding from the Innovative Medicines Initiative (IMI) 2 Joint Undertaking under Grant Agreement No 115902. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and the European Federation of Pharmaceutical Industries and Associations (EFPIA). This research was supported by the NIHR MindTech MedTech Co-operative, NIHR Nottingham Biomedical Research Centre, and NIHR Applied Research Collaboration East Midlands. The funding bodies did not take a role in the design of the study or collection, analysis or interpretation of the data or in the writing of the manuscript.
Ethics approval and consent to participate
This study was conducted in accordance with the Declaration of Helsinki and received a favourable review from the University of Nottingham Research Ethics Committee (ref 277-1802) and from the Health Research Authority (Ref 19/HRA/5041). Respondents provided informed consent to take part in the study by reading the information provided on the first page of the study and indicating consent using the questions listed on the first page of the online questionnaire.
Consent for publication
Survey respondents remained anonymous and as such this section is not applicable.
There are no competing interests to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Andrews, J.A., Craven, M.P., Lang, A.R. et al. The impact of data from remote measurement technology on the clinical practice of healthcare professionals in depression, epilepsy and multiple sclerosis: survey. BMC Med Inform Decis Mak 21, 282 (2021). https://doi.org/10.1186/s12911-021-01640-5