- Open Access
A telemonitoring system to support CPAP therapy in patients with obstructive sleep apnea: a participatory approach in analysis, design, and evaluation
BMC Medical Informatics and Decision Making volume 22, Article number: 168 (2022)
Continues positive airway pressure (CPAP) therapy is a gold standard treatment for moderate to severe cases of OSA (obstructive sleep apnea). The present research aimed to describe the analysis, design, and evaluation of a telemonitoring system to improve CPAP adherence in patients afflicted with OSA.
The telemonitoring system was developed in five phases. In the exploratory phase, the body of related literature was reviewed. Then a need analysis was conducted through a focus group discussion with sleep medicine specialists and sales company representatives and an interview with patients. The third phase involved data integration. Then the content and system development were done based on the previous phases. Finally, usability and functionality tests were used to evaluate the system.
The exploratory phase and the needs analysis were conducted by four sleep medicine specialists, two medical informatics specialists, six key figures of the sales companies, two system developers, and 46 patients in different phases. Based on the results obtained from the data integration phase, the telemonitoring system involved three main parts: a patient’s application, a doctor’s portal, a selling companies’ portal (operator’s portal) along with facilitating software for patients to send the CPAP data. Usability and functionality tests were given to 7 and 10 patients, respectively. The total number of usability issues reported by users in the evaluation process was 18, with an average of 2.5 issues per user. The installation problems, disrupted links and improper playing of videos were the main functionalities problems that were solved.
The telemonitoring system, as a means of communication between patients, doctors, and selling companies, can be used to support patients clinically and technically. It has the potential to improve CPAP adherence in patients with OSA.
The study developed and evaluated a telemonitoring system to support CPAP therapy in patients with obstructive sleep apnea.
Participatory approach in analysis, design and evaluation increased the potential effectiveness of the telemonitoring system.
Using different data collection methods can guarantee meeting all requirements and make using the existing capabilities in the best way.
Using the behavior change techniques in preparing content and system capabilities probably enhances the changing patient’s behavior in using the CPAP device.
Using different system evaluation methods can help identify system defects and correct them in further research.
Obstructive sleep apnea (OSA) is the most common sleep disorder caused by temporary obstruction of the upper airway during sleep. As the findings reported by Benjafield et al. (2019) showed, an overall number of 936 million adults aged 30–69 years indicated mild to severe obstructive sleep apnea (AHI ≥ 5 events/hour). Besides, 425 million adults whose ages ranged between 30 and 69 years had a moderate to severe level of obstructive sleep apnea (AHI ≥ 15 events/hour) on a global scale . This disease negatively influences the patients’ quality of sleep. It further adversely affects arterial oxygen and can lead to disruption of daily routines, deadly accidents, metabolic syndrome, cardiovascular diseases, and even death caused by a heart attack or cerebral stroke. A timely diagnosis and treatment of sleep apnea can reduce the morbidity and mortality rate [2,3,4].
Continuous positive airway pressure (CPAP) is the gold standard treatment for moderate to severe cases of OSA. CPAP therapy is only effective when the CPAP device is used regularly and for a long time . Yet, patients’ adherence to its regular use has shown to be poor. The non-adherence rate is 34.1%, which reduces the therapeutic effect [6, 7]. It seems that with the advent of new telecommunication technologies, it is time to move towards patient-centered interventions that provide remote monitoring, usually via telemedicine.
It has proved that telemedicine is effective in the management of sleep disorders . The data recorded by the CPAP device (e.g., the pressure of the device, mask leakage, number of apnea, etc.) are easily transferred to the healthcare center and the pressure of the device is easily adjusted from a distance. Therefore, telemedicine can help a complete evaluation of real adherence to CPAP. A body of research showed that educating patients on OSA and using CPAP and providing feedback can be done through communication channels such as videoconferencing, mobile applications, and websites [9,10,11,12,13].
On the one hand, patients with OSA that undergo CPAP therapy require constant clinical and technical support for adherence to medical orders. In such circumstances, telemedicine has the potential to empower and improve self-care in patients with chronic diseases, including OSA. Thus, we require appropriate tools that can provide telemedicine services for patients. Accordingly, the present research aims to describe the analysis, design, and evaluation of a telemonitoring system for patients afflicted with OSA, who undergo CPAP therapy.
Design and setting
The present research is a qualitative study using a participatory approach to engage all stakeholders including patients with OSA who used CPAP machines, sleep medicine specialists, sales companies, researchers, and software developers, in different steps of need analysis, design, and evaluation process.
The study was conducted in Mashhad, the second metropolis of Iran. All sleep medicine specialists who participated in this study were faculty members of Mashhad University of Medical Sciences. The patients were selected in two ways: those who had purchased their CPAP device from Resmed or Weinmann companies in Mashhad and those who were referred to the specialists mentioned above to treat sleep apnea and for follow-up purposes.
The present research was conducted in five phases. The first was exploratory and investigated the body of related literature. In the second phase, a need analysis was done with the cooperation of the main stakeholders. The third phase involved data integration. The fourth phase involved content development and the design of a telemonitoring system named Roya. The fifth phase involved the evaluation of the content and system. Figure 1 summarizes this procedure.
The body of related literature on sleep apnea treatment and a focus on patient’s adherence to CPAP belonged to either of the following two categories:
Studies with a focus on effective factors for adherence to CPAP
Studies implementing an intervention to increase adherence to CPAP
Exploring effective factors on adherence to CPAP
In the body of related literature, among the effective factors of adherence to CPAP were patients’ characteristics, the severity of disease, side effects of using the device, method of conducting the sleep test and titration, claustrophobia, inadequate support of the clinical team, lacking cooperation of the spouse, inadequate knowledge and high costs of treatment and equipment. These were among the main barriers to adherence to treatment [7, 14,15,16,17,18]. Among the facilitators of adherence to CPAP were: the willingness to rid of symptoms and a positive attitude to treatment, awareness of the adverse effects of the disease, fear of the social consequences, disrupting others’ sleep, trust in healthcare providers, spouse’s cooperation, feeling physically improved, use of a humidifier, changing the design of the device, benefiting of social, clinical and behavioral change supports [7, 14,15,16,17,18].
Exploring interventions for adherence to CPAP
According to a review by Askland et al. (2020) published by Cochrane , interventions in the literature can be divided into three types, educational, supportive and behavioral.
Educational interventions These interventions provide general information about OSA and CPAP therapy through different techniques including educational videos, group sessions, personalized explanation of polysomnography (PSG) reports, and positive/negative risk message framing [20,21,22,23]. Although educating patients is the primary way of involving them in the therapeutic process, it has a minor effect on CPAP adherence as a complicated behavior . So, it is suggested the educational interventions be accompanied by other interventions.
Supportive interventions These interventions provide participants with further clinical follow-up by the clinical staff through telemonitoring to remove barriers or difficulties in using CPAP. The principal privilege of this type of intervention is that patients are encouraged to provide regular feedback on the experience of using the device. Therefore, the therapeutic barriers and problems are removed at the right time. Telemonitoring services in different formats and platforms, such as peer support, web-based, and personalized programs are among supportive interventions [24,25,26,27,28,29,30].
Behavioral interventions These include interventions with psychotherapeutic techniques based on behavioral, cognitive, or models related to health behavior change. Behavioral interventions addressed modifiable and measurable constructs that influenced the health beliefs about OSA and CPAP therapy and adherence to CPAP behavior. In different studies, various motivational strategies such as Motivational Enhancement Therapy (MET), Socio-Cognitive Theory (SCT), and habit formation audiotapes [31,32,33,34] were mixed with educational and supportive materials to enhance effectiveness [35,36,37,38,39].
In the second phase, a need analysis was done with the cooperation of the main stakeholders. The purpose was to gain an in-depth understanding of the services needed by patients. So, after each meeting, the key concepts were extracted and presented at the next session to explore more.
Meeting with sleep medicine specialists
To better understand the requirements to provide telemedicine services for OSA patients who use CPAP, different meetings were held with a panel of sleep medicine specialists (n = 4) and medical informatics specialists (n = 2). In these meetings, patients’ needs and current follow-up plans by physicians and selling companies were investigated.
Meeting with key figures of the device selling companies
These meetings were independently held with the key figures of the Resmed (n = 4) and Weinmann (n = 2) companies. In these meetings, services provided to patients such as follow-up plans and instructional materials, and technical capabilities and limitations of devices were discussed.
Interview with patients
To know the needs of patients who use CPAP, semi-structured in-depth interviews were held with 29 patients who did not adhere to the treatment. The detail is described in our previous paper .
According to the literature review, multiple meetings with sleep specialists and key figures of the device selling companies, and patients’ interviews, the following topics were extracted:
Use of different architectures for the telemonitoring system in other countries and further investigations to design and implement the new system in Iran considering the existing technical limitations,
Physicians’ concerns about the independence of the device selling companies in the patients’ follow-up and the lack of continuous communication with healthcare providers,
Companies’ emphasis and willingness to involve the clinical team in patient follow-up and provision of clinical support,
Technical issues such as the absence of a data sending option in CPAP device in a wireless mode to the central system,
Barriers to CPAP adherence such as patients’ inadequate knowledge and patients problems in using CPAP device,
Use of a combination of different interventions (educational, supportive, and behavioral) to increase effectiveness,
Apply behavior change theories and techniques to influence the health beliefs about OSA and CPAP therapy and adherence to CPAP behavior.
System and content development
Based on topics 1, 2, 3, and 4, the required parts for designing the telemonitoring system were recognized. This system had to be designed in a way to communicate with different groups (e.g., doctors as the clinical service providers, the device selling companies as the technical service providers, and patients as the service recipients). Also, certain facilities had to be provided for patients to send the CPAP data. Thus, three main parts were proposed including the patient’s application, the doctor’s portal, and the operator’s portal (selling company’s portal) along with facilitating software for patients to send the CPAP data.
Topics 5, 6, and 7 led us to provide clinical, educational, and behavioral supports for patients, simultaneously.
Clinical support involves medical support by doctors such as advice on mask replacement, change of pressure, the answers to medical queries, and other instances of medical support.
Educational support refers to information provided to raise patients’ awareness of apnea and CPAP therapy.
Behavior change support refers to measures taken specifically to change a patient’s way of thinking or acting based on a behavior change model or theory to increase the rate of using CPAP eventually.
Clinical support was provided by monitoring patients’ status and sending appropriate feedback and recommendations through the doctor’s portal. Also, to provide education and behavioral support, the applicable content was made available through the patient’s application. It is noteworthy that some of the information displayed on the doctor’s portal and the patient’s application was fed by data in the operator’s portal. The details are described in the result section.
Content development and evaluation
To provide content for the patient’s application, considering the extracted topics and previous findings [40,41,42,43], the socio-cognitive theory (SCT) was selected as the basis of content development, which has four constituent constructs: knowledge, perceived risk, outcome expectancy, and self-efficacy.
Perceived risk has to do with the patient’s perceived susceptibility to health threats. In other words, perceiving that untreated OSA is followed by adverse effects. Outcome expectancy refers to the potential outcomes of using or not using CPAP and the possible impact of using CPAP on reducing the associated risks. Self-efficacy implies one’s perceived capability of showing a particular behavior. In other words, it involves perceiving oneself as capable of using the CPAP device regularly under any condition.
Considering socio-cognitive theory and behavior change techniques [54, 55], sleep apnea-related (the definition, symptoms, risk factors, and negative consequences of sleep apnea) and CPAP-related content (benefits and the probable side effects of using CPAP, equipment description, cleaning and replacement methods, troubleshooting, and how to travel with CPAP) were taken as the major portion of the content. This content was derived from credible global websites, existing publications, and sleep specialists’ opinions. Table 1 shows the relationship between the behavior change techniques and the prepared content.
The accuracy, comprehensibility, clarity, and simplicity of the content were assessed by four sleep medicine specialists in a focus group and finalized. Also, a sample of target patients evaluated the difficulty of phrases to decrease the cases of ambiguity and erroneous inferences made of the utterances or the meanings. If a problem was found, the content was changed as required.
Usability testing of patient’s application
To test the usability of the patient’s application, a think-aloud protocol was used, which is a user-based and empirical method based on the observation of system performance in time . The think-aloud method collects data about users’ cognitive growth in working with the system. In this method, users are asked to state out loud whatever they see, think about, and feel, as well as the questions that arise in their minds or their decisions.
For this purpose, seven patients who used CPAP were selected. Two trained facilitators and a software engineer were also present during the evaluation process. The evaluation process was followed in a room of a sleep test clinic within a peaceful and light environment. To conduct the evaluation process, a scenario was developed based on the tasks and duties of the Roya telemonitoring system. All users’ interaction with the system and their voices were recorded by a screen recorder on a tablet computer and a microphone. When the evaluations were completed, all the recorded documents were analyzed by the facilitators. To categorize problems, the method suggested by Haak et al. was used, according to which the problems were categorized into four groups, including system layout, terminology, data entry, and comprehensiveness.
The detail of the usability evaluation process is provided in Appendix 1A.
Functionality testing of patient’s application:
In this phase, the primary purpose of functionality testing was to check the success of:
installing the application on smartphones, each with a different version of the Android operating system,
transferring the CPAP data from the operator’s portal to the patient’s application,
transferring responses to daily questions and user problems from the application to the doctor’s portal,
displaying charts and content in different mobile sets,
showing videos integrated within the content in different mobile sets,
the functionality of settings in different mobile sets,
For this purpose, ten patients who had purchased their CPAP devices from two sales companies in Mashhad, were literate, and had smartphones to work with effectively were selected. They used the application for two weeks. Patients’ comments and issues they faced while using the application were recorded in the form of unstructured interviews. They were then provided to the technical team after more scrutiny for further development of the system. The detail of the functionality evaluation process is provided in Appendix 1B.
Evaluation of doctor’s portal and selling companies’ portal
As the system development was done via the agile, recursive, and incremental method, during the project development process, different versions of the doctor’s portal and the selling companies’ portal were continuously made available to doctors and sales companies. After the evaluation, their comments were obtained through unstructured interviews and applied as far as possible by the technical team. This process continued until the end of the system design and final approval by the users of the two portals.
Following the stakeholders’ input, the research team (including researchers and system developers) concluded that a patient interface needs to be designed for smartphones because of its easy use and access. The operator and doctor interfaces need to be made to suit PCs corresponding to the data protection legislation.
Patient’s application The application was provided to the patient with the capabilities of educating them, reporting on performance, sending and receiving information, and showing notifications. The main parts of the patient’s application were educational content (Fig. 2), daily queries, daily messages (Fig. 3), and reports of performances (Fig. 4). Also, The checklist of barriers to device use was displayed to non-adherent patients (Table 3). The marked reasons were sent to the doctor’s portal to control and possible recommendations. A sample of feedback displayed on the performance report page is presented in Table 2. The detail of each part of the patient’s application is described in Appendix 1C.
Doctor’s portal The doctor’s portal was designed for the visiting doctor. Patient’s answers to daily questions, actual use of the device, adherence status, reasons for non-adherence, the capability of sending messages to patients, and taking notes for future visits were the main features of the doctor’s portal (Fig. 5A).
Operator’s portal An operator’s portal was made available to the selling companies. Recording patients’ demographic and clinical information, uploading the CPAP data, and activating the notifications were the main features of the operator’s portal (Fig. 5B).
Data sending software due to the lack of capability of automatic sending of CPAP data to the central system, a facilitator software was designed and offered to patients on a CD along with instructions on how to use and install it.
Usability testing of patient access module (patient’s application)
In usability testing, a think-aloud protocol analysis was done with seven patients (six men and one woman) whose average age was 44 ± 10.2 years. The mean time of the evaluation process was 22 ± 4.7 min. The time it took for each user to do the evaluation is presented in Fig. 6.
The total number of issues found with usability by users in the evaluation process was 18, with an average of 2.5 issues per user.
The layout issues of the system constituent parts were 8 in number and comprised 44.5% of the total issues (the most frequent). The most important changes were:
Location of the list of problems on the performance report page, the display type, and the selection mode,
Color of the CPAP usage diagram,
Details and headings of the CPAP usage diagram axes,
Display daily messages,
The next rank belonged to vocabulary issues with five cases (28%). One issue of this type was the unintelligibility of the names of buttons. To tackle this problem, the names of the buttons were changed in a way that better fitted the target action.
As for the data entry issues, four cases were found (22%). One of the most critical problems was entering data for daily queries. To solve this issue, the type of data entry was changed. Besides, to set the notification sending time, in the settings, the type of data entry changed according to the users’ suggestions.
As for issues with comprehensiveness, there was only 1 case (5.5%) about touching the columns of the performance diagram that indicated the device’s daily use (including the extent of use, amount of leakage in the mask, number of apnea, device pressure). As we could find no technical solution to this issue, adequate instructions were provided to patients when installing the application. Some changes to the application after usability testing are shown in Fig. 7.
Functionality testing of patient’s application
The main problems detected in functionality testing were: not working properly on devices in languages other than English, disruption in the installation process, no link between the portals and the application, and improper playing of videos on some mobile sets with small screens. Once these problems were found, they were solved by the technical team.
The present research described the design, development, and evaluation of a patient telemonitoring system for those afflicted with sleep apnea undergoing CPAP therapy. To our knowledge, there has been almost no research to use a participatory analysis, design, and evaluation approach to incorporate stakeholder inputs, evidence, and behavior change theories and techniques in developing a patient monitoring system for patients with OSA using PAP machines. Also, this is the first study on the Iranian population that differs from previous studies regarding cultural, economic, and social factors. So, it would be a complementary study to previous ones in other societies.
Obstructive sleep apnea is a chronic disease that needs to be treated through the long-term use of PAP devices. To manage the disease, many groups are involved including doctors, selling companies, and the patients. Due to the significance of interaction among these three key elements, the system was designed in a way that physicians and companies could provide their services to the patient as far as possible. To this aim, three parts were integrated into the system: the patient’s application, doctor’s portal, and operator’s portal.
A key feature of the system was the recurrence of educational content through daily messages and the creation of a link in different parts of the patient’s application for easier access to the internal content. As the related literature indicated, recurrent exposure to educational content can improve treatment adherence. Some other research findings using daily text messages (e.g., SMS) to change health-related behaviors showed that these interventions were truly effective in changing behaviors in patients and promoting preventive behaviors and self-care in chronic diseases . It is also noteworthy that though education is essential for a basic knowledge of behavior change, information and recommendations might be inadequate for significant changes in an individual’s behavior [45,46,47,48].
Some parts of the application content were using educational videos that helped patients to use and maintain the device, giving feedback on patients’ performance followed by suggestions to non-adherent patients to solve the existing problems, and sending daily messages that reminded the side effects of irregular use of the device or not using it at all. These could pave the way for changing the patient’s behavior. Of note is that the application content was based on the socio-cognitive theory and the correlation between the constituent constructs of this theory (i.e., knowledge, perceived risk, outcome expectancy, self-efficacy) and CPAP adherence proved in many studies [40,41,42,43].
As some users of the application are elderly, we attempted to facilitate the use of the application as much as possible for them. As it was required to enter data in the application or send it to receive feedback, the older users needed more help and support to use the application. However, younger users used the application more freely and independently. As the new technologies such as mobile-based health can be challenging to the elderly, we tried to use larger font sizes and shorter sentences that were easier to follow. Other relevant attempts included no use of specialized terms in content, straightforward design of the interface, display of adequate explanations upon entering the application, and the possibility of making changes to settings.
Another advantage of the system was monitoring patients’ performance from far. Doctor’s monitoring makes patients feel more responsible for their conditions and more motivated to use the device in order not to disappoint the doctor. This point has been raised in other studies, too, that eliciting patients’ feeling of responsibility in comparison to educational-only interventions can significantly affect the adherence behavior .
Wireless telemonitoring in the initial stages of CPAP treatment can significantly reduce the nursing time compared to usual care. Prompt troubleshooting during CPAP therapy can increase patients’ adherence to treatment. Telemonitoring can save nursing sources and lead to regular follow-up and adequate support. Consequently, treatment adherence is increased . Moreover, for patients with physical disabilities, who cannot move easily or live farther than the sleeping centers, telemonitoring can save the patient’s and healthcare providers’ time due to tele-settings and tele-troubleshooting.
Study limitations, strengths, and future directions
There are several strengths in the present study. first, the development process was accompanied by the stakeholders collaborating closely. These included patients, healthcare providers, researchers, system developers, and patient representatives. Thus, this research ensured that content and software functionalities were included that were both clear and meaningful to patients and healthcare providers. This process can help to increase the potential effectiveness of the target intervention. Another strength was that in the design and development of the system, different methods were used for data collection to meet the users’ needs and make the best use of existing capabilities. Moreover, using the behavior change techniques in preparing content and system capabilities probably enhances the effectiveness in changing the patient’s behavior of using the CPAP device. Finally, evaluating system usability and functionality was done after designing and developing the system which led to the recognition and removal of system defects for further research.
This study has several limitations. The sample size was limited which negatively affected the usability testing. However, 3–5 participants are enough for usability testing . Another limitation was that no clinical outcome was explored in this research as here the aim was to design, develop and evaluate the software in terms of usability and functionality to solve potential problems in the forthcoming body of research. It is suggested that the effectiveness of the telemonitoring system be investigated as a mobile health intervention compared to usual methods and the results are provided for higher-level decision-makers.
Proper management of OSA needs a long-term use of CPAP devices and subsequently, constant clinical and technical support. The present research elaborated on the participatory analysis, design, and evaluation approach, including stakeholder inputs, evidence, and behavior change theories and techniques when developing the patient monitoring system for patients with OSA who used CPAP machines. While the system efficacy remains to be evaluated, content and system development were based on the need analysis of stakeholders. So it has the potential to improve CPAP adherence in patients with OSA.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Benjafield AV, Ayas NT, Eastwood PR, Heinzer R, Ip MS, Morrell MJ, et al. Estimation of the global prevalence and burden of obstructive sleep apnoea: a literature-based analysis. Lancet Respir Med. 2019;7(8):687–98.
Medicine AOSATFotAAoS. Clinical guideline for the evaluation, management and long-term care of obstructive sleep apnea in adults. J Clin Sleep Med. 2009;5(3):263–76.
Aalaei S, Amini M, Taghipour A, Afsharisaleh L, Rezaeitalab F, Asadpour H, et al. Adherence to prescribed overnight sleep study in patients suspected of sleep apnea: problem size and influential factors. Sleep Breath. 2020;25:1–10.
Aalaei S, Amini M, Rezaeitalab F, Asadpour H, Tabesh H, Khoshrounejad F, et al. Evaluating the effect of an educational intervention on the adherence rate to sleep study: a multi-centered stratified randomized controlled trial. PLoS ONE. 2021;16(1): e0244496.
Virk JS, Kotecha B. When continuous positive airway pressure (CPAP) fails. J Thorac Dis. 2016;8(10):E1112.
Rotenberg BW, Murariu D, Pang KP. Trends in CPAP adherence over twenty years of data collection: a flattened curve. J Otolaryngol Head Neck Surg. 2016;45(1):1–9.
Aalaei S, Rezaeitalab F, Tabesh H, Amini M, Afsharisaleh L, Mostafavi SM, et al. Factors affecting patients’ adherence to continuous positive airway pressure therapy for obstructive sleep apnea disorder: a multi-method approach. Iran J Med Sci. 2020;45(3):170.
Zia S, Fields BG. Sleep telemedicine: an emerging field’s latest frontier. Chest. 2016;149(6):1556–65.
Fox N, Hirsch-Allen A, Goodfellow E, Wenner J, Fleetham J, Ryan CF, et al. The impact of a telemedicine monitoring system on positive airway pressure adherence in patients with obstructive sleep apnea: a randomized controlled trial. Sleep. 2012;35(4):477–81.
Isetta V, Negrín MA, Monasterio C, Masa JF, Feu N, Álvarez A, et al. A Bayesian cost-effectiveness analysis of a telemedicine-based strategy for the management of sleep apnoea: a multicentre randomised controlled trial. Thorax. 2015. https://doi.org/10.1136/thoraxjnl-2015-207032.
Isetta V, Torres M, González K, Ruiz C, Dalmases M, Embid C, et al. A New mHealth application to support treatment of sleep apnoea patients. J Telemed Telecare. 2017;23(1):14–8.
Kuna ST, Shuttleworth D, Chi L, Schutte-Rodin S, Friedman E, Guo H, et al. Web-based access to positive airway pressure usage with or without an initial financial incentive improves treatment use in patients with obstructive sleep apnea. Sleep. 2015;38(8):1229–36.
Sparrow D, Aloia M, DeMolles DA, Gottlieb DJ. A telemedicine intervention to improve adherence to continuous positive airway pressure: a randomised controlled trial. Thorax. 2010;65(12):1061–6.
Rezaie L, Phillips D, Khazaie H. Barriers to acceptance and adherence to continuous positive airway pressure therapy in patients with obstructive sleep apnea: a report from Kermanshah province, western Iran. Patient Prefer Adher. 2018;12:1299.
Weaver TE, Grunstein RR. Adherence to continuous positive airway pressure therapy: the challenge to effective treatment. Proc Am Thorac Soc. 2008;5(2):173–8.
Broström A, Nilsen P, Johansson P, Ulander M, Strömberg A, Svanborg E, et al. Putative facilitators and barriers for adherence to CPAP treatment in patients with obstructive sleep apnea syndrome: a qualitative content analysis. Sleep Med. 2010;11(2):126–30.
Luyster FS, Dunbar-Jacob J, Aloia MS, Martire LM, Buysse DJ, Strollo PJ. Patient and partner experiences with obstructive sleep apnea and CPAP treatment: a qualitative analysis. Behav Sleep Med. 2016;14(1):67–84.
Sawyer AM, Gooneratne NS, Marcus CL, Ofer D, Richards KC, Weaver TE. A systematic review of CPAP adherence across age groups: clinical and empiric insights for developing CPAP adherence interventions. Sleep Med Rev. 2011;15(6):343–56.
Askland K, Wright L, Wozniak DR, Emmanuel T, Caston J, Smith I. Educational, supportive and behavioural interventions to improve usage of continuous positive airway pressure machines in adults with obstructive sleep apnoea. Cochrane Database Syst Rev. 2020. https://doi.org/10.1002/14651858.CD007736.pub3.
Basoglu OK, Midilli M, Midilli R, Bilgen C. Adherence to continuous positive airway pressure therapy in obstructive sleep apnea syndrome: effect of visual education. Sleep Breath. 2012;16(4):1193–200.
Pires FS, Drummond M, Marinho A, Sampaio R, Pinto T, Gonçalves M, et al. Effectiveness of a group education session on adherence with APAP in obstructive sleep apnea—a randomized controlled study. Sleep Breath. 2013;17(3):993–1001.
Falcone VA, Damiani MF, Quaranta VN, Capozzolo A, Resta O. Polysomnograph chart view by patients: a new educational strategy to improve CPAP adherence in sleep apnea therapy. Respir Care. 2014;59(2):193–8.
Pengo MF, Czaban M, Berry MP, Nirmalan P, Brown R, Birdseye A, et al. The effect of positive and negative message framing on short term continuous positive airway pressure compliance in patients with obstructive sleep apnea. J Thorac Dis. 2018;10(Suppl 1):S160.
Hoet F, Libert W, Sanida C, Van den Broecke S, Bruyneel AV, Bruyneel M. Telemonitoring in continuous positive airway pressure-treated patients improves delay to first intervention and early compliance: a randomized trial. Sleep Med. 2017;39:77–83.
Munafo D, Hevener W, Crocker M, Willes L, Sridasome S. A telehealth program for CPAP adherence reduces labor and yields similar adherence and efficacy when compared to standard of care. Sleep Breath. 2016;20(2):777–85.
Turino C, de Batlle J, Woehrle H, Mayoral A, Castro-Grattoni AL, Gómez S, et al. Management of continuous positive airway pressure treatment compliance using telemonitoring in obstructive sleep apnoea. Eur Respir J. 2017;49(2):1601128.
Pépin J-L, Jullian-Desayes I, Sapène M, Treptow E, Joyeux-Faure M, Benmerad M, et al. Multimodal remote monitoring of high cardiovascular risk patients with OSA initiating CPAP: a randomized trial. Chest. 2019;155(4):730–9.
Mendelson M, Vivodtzev I, Tamisier R, Laplaud D, Dias-Domingos S, Baguet J-P, et al. CPAP treatment supported by telemedicine does not improve blood pressure in high cardiovascular risk OSA patients: a randomized, controlled trial. Sleep. 2014;37(11):1863–70.
Parthasarathy S, Wendel C, Haynes PL, Atwood C, Kuna S. A pilot study of CPAP adherence promotion by peer buddies with sleep apnea. J Clin Sleep Med. 2013;9(6):543–50.
Stepnowsky C, Edwards C, Zamora T, Barker R, Agha Z. Patient perspective on use of an interactive website for sleep apnea. Int J Telemed Appl. 2013;2013:1–10.
Aloia MS, Arnedt JT, Strand M, Millman RP, Borrelli B. Motivational enhancement to improve adherence to positive airway pressure in patients with obstructive sleep apnea: a randomized controlled trial. Sleep. 2013;36(11):1655–62.
Lai AY, Fong DY, Lam JC, Weaver TE, Ip MS. The efficacy of a brief motivational enhancement education program on CPAP adherence in OSA: a randomized controlled trial. Chest. 2014;146(3):600–10.
Dantas APT, Winck JC, Figueiredo-Braga M. Adherence to APAP in obstructive sleep apnea syndrome: effectiveness of a motivational intervention. Sleep Breath. 2015;19(1):327–34.
Smith CE, Dauz E, Clements F, Werkowitch M, Whitman R. Patient education combined in a music and habit-forming intervention for adherence to continuous positive airway (CPAP) prescribed for sleep apnea. Patient Educ Couns. 2009;74(2):184–90.
Hwang D, Chang JW, Benjafield AV, Crocker ME, Kelly C, Becker KA, et al. Effect of telemedicine education and telemonitoring on continuous positive airway pressure adherence. The tele-OSA randomized trial. Am J Respir Crit Care Med. 2018;197(1):117–26.
Chen X, Chen W, Hu W, Huang K, Huang J, Zhou Y. Nurse-led intensive interventions improve adherence to continuous positive airway pressure therapy and quality of life in obstructive sleep apnea patients. Patient Prefer Adher. 2015;9:1707.
Bartlett D, Wong K, Richards D, Moy E, Espie CA, Cistulli PA, et al. Increasing adherence to obstructive sleep apnea treatment with a group social cognitive therapy treatment intervention: a randomized trial. Sleep. 2013;36(11):1647–54.
Sawyer AM, King TS, Weaver TE, Sawyer DA, Varrasse M, Franks J, et al. A tailored intervention for PAP adherence: the SCIP-PA trial. Behav Sleep Med. 2019;17(1):49–69.
Sedkaoui K, Leseux L, Pontier S, Rossin N, Leophonte P, Fraysse J-L, et al. Efficiency of a phone coaching program on adherence to continuous positive airway pressure in sleep apnea hypopnea syndrome: a randomized trial. BMC Pulm Med. 2015;15(1):1–8.
Aloia MS, Arnedt JT, Stepnowsky C, Hecht J, Borrelli B. Predicting treatment adherence in obstructive sleep apnea using principles of behavior change. J Clin Sleep Med. 2005;1(04):346–53.
Stepnowsky CJ, Marler MR, Palau J, Brooks JA. Social-cognitive correlates of CPAP adherence in experienced users. Sleep Med. 2006;7(4):350–6.
Stepnowsky CJ, Palau JJ, Gifford AL, Ancoli-Israel S. A self-management approach to improving continuous positive airway pressure adherence and outcomes. Behav Sleep Med. 2007;5(2):131–46.
Stepnowsky CJ Jr, Dimsdale JE. Dose–response relationship between CPAP compliance and measures of sleep apnea severity. Sleep Med. 2002;3(4):329–34.
Hix D, Hartson HR. Formative evaluation: ensuring usability in user interfaces. 1992
Sarabi RE, Sadoughi F, Orak RJ, Bahaadinbeigy K. The effectiveness of mobile phone text messaging in improving medication adherence for patients with chronic diseases: a systematic review. Iran Red Crescent Med J. 2016. https://doi.org/10.5812/ircmj.25183.
Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev. 2010;32(1):56–69.
Fletcher R, May C, Wroe J, Hall P, Cooke D, Rawlinson C, et al. Development of a set of mobile phone text messages designed for new fathers. J Reprod Infant Psychol. 2016;34(5):525–34.
Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015;36:393–415.
Anttalainen U, Melkko S, Hakko S, Laitinen T, Saaresranta T. Telemonitoring of CPAP therapy may save nursing time. Sleep Breathing. 2016;20(4):1209–15.
Nielsen J, Landauer TK, editors. A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems; 1993
Van Someren M, Barnard Y, Sandberg J. The think aloud method: a practical approach to modelling cognitive. 1994
Van den Haak MJ, de Jong MD, Schellens PJ. Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison. Interact Comput. 2004;16(6):1153–70.
Polonsky WH, Fisher L. When does personalized feedback make a difference? a narrative review of recent findings and their implications for promoting better diabetes self-care. Curr DiabRep. 2015;15(8):50.
Stepnowsky C, Zamora T, Edwards C, Liu L, Agha Z. Interventions to improve CPAP adherence and outcomes: role of theory and behavioral change techniques. J Sleep Disord Ther. 2013;2(133):2167–277.
Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379.
The present manuscript was extracted from the Ph.D. dissertation by Shokoufeh Aalaei. We would like to thank the Vice-Chancellor for Research Affairs of Mashhad University of Medical Sciences for the financial support (grant number 950994). We also would like to express our gratitude to all those who helped us conduct this study, particularly the participants, including the healthcare providers and patients, system developers, and sales companies.
This study was supported by the Mashhad University of Medical Sciences Research under grant 950994. The funder does not have any role in study design, data collection, analysis, decision to publish, interpretation, or preparation of the manuscript. The corresponding author will have full access to all the data in the study and will have final responsibility for the decision to submit for publication.
Ethics approval and consent to participate
This study was approved by the Ethics Committee of Mashhad University of Medical Sciences and Medical School (Ethical code: IR.MUMS.fm.REC.1395.571). Written informed consent was obtained from participants upon entering the study. All methods were carried out following relevant guidelines and regulations.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
A: Usability testing of the patient access module (patient application)
To test the usability of the patient application, the think-aloud protocol was used, which is a user-based method widely used. Think-aloud is an empirical method based on the observation of system performance in time . The think-aloud method aims to collect data related to users’ cognitive growth in working with the system. In this method, users are asked to state out loud whatever they see, think about, and feel, as well as the questions that arise in their mind or their decisions . In this method, the user states his/her thoughts, activities, and observations while working with the system verbally.
Participants The participants in this study included three groups: users, facilitators, and a technical supporter. The users were 7 patients using the CPAP. They had no knowledge or experience of the Roya telemonitoring system. For the evaluation process, each user was accompanied by a facilitator, who did not interfere in the evaluation process and only reminded them of speaking loudly when they faced a problem in the process. Facilitators were among medical informatics experts with adequate knowledge and experience of testing usability. A software engineer was also present during the evaluation process as the technical support just in case.
Time and place of evaluation: The evaluation process was followed in a room of a sleep test clinic within a peaceful and light environment. There were a table, two chairs and a tablet connected to the internet. To do the evaluation process, such equipment as the Screen Recorder was installed on the tablet computer to record the user’s interaction with the system and a microphone to record the user’s voice. To conduct the evaluation process, a scenario was developed based on the tasks and duties of the Roya telemonitoring system.
Evaluation process Before evaluation, the think-aloud protocol was taught to the users. In 10 min, they were instructed on how to express their thoughts, feelings, and decisions in detail. Moreover, the issues with conducting the precise evaluation process were reminded to facilitators. They were asked not to make any interference in the evaluation process for the user and not to impose any personal comment. They were supposed to constantly encourage the user to speak aloud while thinking. When the evaluation was done, the users were asked to give suggestions for the improvement of system performance.
Data analysis When the evaluations were completed, all the recorded documents were analyzed by the facilitators. To categorize problems, the method suggested by Haak et al.  was used, according to which the problems were categorized in 4 groups:
Problems with the system layout (e.g., the user cannot find the key to go to the next page)
Problems with terminology (e.g., the user cannot understand the meaning of some items)
Problems with data entry (e.g., the user does not know how to enter data in a specific field)
Problems with comprehensiveness (e.g., the user feels that the system guideline is not comprehensive)
B: Functionality testing of patient access module (patient’s application)
10 patients who had purchased their device from two sales companies in Mashhad and were literate and had smartphones to work with effectively were selected. They set prior appointments with a sleep specialist and visited him. The doctor had a full examination of the patient’s conditions and the extent to which s/he used the device. After visiting the doctor, the purpose of the research was explained to the patients who involved evaluating the functionality of the system and asking for their opinions to make improvements in the system. If they were willing to participate, they registered in the portal and had the application installed on their smartphones. The data concerning the extent to which the device was used was derived from CPAP and uploaded in an Excel file into the system. When the application was installed, the patient could log into the application with a username and password and receive the required instructions on using the application from the researcher.
Patients followed up for two weeks. Those who received the application sent the information stored in the CPAP memory card through emails once a week (overall two times during the evaluation course) and received feedback on it on their mobile application. When there was no possibility of emailing the information on the memory card by the patient or his/her company, the data sending software, which was already designed by the researchers to match the devices of each brand, were provided to the patient on a CD along with its instructions on how to use them. If the patient did not send the weekly report (at the end of the first and second week), a reminder message was automatically sent to him/her.
After the follow-up, the patients were contacted to remind them of the second visit and referral to the clinic. In the second visit, patients’ comments and issues they faced while using the application were recorded in the form of unstructured interviews and were then provided for the technical team after more scrutiny for further development of the system. The main points taken into account in the evaluation of the functionality of the application were:
Successful installation of the application on smartphones each with a different version of Android operating system
Successful transfer of data on CPAP device from the operator’s portal to the application
Successful transfer of responses to daily questions and user’s problems from the application to operator’s portal
Accurate display of charts and content in different mobile sets
Accurate display of videos integrated within the content in different mobile sets
Accurate functionality of settings in different mobile sets
C: Patient access module (patient’s application)
Educational content included information about apnea and treatment with CPAP. This information was presented in textual and audio-visual modes. To facilitate the patient’s access to the educational content, the prepared content was presented in short text chunks with specific headings (Fig. 2).
Daily queries asked to what extent the device was used the previous night, whether sleeping pills were taken or not and the quality of sleep the night before. If the question about taking sleeping pills was answered as No three times consecutively (for three consecutive days), it was omitted. Following the time set by the user for the Q&A part of the application, a notification was sent by the device at the same time. The user was guided to daily questions by touching the notification message. The mechanism of sending messages to the server was “store and forward”. Thus, the answers to questions were saved in the memory according to their date and then transferred to the server once connected to the internet (Fig. 3).
Daily messages corresponded to the application content and contain problems with the device, side effects, significance of disease, and so on. Daily, one to two messages were sent to patients. According to the time set by the user in the application to receive daily messages, a message was sent along with a notification at each time. The messages were saved in the inbox to make later checking possible. They were saved chronologically from the newest to oldest in the inbox (Fig. 3).
According to the related literature, feedback can only have positive effects on health when it aims to support and guide in the right direction . Accordingly, in the report on performance section, after receiving the required feedback on the frequency of using the device during the past week, if one was recognized as non-adherent based on the pre-defined criteria, a checklist was presented of the probable reasons for not using the device regularly (Table 3). It is noteworthy that this list was made based on the qualitative content analysis of texts, patients’ interviews, and the specialists’ comments. For each item within the list, several solutions were thought of. This solution was based on the educational content of the application offered in different words. The patient used the inserted hyperlink to access the internal content of the application at the end of each solution for further information. Finally, the patient was asked to register the selected items in the system in to inform the physician. This allows the doctor to intervene and send further advice in situations where the patient's problem is recurring.
About this article
Cite this article
Aalaei, S., Amini, M., Mazaheri Habibi, M.R. et al. A telemonitoring system to support CPAP therapy in patients with obstructive sleep apnea: a participatory approach in analysis, design, and evaluation. BMC Med Inform Decis Mak 22, 168 (2022). https://doi.org/10.1186/s12911-022-01912-8
- Mobile health
- Sleep apnea
- Continuous positive airway pressure
- Patient education