From: Constructing an assessment framework for the quality of asthma smartphone applications
Dimensions | Weight | Sub-Dimensions | Weight | Items | Criteria/Example | Weight | Overall Weight |
---|---|---|---|---|---|---|---|
The following knowledge is included in the apps (i.e., presented in words, pictures, video, etc.): | |||||||
 Asthma knowledge | 0.105 | Basic fact about asthma | 0.182 | Definition of asthma | Asthma is a chronic respiratory disease, together with airway hyperresponsiveness and airway inflammation | 0.086 | 0.0016 |
Causes of asthma | Asthma is caused by a combination of endogenous (genetic) and external (environment) causes | 0.123 | 0.0024 | ||||
Respiratory symptoms of asthma | Repeated episodes of wheeze, shortness of breath, chest tightness and cough | 0.177 | 0.0034 | ||||
Prognosis of asthma | Asthma cannot be cured, but can be effectively controlled through effective management | 0.253 | 0.0048 | ||||
Early treatment | Early controller treatment of asthma is critical to achieving optimal outcomes | 0.361 | 0.0069 | ||||
Asthma medications | 0.439 | Categories of asthma medications | Asthma medications include controller medications and reliever medications | 0.138 | 0.0063 | ||
Roles and usage of controller medications | Controller medications can be used to reduce airway inflammation, control symptoms, and reduce future risks, which must be used regularly | 0.240 | 0.0110 | ||||
Roles and usage of reliever medications | Reliever medications can be used to relief breakthrough symptoms, which must be used as needed | 0.182 | 0.0084 | ||||
Side-effects of asthma medications | Local side effects of ICS include oral thrush and dysphonia; osteoporosis, hypertension, and diabetes, etc. in high dose steroids; tachycardia and tremor in ß2-agoinsts | 0.096 | 0.0044 | ||||
Carrying reliever medications | Patients need to carry asthma reliever medications (such as Ventolin solution) with them in case of emergency | 0.344 | 0.0158 | ||||
Management of asthma exacerbations | 0.241 | Early signs and symptoms of worsening asthma | The app describes early signs and symptoms of worsening asthma (sneezing, runny nose, dry cough, shortness of breath, and chest tightness, etc.) | 0.138 | 0.0035 | ||
Symptoms of asthma exacerbations | The app describes symptoms of asthma exacerbations (a progressive increase in symptoms of shortness of breath, cough, wheezing or chest tightness) | 0.195 | 0.0049 | ||||
Management of asthma exacerbations | For example, patients were removed from the allergen environment, inhale ß2 agonist, and went to see the doctor in time | 0.391 | 0.0098 | ||||
Management after asthma exacerbations | Seek the cause of acute attack actively, check medication compliance, and adjust treatment plan | 0.276 | 0.0070 | ||||
Asthma with comorbidities and triggers | 0.138 | Comorbidities of asthma | The app describes comorbidities of asthma, such as, rhinitis, sinusitis, and symptomatic gastroesophageal reflux disease, etc. | 0.249 | 0.0036 | ||
Management of comorbidities | The app provides details of treatment of rhinitis, sinusitis, and symptomatic gastroesophageal reflux disease, and psychological intervention, etc. | 0.157 | 0.0023 | ||||
Triggers of asthma | The app describes triggers of asthma, such as, occupational factors, environmental factors, weather changes, drug and sports | 0.594 | 0.0086 | ||||
 Skills training for effective self-management | 0.203 | Peak flow meter use and monitoring | 0.667 | The purpose of using peak flow meter | A peak flow meter is used for monitoring lung function changes in patients | 0.195 | 0.0264 |
Operational criteria for peak flow meter | Take a deep breath, seal your mouth tightly around the mouthpiece and then blow as hard and as fast as you soon. Check the number, re-set the pointer to zero, and repeat two more times | 0.391 | 0.0527 | ||||
The same peak flow meter | The patient should use the same peak flow meter each time | 0.276 | 0.0373 | ||||
The best time to use peak flow meter | PEF is measured in the morning, and then in the evening (after 10-12 h of the first time) | 0.138 | 0.0186 | ||||
Inhaler devices use | 0.333 | Common inhaler devices | The app describes common inhaler devices, such as pressurized metered dose inhalers (pMDI), pMDI +spacer and dry power inhalers (DPIs) | 0.140 | 0.0094 | ||
The importance of correct inhaler technique | Correct inhaler technique can enhance the medication into lung, reduce asthma attack, and obtain the best clinical effect | 0.528 | 0.0356 | ||||
Operational criteria for different inhaler devices | For example, usage of Diskus is that remove mouthpiece cover, position inhaler mouthpiece in mouth and seal lips, inward breath steady and deeply, remove inhaler, hold breath for a few seconds, and rinse mouth | 0.332 | 0.0225 | ||||
 Non- pharmacological strategies | 0.094 | Measures to treat asthma triggers | 0.667 | Identifying risk factors that make asthma worse | The app describes factors that make asthma worse, such as allergens exposure, physical and chemical irritants, psychosocial factors, etc. | 0.160 | 0.0100 |
Avoidance of environmental smoke exposure | The app provides advice about avoidance of active smoking and passive smoking | 0.106 | 0.0066 | ||||
Avoidance of occupation exposures | The app provides advice about avoidance of plant dust, animal dust, etc. | 0.255 | 0.0159 | ||||
Avoidance of medications that may make asthma worse | The app provides advice about avoidance of aspirin, NSAIDs, and ß-blockers, etc. | 0.255 | 0.0159 | ||||
Avoidance of allergen exposure | The app provides advice about avoidance of domestic mites, furred animals, fungi, and pollen, etc. | 0.160 | 0.0100 | ||||
Avoidance of indoor and outdoor air pollution | The app provides advice about avoidance of domestic coal burning, cooking, and traffic pollution, etc. | 0.064 | 0.0040 | ||||
Lifestyles | 0.333 | Avoidance of emotional stress | The app provides advice about relieving emotional stress and encouraging breathing exercises, etc. | 0.667 | 0.0209 | ||
Regular moderate physical activity | Patients should exercise regularly and given appropriate exercise advice | 0.333 | 0.0104 | ||||
The following behavioral change strategies are employed in apps: | |||||||
 Goals and planning | 0.068 | Goal setting (outcome/behavior) | 0.667 | Allow users to set behavior goals or provide behavior goals | The app allows users to record symptoms and PEF values daily, and assess asthma control level periodically, etc. | 0.667 | 0.0300 |
Allows users to set outcome goals or provide outcome goals | The app allows users to set the goals of asthma control | 0.333 | 0.0150 | ||||
Action plans | 0.333 | Explain the purpose of an asthma action plan | An asthma action plan helps patients to identify early symptoms of asthma attacks and respond appropriately to improve asthma control | 0.500 | 0.0113 | ||
Allow making individualized asthma action plan, and updated in time | The app allows doctors to program asthma action plan directly into their phone or users type in manually | 0.500 | 0.0113 | ||||
 Feedback and monitoring | 0.084 | Feedback | 0.250 | Provide result feedback information based on patients’ health data | The app can provide advice based on changing PEF, symptoms or ACT scores | 0.185 | 0.0039 |
Provide professional feedback information based on patients’ inhaler technique | The app allows users to upload the patients’ inhaler technique video through user-end, and then clinicians check inhaler technique in order to identify problematic steps | 0.245 | 0.0051 | ||||
Provide feedback information based on patients’ changing asthma status | The app can provide feedback about severity of asthma based on symptoms or PEF, etc. | 0.323 | 0.0068 | ||||
Allow storing and summarizing patients’ recent health data, and generating summary visualization automatically | The app allows storing patients’ data, such as symptoms, PEF or medicine use | 0.141 | 0.0030 | ||||
Allow connecting medical devices or wearables to upload data and provide feedback information to patients | For example, after the sensor collecting the patients’ vital signs, the app can send the data to end-users and judge whether the patients’ health is in the normal range | 0.106 | 0.0022 | ||||
Self-monitoring of behavior | 0.500 | Provide a diary to record PEF readings and predicted PEFR will be calculated automatically | The app allows users to type in manually or supports pair to the patients’ Bluetooth device automatically for data exchange | 0.195 | 0.0082 | ||
Provide a diary to record patients’ symptoms. | The app provides a diary to record details about wheezing/shortness of breath/sleep, etc. | 0.391 | 0.0164 | ||||
Provide a diary to record medication. | The app provides a diary to record details about medication use, such as categories and frequency, etc. | 0.276 | 0.0116 | ||||
Provide a diary to record return visit. | The app provides a diary to record details about return visit, such as frequency and results, etc. | 0.138 | 0.0058 | ||||
Self-monitoring of outcomes of behavior | 0.250 | Provide a diary to record lung function test. | The app provides a diary to record details about lung function test, such as FEV1, FVC, etc. | Â | 0.0065 | ||
Provide a diary to record worsening asthma-related events. | The app provides a diary to record details about worsening asthma-related events, such as attack symptoms, duration of symptoms, and complications, etc. | 0.196 | 0.0041 | ||||
Provide asthma assessment tools | The app provides asthma assessment tools to assess patient progress, such as Asthma Control Test (ACT) | 0.493 | 0.0104 | ||||
 Shaping knowledge | 0.105 | Demonstration of behavior | 1.000 | Provide video tutorials or animations of peak flow meter use | The app provides video tutorials or animations to display instructions of peak flow meter for patients | 0.500 | 0.0524 |
Provide video tutorials or animations of inhaler devices use | The app provides video tutorials or animations to display instructions of inhaler device for patients | 0.500 | 0.0524 | ||||
 Social support | 0.049 | Practical support | 0.667 | Allow establishing a cooperative relationship between doctors and patients, and providing patient-doctor communication platform or interactive consultation service | For example, the app offers online consulting service | 0.100 | 0.0324 |
Emotional support | 0.333 | Provide functions of interactive communication among patients | For example, the app provides functions of sharing information and comment, etc. | 0.100 | 0.0162 | ||
 Prompts | 0.084 | Reminder | 0.333 | Allow users to set reminders for asthma tests. | The app provides details of asthma tests reminder | 0.139 | 0.0039 |
Allow users to set medication reminder | The app provides details of medication reminder, such as medication name and dosage, etc. | 0.393 | 0.0110 | ||||
Allow users to set reminders for return visit | The app can send information regularly to remind return visit | 0.234 | 0.0066 | ||||
Provide reminders for checking inhalers | The app provides reminders for checking the date and medications dosage of inhalers | 0.234 | 0.0066 | ||||
Warnings | 0.667 | Provide alert based on patients’ changing health data | The app can send warning information automatically when there is abnormal data | 1.000 | 0.0561 | ||
The following design principles are implemented in the apps: | |||||||
 Ease of use | 0.105 | Accessibility | 0.429 | The app can be easily accessed and obtained information | The app and its contents are accessible to all users (including all kinds of users with access barriers, such as visual impairment, hearing impairment, etc.) | 1.000 | 0.0449 |
Automation | 0.429 | The app can retrieve patients’ data automatically | The app can connect to health apparatuses to improve efficiency of data collection | 1.000 | 0.0449 | ||
User-friendly interface | 0.142 | All components/screens, menu labels/icons of apps are clear, intuitive, and able to use immediately | Interface design (including menu, background, colors, fonts, etc.) is scientific and reasonable. The operation steps are simple and can be operated according to window prompts without user guide. Navigation is logical and intuitive, and internal and external links are valid | 1.000 | 0.0150 | ||
 Usability | 0.105 | Usefulness of knowledge | 0.250 | Information released by apps is for patient’s needs and value | Information contained within apps is accurate and comprehensive, with high utilization rate | 1.000 | 0.0262 |
Rate of update | 0.750 | The app is updated regularly and timely | The app (including its contents, functions and technology) is updated regularly and timely | 1.000 | 0.0786 |