Skip to main content

Table 9 Asthma apps assessment framework and weight value of each item after three-round Delphi survey

From: Constructing an assessment framework for the quality of asthma smartphone applications

Dimensions

Weight

Sub-Dimensions

Weight

Items

Criteria/Example

Weight

Overall Weight

The following knowledge is included in the apps (i.e., presented in words, pictures, video, etc.):

 Asthma knowledge

0.105

Basic fact about asthma

0.182

Definition of asthma

Asthma is a chronic respiratory disease, together with airway hyperresponsiveness and airway inflammation

0.086

0.0016

Causes of asthma

Asthma is caused by a combination of endogenous (genetic) and external (environment) causes

0.123

0.0024

Respiratory symptoms of asthma

Repeated episodes of wheeze, shortness of breath, chest tightness and cough

0.177

0.0034

Prognosis of asthma

Asthma cannot be cured, but can be effectively controlled through effective management

0.253

0.0048

Early treatment

Early controller treatment of asthma is critical to achieving optimal outcomes

0.361

0.0069

Asthma medications

0.439

Categories of asthma medications

Asthma medications include controller medications and reliever medications

0.138

0.0063

Roles and usage of controller medications

Controller medications can be used to reduce airway inflammation, control symptoms, and reduce future risks, which must be used regularly

0.240

0.0110

Roles and usage of reliever medications

Reliever medications can be used to relief breakthrough symptoms, which must be used as needed

0.182

0.0084

Side-effects of asthma medications

Local side effects of ICS include oral thrush and dysphonia; osteoporosis, hypertension, and diabetes, etc. in high dose steroids; tachycardia and tremor in ß2-agoinsts

0.096

0.0044

Carrying reliever medications

Patients need to carry asthma reliever medications (such as Ventolin solution) with them in case of emergency

0.344

0.0158

Management of asthma exacerbations

0.241

Early signs and symptoms of worsening asthma

The app describes early signs and symptoms of worsening asthma (sneezing, runny nose, dry cough, shortness of breath, and chest tightness, etc.)

0.138

0.0035

Symptoms of asthma exacerbations

The app describes symptoms of asthma exacerbations (a progressive increase in symptoms of shortness of breath, cough, wheezing or chest tightness)

0.195

0.0049

Management of asthma exacerbations

For example, patients were removed from the allergen environment, inhale ß2 agonist, and went to see the doctor in time

0.391

0.0098

Management after asthma exacerbations

Seek the cause of acute attack actively, check medication compliance, and adjust treatment plan

0.276

0.0070

Asthma with comorbidities and triggers

0.138

Comorbidities of asthma

The app describes comorbidities of asthma, such as, rhinitis, sinusitis, and symptomatic gastroesophageal reflux disease, etc.

0.249

0.0036

Management of comorbidities

The app provides details of treatment of rhinitis, sinusitis, and symptomatic gastroesophageal reflux disease, and psychological intervention, etc.

0.157

0.0023

Triggers of asthma

The app describes triggers of asthma, such as, occupational factors, environmental factors, weather changes, drug and sports

0.594

0.0086

 Skills training for effective self-management

0.203

Peak flow meter use and monitoring

0.667

The purpose of using peak flow meter

A peak flow meter is used for monitoring lung function changes in patients

0.195

0.0264

Operational criteria for peak flow meter

Take a deep breath, seal your mouth tightly around the mouthpiece and then blow as hard and as fast as you soon. Check the number, re-set the pointer to zero, and repeat two more times

0.391

0.0527

The same peak flow meter

The patient should use the same peak flow meter each time

0.276

0.0373

The best time to use peak flow meter

PEF is measured in the morning, and then in the evening (after 10-12 h of the first time)

0.138

0.0186

Inhaler devices use

0.333

Common inhaler devices

The app describes common inhaler devices, such as pressurized metered dose inhalers (pMDI), pMDI +spacer and dry power inhalers (DPIs)

0.140

0.0094

The importance of correct inhaler technique

Correct inhaler technique can enhance the medication into lung, reduce asthma attack, and obtain the best clinical effect

0.528

0.0356

Operational criteria for different inhaler devices

For example, usage of Diskus is that remove mouthpiece cover, position inhaler mouthpiece in mouth and seal lips, inward breath steady and deeply, remove inhaler, hold breath for a few seconds, and rinse mouth

0.332

0.0225

 Non- pharmacological strategies

0.094

Measures to treat asthma triggers

0.667

Identifying risk factors that make asthma worse

The app describes factors that make asthma worse, such as allergens exposure, physical and chemical irritants, psychosocial factors, etc.

0.160

0.0100

Avoidance of environmental smoke exposure

The app provides advice about avoidance of active smoking and passive smoking

0.106

0.0066

Avoidance of occupation exposures

The app provides advice about avoidance of plant dust, animal dust, etc.

0.255

0.0159

Avoidance of medications that may make asthma worse

The app provides advice about avoidance of aspirin, NSAIDs, and ß-blockers, etc.

0.255

0.0159

Avoidance of allergen exposure

The app provides advice about avoidance of domestic mites, furred animals, fungi, and pollen, etc.

0.160

0.0100

Avoidance of indoor and outdoor air pollution

The app provides advice about avoidance of domestic coal burning, cooking, and traffic pollution, etc.

0.064

0.0040

Lifestyles

0.333

Avoidance of emotional stress

The app provides advice about relieving emotional stress and encouraging breathing exercises, etc.

0.667

0.0209

Regular moderate physical activity

Patients should exercise regularly and given appropriate exercise advice

0.333

0.0104

The following behavioral change strategies are employed in apps:

 Goals and planning

0.068

Goal setting (outcome/behavior)

0.667

Allow users to set behavior goals or provide behavior goals

The app allows users to record symptoms and PEF values daily, and assess asthma control level periodically, etc.

0.667

0.0300

Allows users to set outcome goals or provide outcome goals

The app allows users to set the goals of asthma control

0.333

0.0150

Action plans

0.333

Explain the purpose of an asthma action plan

An asthma action plan helps patients to identify early symptoms of asthma attacks and respond appropriately to improve asthma control

0.500

0.0113

Allow making individualized asthma action plan, and updated in time

The app allows doctors to program asthma action plan directly into their phone or users type in manually

0.500

0.0113

 Feedback and monitoring

0.084

Feedback

0.250

Provide result feedback information based on patients’ health data

The app can provide advice based on changing PEF, symptoms or ACT scores

0.185

0.0039

Provide professional feedback information based on patients’ inhaler technique

The app allows users to upload the patients’ inhaler technique video through user-end, and then clinicians check inhaler technique in order to identify problematic steps

0.245

0.0051

Provide feedback information based on patients’ changing asthma status

The app can provide feedback about severity of asthma based on symptoms or PEF, etc.

0.323

0.0068

Allow storing and summarizing patients’ recent health data, and generating summary visualization automatically

The app allows storing patients’ data, such as symptoms, PEF or medicine use

0.141

0.0030

Allow connecting medical devices or wearables to upload data and provide feedback information to patients

For example, after the sensor collecting the patients’ vital signs, the app can send the data to end-users and judge whether the patients’ health is in the normal range

0.106

0.0022

Self-monitoring of behavior

0.500

Provide a diary to record PEF readings and predicted PEFR will be calculated automatically

The app allows users to type in manually or supports pair to the patients’ Bluetooth device automatically for data exchange

0.195

0.0082

Provide a diary to record patients’ symptoms.

The app provides a diary to record details about wheezing/shortness of breath/sleep, etc.

0.391

0.0164

Provide a diary to record medication.

The app provides a diary to record details about medication use, such as categories and frequency, etc.

0.276

0.0116

Provide a diary to record return visit.

The app provides a diary to record details about return visit, such as frequency and results, etc.

0.138

0.0058

Self-monitoring of outcomes of behavior

0.250

Provide a diary to record lung function test.

The app provides a diary to record details about lung function test, such as FEV1, FVC, etc.

 

0.0065

Provide a diary to record worsening asthma-related events.

The app provides a diary to record details about worsening asthma-related events, such as attack symptoms, duration of symptoms, and complications, etc.

0.196

0.0041

Provide asthma assessment tools

The app provides asthma assessment tools to assess patient progress, such as Asthma Control Test (ACT)

0.493

0.0104

 Shaping knowledge

0.105

Demonstration of behavior

1.000

Provide video tutorials or animations of peak flow meter use

The app provides video tutorials or animations to display instructions of peak flow meter for patients

0.500

0.0524

Provide video tutorials or animations of inhaler devices use

The app provides video tutorials or animations to display instructions of inhaler device for patients

0.500

0.0524

 Social support

0.049

Practical support

0.667

Allow establishing a cooperative relationship between doctors and patients, and providing patient-doctor communication platform or interactive consultation service

For example, the app offers online consulting service

0.100

0.0324

Emotional support

0.333

Provide functions of interactive communication among patients

For example, the app provides functions of sharing information and comment, etc.

0.100

0.0162

 Prompts

0.084

Reminder

0.333

Allow users to set reminders for asthma tests.

The app provides details of asthma tests reminder

0.139

0.0039

Allow users to set medication reminder

The app provides details of medication reminder, such as medication name and dosage, etc.

0.393

0.0110

Allow users to set reminders for return visit

The app can send information regularly to remind return visit

0.234

0.0066

Provide reminders for checking inhalers

The app provides reminders for checking the date and medications dosage of inhalers

0.234

0.0066

Warnings

0.667

Provide alert based on patients’ changing health data

The app can send warning information automatically when there is abnormal data

1.000

0.0561

The following design principles are implemented in the apps:

 Ease of use

0.105

Accessibility

0.429

The app can be easily accessed and obtained information

The app and its contents are accessible to all users (including all kinds of users with access barriers, such as visual impairment, hearing impairment, etc.)

1.000

0.0449

Automation

0.429

The app can retrieve patients’ data automatically

The app can connect to health apparatuses to improve efficiency of data collection

1.000

0.0449

User-friendly interface

0.142

All components/screens, menu labels/icons of apps are clear, intuitive, and able to use immediately

Interface design (including menu, background, colors, fonts, etc.) is scientific and reasonable. The operation steps are simple and can be operated according to window prompts without user guide. Navigation is logical and intuitive, and internal and external links are valid

1.000

0.0150

 Usability

0.105

Usefulness of knowledge

0.250

Information released by apps is for patient’s needs and value

Information contained within apps is accurate and comprehensive, with high utilization rate

1.000

0.0262

Rate of update

0.750

The app is updated regularly and timely

The app (including its contents, functions and technology) is updated regularly and timely

1.000

0.0786