Skip to main content

Table 1 Usability questionnaire completed by study participants; each was scored using a Likert scale from 1 (strongly disagree) to 5 (strongly agree)

From: Machine learning to help researchers evaluate biases in clinical trials: a prospective, randomized user study

Usability Questions

System Usability Scale (SUS) Questions

 I think I would like to use this system frequently.

 I found the system unnecessarily complex.

 I thought the system was easy to use.

 I think that I would need the support of a technical person to be able to use this system.

 I found the various functions in this system were well integrated.

 I thought there was too much inconsistency in this system.

 I would imagine that most people would learn to use this system very quickly.

 I found the system very cumbersome to use.

 I felt very confident using the system.

 I needed to learn a lot of things before I could get going with this system.

Additional questions relating to bias assessment

 I found the text suggested by the computer helpful in completing the task.

 I found it difficult to navigate to the sections of the article suggested as relevant by the model.

 I feel that having the computer suggest text to reviewers would improve the quality of the final output (i.e., the information extracted for the systematic review).

 I felt the text suggested by the computer was often irrelevant.

 I was confused by the text that the computer suggested.

 I would like to continue using this system to aid systematic review production.