Skip to main content

Table 1 Usability questionnaire completed by study participants; each was scored using a Likert scale from 1 (strongly disagree) to 5 (strongly agree)

From: Machine learning to help researchers evaluate biases in clinical trials: a prospective, randomized user study

Usability Questions
System Usability Scale (SUS) Questions
 I think I would like to use this system frequently.
 I found the system unnecessarily complex.
 I thought the system was easy to use.
 I think that I would need the support of a technical person to be able to use this system.
 I found the various functions in this system were well integrated.
 I thought there was too much inconsistency in this system.
 I would imagine that most people would learn to use this system very quickly.
 I found the system very cumbersome to use.
 I felt very confident using the system.
 I needed to learn a lot of things before I could get going with this system.
Additional questions relating to bias assessment
 I found the text suggested by the computer helpful in completing the task.
 I found it difficult to navigate to the sections of the article suggested as relevant by the model.
 I feel that having the computer suggest text to reviewers would improve the quality of the final output (i.e., the information extracted for the systematic review).
 I felt the text suggested by the computer was often irrelevant.
 I was confused by the text that the computer suggested.
 I would like to continue using this system to aid systematic review production.