Table 1 Examples of the validation questions, answers output by the system, and results
Examples of validation question (Original text was in Japanese) | Answer in system | Question-author’s answers | System answersa | System confidence | Judgment | ||
|---|---|---|---|---|---|---|---|
Can I use Daikenchuto for patients with high AST and ALT? 大建中湯はAST,ALTが高い人に使ってもいいですか? | Yes | Daikenchuto and liver dysfunction | Daikenchuto and liver dysfunction | 〇 | 95.2% | Correct | TP |
In what patients is Shakuyakukanzoto contraindicated? 芍薬甘草湯の禁忌はどんな患者さんですか? | Yes | Contraindications to Shakuyakukanzoto | Indication of Shakuyakukanzoto | × | 71.4% | Incorrect | FN |
Can I give Yokukansan to patients with gastrointestinal upset? 胃腸の調子が良くない患者さんに抑肝散を使ってもいいですか? | Yes | Careful administration of Yokukansan | I do not have an answer.c | △ | 45.6% | Incorrect | FNb |
Please tell me the crude drug that has a diuretic effect in Rikkunshito. 六君子湯の中で利水利尿作用のある生薬を教えてください。 | No | - | I do not have an answer.c | △ | 40.5% | Correct | TNb |
How many grams of licorice can I take in a day when I take Yokukansan? 抑肝散の一日の甘草の量は何グラムまでならよいですか? | No | - | Yokukansan package | × | 95.5% | Incorrect | FP |