From: Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)
Data size
Train epochs
Train batch_size
Eval batch_size
Eval strategy
Eval steps
GPU
Pre-training time per epoch
10.7 MByte
10
16
Steps
100
Nvidia GTX1070
32 min