Fig. 1From: Investigation of improving the pre-training and fine-tuning of BERT model for biomedical relation extractionLearned knowledge of training data in the layers of BioBERT. L is the total layers of BERT model. “Measurement of Knowledge” (\(\Delta _\tau ^L\)) is defined in the Methods sectionBack to article page