Update README.md
Browse files
README.md
CHANGED
@@ -1,4 +1,4 @@
|
|
1 |
-
This model repository presents "TinySapBERT",
|
2 |
We used our [TinyPubMedBERT](https://huggingface.co/dmis-lab/TinyPubMedBERT-v1.0), a tiny-sized LM, as an initial starting point to train using the SapBERT scheme.
|
3 |
<br>
|
4 |
cf) TinyPubMedBERT is a distillated [PubMedBERT (Gu et al., 2021)](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract), open-sourced along with the release of the KAZU (Korea University and AstraZeneca) framework.
|
|
|
1 |
+
This model repository presents "TinySapBERT", tiny-sized biomedical entity representations (language model) trained using [official SapBERT code and instructions (Liu et al., NAACL 2021)](https://github.com/cambridgeltl/sapbert).
|
2 |
We used our [TinyPubMedBERT](https://huggingface.co/dmis-lab/TinyPubMedBERT-v1.0), a tiny-sized LM, as an initial starting point to train using the SapBERT scheme.
|
3 |
<br>
|
4 |
cf) TinyPubMedBERT is a distillated [PubMedBERT (Gu et al., 2021)](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract), open-sourced along with the release of the KAZU (Korea University and AstraZeneca) framework.
|