BERT Pretraining for PyTorch
Application
Natural Language Processing
Framework
PyTorch
Pretrained Models
Checkpoints
SynapseAI 1.9.0
https://vault.habana.ai/artifactory/pretrained-models/checkpoints/1.9.0/PT/BertL-PT/BertL-PT-PyTorch-1.13.1-1.9.0-580-32n-checkpoint.tar.gz
Saved Models
SynapseAI 1.9.0
https://vault.habana.ai/artifactory/pretrained-models/models/1.9.0/PT/Bert-Large/Bert-Large-PyTorch-1.13.1-1.9.0-580-32n-model.tar.gz
Datasets
Wikipedia, Book Corpus
License
CC-BY-SA