BERT Pretraining for PyTorch
Application
Natural Language Processing
Framework
PyTorch
Pretrained Models
Checkpoints
SynapseAI 1.11.0
https://vault.habana.ai/artifactory/pretrained-models/checkpoints/1.11.0/PT/BertL-PT/BertL-PT-PyTorch-2.0.1-1.11.0-587-8n-checkpoint.tar.gz
Saved Models
SynapseAI 1.11.0
https://vault.habana.ai/artifactory/pretrained-models/models/1.11.0/PT/Bert-Large/Bert-Large-PyTorch-2.0.1-1.11.0-587-32n-model.tar.gz
Datasets
Wikipedia, Book Corpus
License
CC-BY-SA