Home » Catalog » Models » BERT Pretraining

BERT Pretraining

BERT Pretraining for PyTorch

Application

Natural Language Processing

Framework

PyTorch

Saved Models

SynapseAI 1.6.0
https://vault.habana.ai/artifactory/pretrained-models/models/1.6.0/PT/Bert-Large/Bert-Large-PyTorch-1.12.0-1.6.0-439-8n-model.tar.gz

Datasets

Wikipedia, Book Corpus

License

CC-BY-SA

Overview

Sign up for the latest Habana developer news, events, training, and updates.