BERT-5B
BERT model with 5 Billion Parameters using DeepSpeed for NLP
BERT-1.5B
BERT model with 1.5 Billion Parameters using DeepSpeed for NLP
BERT Fine tuning
BERT Fine Tuning Training and Inference
BERT Pretraining
BERT Pretraining for PyTorch