Skip to content
Menu
Home
Resources
Get started with Gaudi
Large Scale Models
Amazon EC2 DL1 Training Instances
Tutorials
Debugging and Optimization Solutions
Model Performance Data
Kernel Libraries
Gaudi on Premise
Software Setup and Installation
Habana Program for Academic and Research Institutions
Videos
Documentation
Installation Guide
PyTorch User Guide
TensorFlow User Guide
Catalog
TensorFlow
PyTorch
Containers
Computer Vision
Natural Language Processing
Forum
Explore More
Habana Developer Blog
Events and Webinars
FAQs
Support
Contact us
Developer
Menu
Home
Resources
Get started with Gaudi
Large Scale Models
Amazon EC2 DL1 Training Instances
Tutorials
Debugging and Optimization Solutions
Model Performance Data
Kernel Libraries
Gaudi on Premise
Software Setup and Installation
Habana Program for Academic and Research Institutions
Videos
Documentation
Installation Guide
PyTorch User Guide
TensorFlow User Guide
Catalog
TensorFlow
PyTorch
Containers
Computer Vision
Natural Language Processing
Forum
Explore More
Habana Developer Blog
Events and Webinars
FAQs
Support
Contact us
Home
»
BERT
Habana Developer Blog
/ BERT
01/31/2023
Pre-Training the BERT 1.5B model with DeepSpeed
In this post, we show you how to run Habana’s DeepSpeed enabled BERT1.5B model from our Model-References repository.
Read more
BERT
,
DeepSpeed
,
Gaudi
,
Gaudi2
,
pytorch
,
synapseai
Sign up for the latest Habana developer news, events, training, and updates.
Sign up