Skip to content
Menu
Home
Resources
Get started with Gaudi
Large Scale Models
Amazon EC2 DL1 Training Instances
Tutorials
Debugging and Optimization Solutions
Model Performance Data
Kernel Libraries
Gaudi on Premise
Software Setup and Installation
Habana Program for Academic and Research Institutions
Videos
Documentation
Installation Guide
PyTorch User Guide
TensorFlow User Guide
Catalog
TensorFlow
PyTorch
Containers
Computer Vision
Natural Language Processing
Forum
Explore More
Habana Developer Blog
Events and Webinars
FAQs
Support
Contact us
Developer
Menu
Home
Resources
Get started with Gaudi
Large Scale Models
Amazon EC2 DL1 Training Instances
Tutorials
Debugging and Optimization Solutions
Model Performance Data
Kernel Libraries
Gaudi on Premise
Software Setup and Installation
Habana Program for Academic and Research Institutions
Videos
Documentation
Installation Guide
PyTorch User Guide
TensorFlow User Guide
Catalog
TensorFlow
PyTorch
Containers
Computer Vision
Natural Language Processing
Forum
Explore More
Habana Developer Blog
Events and Webinars
FAQs
Support
Contact us
Home
»
BLOOM
Habana Developer Blog
/ BLOOM
02/14/2023
BLOOM 176B Inference on Habana Gaudi2
With Habana’s SynapseAI 1.8.0 release support of DeepSpeed Inference, users can run inference on large language models, including BLOOM 176B.
Read more
BLOOM
,
DeepSpeed
,
Inference
Sign up for the latest Habana developer news, events, training, and updates.
Sign up