Skip to content
Menu
Home
Get Started
Get started with Intel® Gaudi® AI accelerators
Using Hugging Face
Tutorials
Get Access
Get Optimized
Model Performance Data
Generative AI and Large Language Models
Software Setup and Installation
Kernel Libraries
Intel® Gaudi® accelerators on Premise
Videos
Documentation
Installation Guide
PyTorch User Guide
DeepSpeed User Guide
Catalog
Containers
Generative
Large Language Models
Computer Vision
Natural Language Processing
PyTorch
Forum
Explore More
Intel Gaudi Blog
Events and Webinars
FAQs
Support
Menu
Home
Get Started
Get started with Intel® Gaudi® AI accelerators
Using Hugging Face
Tutorials
Get Access
Get Optimized
Model Performance Data
Generative AI and Large Language Models
Software Setup and Installation
Kernel Libraries
Intel® Gaudi® accelerators on Premise
Videos
Documentation
Installation Guide
PyTorch User Guide
DeepSpeed User Guide
Catalog
Containers
Generative
Large Language Models
Computer Vision
Natural Language Processing
PyTorch
Forum
Explore More
Intel Gaudi Blog
Events and Webinars
FAQs
Support
Home
»
Llama
Intel® Gaudi® AI Accelerators Blog
/ Llama
12/01/2023
Fine-Tuning Llama2-70B with DeepSpeed ZeRO-3 and Low-Rank Adaptation (LoRA) on Intel® Gaudi®2 AI Accelerator
With the Intel Gaudi SynapseAI 1.13.0 release, users can run Fine Tune the Llama2 70B model using only 8 Gaudi2 Accelerators.
Read more
DeepSpeed
,
Fine Tuning
,
Llama
,
LoRA