Home » Fine Tuning

Intel® Gaudi® AI Accelerators Blog

/ Fine Tuning

Fine-Tuning Llama2-70B with DeepSpeed ZeRO-3 and Low-Rank Adaptation (LoRA) on Intel® Gaudi®2 AI Accelerator

With the Intel Gaudi SynapseAI 1.13.0 release, users can run Fine Tune the Llama2 70B model using only 8 Gaudi2 Accelerators.
Read more
DeepSpeed, Fine Tuning, Llama, LoRA

Fine tuning GPT2 with Hugging Face and Habana Gaudi

In this tutorial, we will demonstrate fine tuning a GPT2 model on Habana Gaudi AI processors using Hugging Face optimum-habana library with DeepSpeed.
Read more
DeepSpeed, Fine Tuning, Gaudi, GPT, GPT2, Hugging Face