Large Model usage with minGPT
Published:
This tutorial provides example training scripts to demonstrate different DeepSpeed optimization technologies on HPU.
Getting started with AWS DL1 and PyTorch
Published:
Set up an Amazon EC2 DL1 instance and start training a PyTorch model on Gaudi
Accelerate Transformer training with Optimum Habana
Published:
Migrate Hugging Face model to Habana Gaudi
Getting Started with Hugging Face Transformers
Published:
Set up a Habana Gaudi instance on Amazon Web Services, and fine-tune a BERT model …
Use an HPU
Published:
An adaptation of Use a GPU tutorial using Habana Gaudi AI processors. TensorFlow code, and tf.keras models run on …
Finetune Transformers Models with PyTorch Lightning
Published:
An adaptation of Finetune transformers models with pytorch lightning tutorial using Habana Gaudi AI processors. This notebook …
Introduction To PyTorch Lightning
Published:
An adaptation of Introduction to PyTorch Lightning tutorial using Habana Gaudi AI processors. In this tutorial, we’ll …
DistilBert Sequence Classification with IMDb Reviews
Published:
An adaptation of Huggingface Sequence Classification with IMDB Reviews using Habana Gaudi AI processors. Overview This tutorial …
PyTorch Mixed Precision
Published:
Overview Mixed precision is the use of both 16-bit and 32-bit floating-point types in a …
Distributed Training Using TensorFlow and Horovod
Published:
This tutorial demonstrates how distributed training works with Horovod using Habana Gaudi AI processors. Horovod is a …
Distributed Training Using TensorFlow and HPUStrategy
Published:
This tutorial demonstrates how distributed training works with HPUStrategy using Habana Gaudi AI processors. tf.distribute.Strategy is a TensorFlow …
Data Packing Process for MLPERF BERT
Published:
Introduction Often NLP datasets have large variations in their samples length. setting a maximum sequence …
Intro to Autoencoders
Published:
An adaptation of Intro to Autoencoders tutorial using Habana Gaudi AI processors. This tutorial introduces autoencoders …
Training a Classifier
Published:
An adaptation of training a classifier tutorial using Habana Gaudi AI processors. In this tutorial, we …
Convolutional Neural Network (CNN)
Published:
An adaptation of Convolutional Neural Network (CNN) tutorial using Habana Gaudi AI processors. This tutorial demonstrates …
Mixed precision
Published:
An adaptation of TensorFlow Mixed precision tutorial using Habana Gaudi AI processors. This tutorial demonstrates enabling …
Quick Start
Published:
WARNING: The directory ‘/home/ubuntu/.cache/pip/http’ or its parent directory is not owned by the current user …
Image classification
Published:
An adaptation of Image classification tutorial using Habana Gaudi AI processors. This tutorial shows how …