Profiling and Optimization
Published:
How to Use Gaudi’s Profiler tool and Tensorboard Plug-in to provide to modify any model for better performance.
Tags: GaudiPerformance
Detecting Dynamic Shapes
Published:
How to find Dynamic Data and Ops in your models, and ways to help reduces these for better performance
Tags: GaudiPerformance
Large Model usage with minGPT
Published:
This tutorial provides example training scripts to demonstrate different DeepSpeed optimization technologies on HPU.
Getting started with AWS DL1 and PyTorch
Published:
Set up an Amazon EC2 DL1 instance and start training a PyTorch model on Gaudi
Accelerate Transformer training with Optimum Habana
Published:
Migrate Hugging Face model to Habana Gaudi
Tags: Community
Getting Started with Hugging Face Transformers
Published:
Set up a Habana Gaudi instance on Amazon Web Services, and fine-tune a BERT model …
Tags: Community
Use an HPU
Published:
This tutorial is for users who have tried these approaches and found that they need fine-grained control of how TensorFlow uses the HPU.
Tags: GaudiTensorFlow
Finetune Transformers Models with PyTorch Lightning
Published:
An adaptation of Finetune transformers models with pytorch lightning tutorial using Habana Gaudi AI processors. This notebook …
Introduction To PyTorch Lightning
Published:
An adaptation of Introduction to PyTorch Lightning tutorial using Habana Gaudi AI processors.
In this tutorial, we’ll go over the basics of lightning by preparing models to train on the MNIST Handwritten Digits dataset
PyTorch Mixed Precision
Published:
Overview Mixed precision is the use of both 16-bit and 32-bit floating-point types in a …
Distributed Training Using TensorFlow and Horovod
Published:
This tutorial demonstrates how distributed training works with Horovod using Habana Gaudi AI processors. Horovod is a …
Distributed Training Using TensorFlow and HPUStrategy
Published:
This tutorial demonstrates how distributed training works with HPUStrategy using Habana Gaudi AI processors. tf.distribute.Strategy is a TensorFlow …
Data Packing Process for MLPERF BERT
Published:
Introduction Often NLP datasets have large variations in their samples length. setting a maximum sequence …
Intro to Autoencoders
Published:
An adaptation of Intro to Autoencoders tutorial using Habana Gaudi AI processors. This tutorial introduces autoencoders …
Training a Classifier
Published:
An adaptation of training a classifier tutorial using Habana Gaudi AI processors. In this tutorial, we …
Mixed precision
Published:
An adaptation of TensorFlow Mixed precision tutorial using Habana Gaudi AI processors. This tutorial demonstrates enabling …
Quick Start
Published:
An adaptation of PyTorch Quickstart tutorial using Habana Gaudi AI processors