Megatron-DeepSpeed LLAMA-2 70B
LLAMA 13B parameter model based on Megatron DeepSpeed on Gaudi2
DeepSpeed Chat
How to use the 3 stages of Fine Tuning including Real Life Human Feedback
BLOOM 176B Inference
HuggingFace BLOOM model for Inference on Gaudi2, using DeepSpeed for Inference
Megatron-DeepSpeed BLOOM 13B
GPT based model with 13B parameters based on Megatron DeepSpeed on Gaudi2
Hugging Face BERT large model (uncased) whole word masking
Optimum Habana BERT large model (uncased) whole word masking for PyTorch
Hugging Face RoBERTa
Optimum Habana RoBERTa for PyTorch
Hugging Face BERT
Optimum Habana BERT for PyTorch
Hugging Face ALBERT Large
Optimum Habana ALBERT Large for PyTorch
Hugging Face Swin Transformer
Optimum Habana Swin Transformer for PyTorch
Hugging Face GPT2
Optimum Habana GPT2 for PyTorch
Hugging Face ALBERT XXLarge
Optimum Habana ALBERT XXLarge for PyTorch
Hugging Face RoBERTa large
Optimum Habana RoBERTa large for PyTorch
Hugging Face DistilBERT
Optimum Habana DistilBERT for PyTorch
Hugging Face T5
Optimum Habana T5 for PyTorch
BERT-5B
BERT model with 5 Billion Parameters using DeepSpeed for NLP
BERT-1.5B
BERT model with 1.5 Billion Parameters using DeepSpeed for NLP
BERT Fine tuning
BERT Fine Tuning Training and Inference
BERT Pretraining
BERT Pretraining for PyTorch
Transformer
Transformer for TensorFlow