NLP - Habana Developers

BART

BART model for NLP on Pytorch

BERTGaudiGaudi2Natural Language ProcessingNLPTensorFlow

BERT

BERT for TensorFlow

BERTGaudiInferenceNatural Language ProcessingNLPPyTorch

BERT Fine tuning

BERT Fine Tuning Training and Inference

BERTGaudiNatural Language ProcessingNLPPretrained ModelPyTorch

BERT Pretraining

BERT Pretraining for PyTorch

BERTDeepSpeedGaudiNatural Language ProcessingNLPPyTorch

BERT-1.5B

BERT model with 1.5 Billion Parameters using DeepSpeed for NLP

BERTDeepSpeedGaudiNatural Language ProcessingNLPPyTorch

BERT-5B

BERT model with 5 Billion Parameters using DeepSpeed for NLP

DeepSpeedGaudi2InferenceNLPPyTorch

BLOOM 176B Inference

HuggingFace BLOOM model for Inference on Gaudi2, using DeepSpeed for Inference

GaudiNatural Language ProcessingNLPTensorFlow

DistilBERT

DistilBERT – small, fast

DistilBERT

DistilBERT model from Huggingface repository

GaudiNatural Language ProcessingNLPTensorFlow

ELECTRA Fine Tuning

ELECTRA Fine Tuning For TensorFlow2

ELECTRA Fine Tuning

ELECTRA Large Discriminator model for Fine Tuning

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face ALBERT Large

Habana Optimum ALBERT Large for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face ALBERT XXLarge

Habana Optimum ALBERT XXLarge for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face BERT

Habana Optimum BERT for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face BERT large model (uncased) whole word masking

Habana Optimum BERT large model (uncased) whole word masking for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face DistilBERT

Habana Optimum DistilBERT for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face GPT2

Habana Optimum GPT2 for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face RoBERTa

Habana Optimum RoBERTa for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face RoBERTa large

Habana Optimum RoBERTa large for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face Swin Transformer

Habana Optimum Swin Transformer for PyTorch

CommunityGaudiHugging FaceNatural Language ProcessingNLPPyTorch

Hugging Face T5

Habana OptimumT5 for PyTorch

DeepSpeedGaudi2InferenceNLPPyTorch

Megatron-DeepSpeed BLOOM 13B

GPT based model with 13B parameters based on Megatron DeepSpeed on Gaudi2

RoBERTa

RoBERTa for PyTorch

EfficientDetGaudiNatural Language ProcessingNLPT5TensorFlow

T5

T5 for TensorFlow

GaudiGaudi2Natural Language ProcessingNLPTensorFlowTransformer

Transformer

Transformer for TensorFlow

GaudiGaudi2Natural Language ProcessingNLPPyTorch

Transformer

Transformer model for PyTorch