BERT Pretraining
BERT Pretraining for PyTorch
DistilBERT
DistilBERT model from Huggingface repository
ELECTRA Fine Tuning
ELECTRA Fine Tuning For TensorFlow2
ELECTRA Fine Tuning
ELECTRA Large Discriminator model for Fine Tuning
Hugging Face ALBERT Large
Habana Optimum ALBERT Large for PyTorch
Hugging Face ALBERT XXLarge
Habana Optimum ALBERT XXLarge for PyTorch
Hugging Face BERT
Habana Optimum BERT for PyTorch
Hugging Face BERT large model (uncased) whole word masking
Habana Optimum BERT large model (uncased) whole word masking for PyTorch
Hugging Face DistilBERT
Habana Optimum DistilBERT for PyTorch
Hugging Face GPT2
Habana Optimum GPT2 for PyTorch
Hugging Face RoBERTa
Habana Optimum RoBERTa for PyTorch
Hugging Face RoBERTa large
Habana Optimum RoBERTa large for PyTorch
Hugging Face Swin Transformer
Habana Optimum Swin Transformer for PyTorch
Hugging Face T5
Habana OptimumT5 for PyTorch
Transformer
Transformer for TensorFlow