Megatron-DeepSpeed LLAMA 13B
LLAMA 13B parameter model based on Megatron DeepSpeed on Gaudi2
DeepSpeed Chat
How to use the 3 stages of Fine Tuning including Real Life Human Feedback
BLOOM 176B Inference
HuggingFace BLOOM model for Inference on Gaudi2, using DeepSpeed for Inference
Megatron-DeepSpeed BLOOM 13B
GPT based model with 13B parameters based on Megatron DeepSpeed on Gaudi2
BERT-5B
BERT model with 5 Billion Parameters using DeepSpeed for NLP
BERT-1.5B
BERT model with 1.5 Billion Parameters using DeepSpeed for NLP