Megatron-DeepSpeed BLOOM 13B GPT based model with 13B parameters based on Megatron DeepSpeed on Gaudi2 Application NLP Framework PyTorch with DeepSpeed GitHub Link https://github.com/HabanaAI/Model-References/tree/master/PyTorch/nlp/DeepSpeedExamples/Megatron-DeepSpeed Update Date 02/01/2023 Tags DeepSpeed, Gaudi2, Generative, Inference, Large Language Models, LLM, Natural Language Processing, NLP, PyTorch Overview