Megatron-DeepSpeed LLAMA-2 70B LLAMA 13B parameter model based on Megatron DeepSpeed on Gaudi2 Application Natural Language Processing Framework PyTorch GitHub Link https://github.com/HabanaAI/Model-References/tree/master/PyTorch/nlp/DeepSpeedExamples/Megatron-DeepSpeed Update Date 08/09/2023 Tags DeepSpeed, Gaudi2, Generative, Large Language Models, NLP, PyTorch Overview