Megatron-DeepSpeed LLAMA 13B LLAMA 13B parameter model based on Megatron DeepSpeed on Gaudi2 Application NLP, Fine Tuning Framework PyTorch GitHub Link https://github.com/HabanaAI/Model-References/tree/master/PyTorch/nlp/DeepSpeedExamples/Megatron-DeepSpeed Update Date 08/09/2023 Tags DeepSpeed, Gaudi, Generative, Large Language Models, NLP, PyTorch Overview