BLOOM 176B Inference HuggingFace BLOOM model for Inference on Gaudi2, using DeepSpeed for Inference Application NLP Framework PyTorch with DeepSpeed GitHub Link https://github.com/HabanaAI/Model-References/tree/master/PyTorch/nlp/bloom Update Date 02/01/2023 Tags DeepSpeed, FP8, Gaudi2, Generative, Inference, Large Language Models, LLM, Natural Language Processing, NLP, PyTorch Overview