BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Overview

BLOOM is a 176-billion parameter open-access multilingual language model developed by the BigScience community. It supports 46 natural languages and 13 programming languages, trained on a diverse corpus for text generation and understanding. The model is available under a permissive license for research and commercial use.

Best for

Best for
Researchers and developers needing a large, open multilingual model for diverse language and code tasks

Use cases

• Multilingual text generation and completion
• Cross-lingual translation and summarization
• Code generation in multiple programming languages

Notes

BLOOM is a 176-billion parameter open-access multilingual language model developed by the BigScience community. It supports 46 natural languages and 13 programming languages, trained on a diverse corpus for text generation and understanding. The model is available under a permissive license for research and commercial use.

Use cases

• Multilingual text generation and completion
• Cross-lingual translation and summarization
• Code generation in multiple programming languages

Pros

• Open-access weights and code enable full reproducibility and customization
• Broad language coverage supports many low-resource languages
• Large scale provides strong performance on diverse NLP tasks

Cons

• Requires substantial GPU memory and compute for inference and fine-tuning
• Inference latency is high due to model size
• May inherit biases present in the training corpus

Indexed from awesome-llm and enriched against its public facts.