BLOOM

BLOOM is an open-access multilingual language model that contains 176 billion parameters. It was trained for 3.5 months on 384 A100–80GB. It’s a project by BigScience.