BigScience Workshop
Research workshop on large language models - The Summer of Language Models 21
Popular repositories Loading
-
promptsource
promptsource PublicToolkit for creating, sharing and using natural language prompts.
-
Megatron-DeepSpeed
Megatron-DeepSpeed PublicOngoing research training transformer language models at scale, including: BERT & GPT-2
-
bigscience
bigscience PublicCentral place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
-
biomedical
biomedical PublicTools for curating biomedical training data for large-scale language modeling
Repositories
Showing 10 of 35 repositories
- bigscience Public
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
bigscience-workshop/bigscience’s past year of commit activity - Megatron-DeepSpeed Public
Ongoing research training transformer language models at scale, including: BERT & GPT-2
bigscience-workshop/Megatron-DeepSpeed’s past year of commit activity - massive-probing-framework Public Forked from AIRI-Institute/Probing_framework
Framework for BLOOM probing
bigscience-workshop/massive-probing-framework’s past year of commit activity