Skip to content

Examples of training models with hybrid parallelism using ColossalAI

License

Notifications You must be signed in to change notification settings

jiezhuzzz/ColossalAI-Examples

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ColossalAI-Examples

This repository contains examples of training models with ColossalAI. These examples fall under three categories:

  1. Computer Vision
  2. Natural Language Processing
  3. General examples to demonstrate ColossalAI's features

Discussion

Discussion about the Colossal-AI project and examples is always welcomed! We would love to exchange ideas with the community to better help this project grow. If you think there is a need to discuss anything, you may jump to our dicussion forum and create a topic there.

If you encounter any problem while running these examples, you may want to raise an issue in this repository.

Contributing

This project welcomes constructive ideas and implementations from the community. If you wish to add an example for a specific application, please commit your code either in the image or language folders. If you wish to add new examples to explain our features, you can commit your code in the features folder, we may invite you to put up a tutorial or blog in ColossalAI Documentation.

About

Examples of training models with hybrid parallelism using ColossalAI

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 94.4%
  • C++ 5.4%
  • Other 0.2%