Skip to content

Latest commit

 

History

History

act_scales

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 

Activation Channel Scales

We provide the activation channel scales for OPT and BLOOM models at Huggingface. We get those scales with 512 random sentences in the Pile validation set. You can use ../examples/smoothquant_opt_demo.ipynb to test smoothing and quantizing those models.