New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add layer_norm [WIP] #145

Closed

lancerts wants to merge 2 commits into main from lancerts-patch-2

Collaborator

lancerts commented Aug 28, 2024 •

edited

Loading

Summary

Add layer_norm, #138

Testing Done

Hardware Type:
run make test to ensure correctness
run make checkstyle to ensure code style
run make test-convergence to ensure convergence

lancerts added 2 commits

August 28, 2024 12:13


          Create layer_norm

f5f1ce3


          Merge branch 'main' into lancerts-patch-2

fa543c5

cherichy commented Aug 30, 2024

The assumption n_cols <= BLOCK_SIZE can be eliminated by adding a for loop to iterate offset along col axis.

lancerts closed this

lancerts deleted the lancerts-patch-2 branch

September 4, 2024 04:18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet