Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

gemm fp8 e4m3 #185

Open
wants to merge 31 commits into
base: main
Choose a base branch
from
Open

gemm fp8 e4m3 #185

wants to merge 31 commits into from

Commits on Aug 31, 2024

  1. gemm fp8 e4m3

    @AndreSlavescu
    AndreSlavescu committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    bb89933 View commit details
    Browse the repository at this point in the history

  2. update to benchmark

    @AndreSlavescu
    AndreSlavescu committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    60f7ffd View commit details
    Browse the repository at this point in the history

  3. faster fwd performance with tl.multiple_of

    @AndreSlavescu
    AndreSlavescu committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    e11c22b View commit details
    Browse the repository at this point in the history

  4. add stricter check for compute capability + exception handling

    @AndreSlavescu
    AndreSlavescu committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    e68f7f1 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into matmulfp8

    @AndreSlavescu
    AndreSlavescu authored Aug 31, 2024
    Configuration menu
    Copy the full SHA
    fafdfbe View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. perf improvement

    @AndreSlavescu
    AndreSlavescu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    91bf3dd View commit details
    Browse the repository at this point in the history

  2. remove discrete functional api

    @AndreSlavescu
    AndreSlavescu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    9d467bf View commit details
    Browse the repository at this point in the history

  3. make compute capability check a decorator

    @AndreSlavescu
    AndreSlavescu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    8b45800 View commit details
    Browse the repository at this point in the history

  4. format

    @AndreSlavescu
    AndreSlavescu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    2319fc7 View commit details
    Browse the repository at this point in the history

  5. implement backward kernel as well

    @AndreSlavescu
    AndreSlavescu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    7418433 View commit details
    Browse the repository at this point in the history

  6. add more benchmarks + diff utils

    @AndreSlavescu
    AndreSlavescu committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c39a7aa View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Merge branch 'main' of https://github.com/AndreSlavescu/Liger-Kernel … 

    …into matmulfp8

merge main into matmulfp8
    @AndreSlavescu
    AndreSlavescu committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    f8829e5 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. update utils to include mma_v3 for H100

    @AndreSlavescu
    AndreSlavescu committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    032c4d9 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Merge branch 'main' into matmulfp8

    @lancerts
    lancerts authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    464cdd2 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. update test.

    @AndreSlavescu
    AndreSlavescu committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    c8dba40 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'matmulfp8' of https://github.com/AndreSlavescu/Liger-Ke… 

    …rnel into matmulfp8
    @AndreSlavescu
    AndreSlavescu committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    ce2aee5 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into matmulfp8

    @AndreSlavescu
    AndreSlavescu authored Sep 7, 2024
    Configuration menu
    Copy the full SHA
    cedf3de View commit details
    Browse the repository at this point in the history

  4. format

    @AndreSlavescu
    AndreSlavescu committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    bb2f725 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2024

  1. Merge branch 'main' into matmulfp8

    @lancerts
    lancerts authored Sep 8, 2024
    Configuration menu
    Copy the full SHA
    b3195da View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into matmulfp8

    @lancerts
    lancerts authored Sep 8, 2024
    Configuration menu
    Copy the full SHA
    744642b View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Merge branch 'main' into matmulfp8

    @AndreSlavescu
    AndreSlavescu authored Sep 10, 2024
    Configuration menu
    Copy the full SHA
    7a8043a View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. compute types

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    9e60b0a View commit details
    Browse the repository at this point in the history

  2. modify benchmark to be up to date

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    98b7abf View commit details
    Browse the repository at this point in the history

  3. format

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a709616 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into matmulfp8

    @lancerts
    lancerts authored Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c9cbc3a View commit details
    Browse the repository at this point in the history

  5. fix mem bounds

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    569b4eb View commit details
    Browse the repository at this point in the history

  6. Merge branch 'matmulfp8' of https://github.com/AndreSlavescu/Liger-Ke… 

    …rnel into matmulfp8
    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    acc228b View commit details
    Browse the repository at this point in the history

  7. docstring for fp8 gemm design

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d31244a View commit details
    Browse the repository at this point in the history

  8. format

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0f36098 View commit details
    Browse the repository at this point in the history

  9. remove old benchmark format

    @AndreSlavescu
    AndreSlavescu committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    edc4ebc View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Merge branch 'main' into matmulfp8

    @AndreSlavescu
    AndreSlavescu authored Sep 15, 2024
    Configuration menu
    Copy the full SHA
    618c858 View commit details
    Browse the repository at this point in the history