Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
-
Updated
Sep 8, 2024 - Cuda
#
tensor-core
Here are 7 public repositories matching this topic...
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
gpu cuda inference nvidia cutlass mha multi-head-attention llm tensor-core large-language-model flash-attention flash-attention-2
-
Updated
Sep 7, 2024 - C++
Multiple GEMM operators are constructed with cutlass to support LLM inference.
-
Updated
Sep 27, 2024 - C++
Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.
gpu cuda cublas nvidia gemm matrix-multiply tensor-core hgemm back2back-hgemm fused-hgemm back2back-gemm fused-gemm
-
Updated
Nov 3, 2023 - Cuda
Codes for DTC-SpMM (ASPLOS'24)
-
Updated
Jun 2, 2024 - C++
The lab assignments from CS4302 Parallel and Distributed Programming (2022 Fall) with my solutions
-
Updated
Jan 5, 2023 - C++
Improve this page
Add a description, image, and links to the tensor-core topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tensor-core topic, visit your repo's landing page and select "manage topics."