ggml : AVX IQ quants (#7845) · arthw/llama.cpp@8a9ff8f · GitHub

Commit

ggml : AVX IQ quants (ggerganov#7845)

Browse files

* initial iq4_xs

* fix ci

* iq4_nl

* iq1_m

* iq1_s

* iq2_xxs

* iq3_xxs

* iq2_s

* iq2_xs

* iq3_s before sllv

* iq3_s

* iq3_s small fix

* iq3_s sllv can be safely replaced with sse multiply

Loading branch information

netrunnereve authored and NeoZhangJianyu committed Jun 30, 2024

1 parent ca8dbd6 commit 8a9ff8f