You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the Issue
Trying to run the smallest model (q2_K) from https://huggingface.co/TeeZee/DarkForest-20B-v2.0-GGUF/tree/main on the CPU.
For some reason, the model is not recognized. (output below) The q5_K_M version from the same source works with no problems at all.
It's very likely that file is corrupted then. Looking at the HF file I can confirm that it is indeed corrupted. Clicking on the properties will show you that as well. You should ask the creator to verify and reupload.
Describe the Issue
Trying to run the smallest model (q2_K) from https://huggingface.co/TeeZee/DarkForest-20B-v2.0-GGUF/tree/main on the CPU.
For some reason, the model is not recognized. (output below) The q5_K_M version from the same source works with no problems at all.
Additional Information:
The text was updated successfully, but these errors were encountered: