Load gated models from Huggingface via a yaml file #2450
Unanswered
CodeMazeSolver
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello there,
is it possible to load gated models from Huggingface if I specify the model in the .yaml config file? If so what do I need to add?
In my specific case I try to use the Mistral model Mixtral-8x22B-Instruct-v0.1
This is the exemplary yaml file I try to use
which gives me this error:
Thank you in advance for any help.
Beta Was this translation helpful? Give feedback.
All reactions