Using Jan with Huggingface endpoints #4013

imtuyethan · 2024-11-13T16:35:30Z

imtuyethan
Nov 13, 2024
Maintainer

Can I use Jan for Hugging Face endpoints api calls? I set up HuggingFace inference endpoints and would like to use Jan as GUI to connect to them.

Answered by imtuyethan

This is an OpenAI-compatible endpoint. Here are the steps:

Edit any OpenAI model.json in the /models folder and change its ID to the model you want to use. It would be better to change the name as well for easier distinction in the GUI.
Change the OpenAI endpoint to the corresponding inference URL and enter the HF token.
Select the model and start a chat with it

imtuyethan · 2024-11-13T16:37:12Z

This is an OpenAI-compatible endpoint. Here are the steps:

Edit any OpenAI model.json in the /models folder and change its ID to the model you want to use. It would be better to change the name as well for easier distinction in the GUI.
Change the OpenAI endpoint to the corresponding inference URL and enter the HF token.
Select the model and start a chat with it

0 replies