A Gradio web UI for Large Language Models(Finetune, RAG, Chat).
- Finetune:lora/qlora
- RAG(Retrieval-augmented generation):
- Support txt/pdf/docx
- Show retrieved chunks
- Support finetuned model
- Training tracking and visualization
- Config prompt template through UI
- Support online and offline model
- Support online and offline dataset
Clone repo and install requirements.txt in a Python>=3.8.0 environment
git clone https://github.com/wangermeng2021/llm-webui
cd llm-webui
pip install -r requirements.txt
if you want to download Llama-2 from huggingface hub , you need to configure token:"Setting"->"Huggingface Hub Token"