Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
-
Updated
Dec 18, 2024 - Python
#
mixtral
Here are 76 public repositories matching this topic...
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
nlp bloom distributed-systems machine-learning deep-learning chatbot pytorch falcon transformer neural-networks llama gpt pretrained-models language-models volunteer-computing pipeline-parallelism guanaco tensor-parallelism large-language-models mixtral
-
Updated
Sep 7, 2024 - Python
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
llama gpt lora gemma alpaca zephyr mistral peft aquila baichuan llm chatglm qlora internlm llama2 qwen mixtral minicpm qwen2 llama3
-
Updated
Oct 24, 2024 - Python
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
agent chatbot conversational-ai peft baichuan msagent large-language-models llm supervised-finetuning llava llm-training chatglm2 internlm llama2 qwen chatglm3 mixtral llama3 phi3
-
Updated
Dec 16, 2024 - Python
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
python terminal ai tui llama gpt gemma mistral claude large-language-models llm chatgpt ollama ollama-interface ollama-client mixtral mistral-ai llama3 phi-3
-
Updated
Oct 10, 2024 - Python
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
-
Updated
Apr 30, 2024 - Python
🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.
metal accelerator ml resnet llama low-level-programming mistral llm stable-diffusion mixtral tenstorrent
-
Updated
Dec 18, 2024 - C++
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
docker kubernetes ai inference nvidia openai llama gpt gemma mistral fine-tuning finetuning buildkit large-language-models llm chatgpt open-llm open-source-llm localllama mixtral
-
Updated
Dec 16, 2024 - Go
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
-
Updated
Mar 13, 2024 - Rust
Multi-node production GenAI stack. Run the best of open source AI easily on your own servers. Easily add knowledge from documents and scrape websites. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server
api golang helm swagger openapi self-hosted openai k8s llama mistral finetuning rag llm stable-diffusion llm-serving llm-agent function-calling sdxl mixtral gptscript
-
Updated
Dec 18, 2024 - Go
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
benchmark deployment tool evaluation pruning quantization post-training-quantization awq large-language-models llm vllm smoothquant mixtral internlm2 lvlm llama3 omniquant quarot lightllm spinquant
-
Updated
Dec 17, 2024 - Python
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
chinese gpt lora language-model fine-tuning large-language-models llm instruction-tuning qlora mixtral mixtral-8x7b mixtral-8x7b-instruct
-
Updated
May 9, 2024 - Python
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
bloom falcon moe gemma mistral mixture-of-experts model-quantization multi-gpu-inference m2m100 llamacpp llm-inference internlm llama2 qwen baichuan2 mixtral phi-2 deepseek minicpm
-
Updated
Mar 15, 2024 - C++
GPT-4 level function calling models for real-world tool using use cases
-
Updated
Oct 5, 2024 - Python
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
python open-source openai surveys experiments domain-specific-language market-research social-science synthetic-data data-labeling llm anthropic llm-agent llm-inference llama2 llm-framework mixtral deepinfra
-
Updated
Dec 18, 2024 - Python
On-device LLM Inference Powered by X-Bit Quantization
natural-language-processing compression self-hosted llama language-models quantization language-model gemma mistral model-compression efficient-inference llm llms generative-ai large-language-model llm-inference llama2 mixtral llama3
-
Updated
Dec 18, 2024 - Python
Improve this page
Add a description, image, and links to the mixtral topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mixtral topic, visit your repo's landing page and select "manage topics."