Skip to content
#

lpu-inference-engine

Star

Here is 1 public repository matching this topic...

RMNCLDYO / groq-ai-toolkit

Star 20

A versatile CLI and Python wrapper for Groq AI's breakthrough LPU Inference Engine. Streamline the creation of chatbots and generate dynamic text with speeds of up to 800 tokens/sec.

artificial-intelligence language-processing lpu groq large-language-models mixtral-8x7b groqapi groqai groq-ai groq-api groqaiapi groq-ai-api lpu-inference-engine language-processing-unit languageprocessingunit large-laguage-model llama3 llama-3 llama3-70b-8192
  • Updated Sep 12, 2024
  • Python

Improve this page

Add a description, image, and links to the lpu-inference-engine topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the lpu-inference-engine topic, visit your repo's landing page and select "manage topics."

Learn more