llama.cpp server Playground🦙

A very simple one-file playground inpired on Open-AI playground for llama.cpp http server usage. More information about server.cpp: https://github.com/ggerganov/llama.cpp/tree/master/examples/server

Screenshot

Configure proxy address

Edit the vite.config.ts and change the "target" value for the llama.cpp server ip.

How to run

Install dependences

npm install

Launch server

npm run dev

Compiles and minifies for production

npm run build

It will generate a simple html that can be execute with the browser without using a server (except the llama serve.cpp runing).