Feature request - Local GPUs

[maziyarpanahi]

Thanks @mlabonne for sharing this personal repo, dead simple! I just wanted to say it would be great if it can support local GPUs specially via that vLLM run in a container.

Thanks again, great job.

[mlabonne]

Thanks @maziyarpanahi! No plan at the moment because it's not how I use this tool, but I'll keep it in mind.