shimmy
Small local inference server with OpenAI-compatible GGUF endpoints
Dedicated URL：https://shimmy.ehbpc.com
Official site：https://github.com/Michael-A-Kuykendall/shimmy
Download links
No download link has been collected yet — get the official installer from the vendor site.
Description
Small local inference server with OpenAI-compatible GGUF endpoints