CLIRadar
Michael-A-Kuykendall avatar

shimmy

Michael-A-Kuykendall/shimmy

View on GitHub

Pure-Rust WebGPU inference engine, OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Stars5.5k
Stars today-
Forks532
Trend score0

Install

$ cargo install shimmy
Latest releaseNo releases
Last pushed11 days ago
Created10 months ago
Homepage-

README badge

shimmy on CLI Radar
[![CLI Radar](https://cliradar.com/api/badge/Michael-A-Kuykendall/shimmy.svg)](https://cliradar.com/tool/michael-a-kuykendall-shimmy)

Topics

api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-aimachine-learningollama-apiopenai-compatiblerustrust-cratetransformerswebgpuwebgpu-shaders

More CLI Utilities