From 697ad47e58c1f2cddfdee91da67fe4cc890200d5 Mon Sep 17 00:00:00 2001 From: "Michael A. Kuykendall" Date: Sat, 18 Oct 2025 12:30:46 -0500 Subject: [PATCH] Add shimmy - Python-free Rust inference server --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index a4598cb9..004356fe 100644 --- a/README.md +++ b/README.md @@ -194,6 +194,7 @@ It might want to try `image-rs` for now. Algorithms such as linear transformatio - [xaynetwork/xaynet](https://github.com/xaynetwork/xaynet) - Xaynet represents an agnostic Federated Machine Learning framework to build privacy-preserving AI applications - [webonnx/wonnx](https://github.com/webonnx/wonnx) - A GPU-accelerated ONNX inference run-time written 100% in Rust, ready for the web - [sonos/tract](https://github.com/sonos/tract) - Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference +- [Michael-A-Kuykendall/shimmy](https://github.com/Michael-A-Kuykendall/shimmy) - Python-free Rust inference server with OpenAI API compatibility and hot model swapping. - [MegEngine/MegFlow](https://github.com/MegEngine/MegFlow) - Efficient ML solutions for long-tailed demands.