rai vs genpark-speculative-decoding-compound-ai-serving-runtime-skill
Side-by-side comparison of two Ai projects on AiList.
Tagline
CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.
Speculative decoding compound AI high-throughput serving runtime (Fireworks AI style)
GitHub Stars
10
8
Stars This Week
—
—
Language
Rust
—
License
Apache-2.0
—
Built With
—
—
Views
16
23
Clicks
0
0