CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.
No updates yet.
Updates are company announcements posted by the listing owner and reviewed before publishing. All AiList updates.