Cool Link
GitHub - SharpAI/SwiftLM: ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, + iOS iPhone app. · GitHub
—
github.com
Discuss
Original
Share
Sign In
👤
github.com/SharpAI/SwiftLM