2026-04-16 20:22 UTC
@lexoyo Not an expert but llama.cpp might be what you are looking for: https://github.com/ggml-org/llama.cpp
Replies (1)
-
@lexoyo@framapiaf.org 2026-04-16 22:20
@dlsl indeed it looks great to download and serve, I'll give it a try, hopping it's real #foss 🙏