2026-09-29 04:57 UTC
I mean, but quite, but also yes.
Running your own model doesn’t solve every problem with LLMs, but it sure as hell does solve a ton of them, for way less money! Local models are great, gwen3.8 on my 3090 at home is slower, but often better than the pay to play Claude from work.
Replies (1)
-
@thefluffiest@feddit.nl 2026-09-29 05:10
It maybe doesn’t solve ALL problems, but it solves the ones in this post: high token prices, running out of tokens shutting down the workflow, and handing over your sensitive data to corporates doing god knows what with it.