2026-09-23 18:03 UTC
LLMs run on matrix math and probabilities
Yes, and the silicon to handle that math already exists. It’s the “GPUs” being pumped out by nVidia. Those are basically now highly specialized matrix math machines.
Replies (1)
-
@wholookshere@lemmy.blahaj.zone 2026-09-23 19:09
Then why do NPUs exist? What I’m talking about exists on the smaller scale. Just a matter of time before its done on a larger. A general purpose GPU still contains silicon for display, and video en/decoding. Those don’t contribute in any meainiful way. Not to mention it doesn’t cover all of matrix math for LLM needs…