2026-09-23 13:51 UTC
They aren’t comparable. GPS is deterministic and simple so as you said it could be reduced to an FPGA or ASIC.
LLMs are partially matrix math and probabilities but they’re also more complex than that and require a large amount of RAM to run even the first time. Each query added to the context increases the RAM needed further.
Replies (2)
-
@Strawberry@lemmy.blahaj.zone 2026-09-23 14:20
LLMs are also deterministic and the weights for a model could be ‘hard-coded’ into a chip, no?
-
@wholookshere@lemmy.blahaj.zone 2026-09-23 15:37
I dont believe the memory, both ram and storage combine, are what’s causing data centres to gobble up power and associated resources (electricity, cooling,…). Its the GPUs. I’m not counting on a future with LLMs by any means, but there’s tons of efficiencies we can do to make the cost go down. Were just not doing it. We saw the same thing with crypto mining. It started on GPUs but then speficially designed silicon (asyc miners) were vastly more efficient than a GPU rig. It still needed memory yes, but again, thats not the constraint.