2026-09-15 09:58 UTC
Lets go academic. Entropy, it gets too chaotic.
We can't learn off of slop for ever...
https://arxiv.org/html/2601.05280v1
Replies (1)
-
@nullagent@partyon.xyz 2026-09-15 10:02
Now of course in true academic form the authors go on to look for ways TO get closer to AGI but they have some really good points on the limits of current LLMs and approaches to training. It really makes you question the rate of diminishing returns and the complex way models are trained off of each other at times.