LLMs can be useful in this context, but Anthropic blew Mythos way way out of proportion. It absolutely was overly hyped. Their own demonstrator had to work with a downlevel firefox so it would still have vulnerabilities that were already fixed before they even started. It seems that their narrative is that other tools, some LLM and some not may be as good or better than Mythos at *finding* issues, but there were a couple of issues where Mythos was able to actually create a demonstrator, which the other models did not do. Which is relatively less interesting, as a human going from finding to demonstrator is generally not a huge part of the tedium, the tedium usually is in the finding. They pitched it as "it is dangerous, it will escape confinement", etc etc. But instead they had to explicitly start with a downlevel firefox with known vulnerabilities unpatched and they further had to disable all the security mitigations that in practice had already made the two "vulnerabilities" impossible to exploit. It's a matter of degree and exaggeration.