Terence Tao & other Fields medalists have a declaration worth reading on math & ai: https://mathandai.org/ It notes a clash between AI benchmark culture and mathematical understanding, which to me suggests a subtle emendation of Goodhart's law: with enough optimization pressure, aligned goals diverge. Before, solving major open problems required gaining community understanding of it; now, an AI company LLM swarm can demolish a problem without contributing much to the mathematical community.