A legitimately interesting take. I can see two angles: AGI is implicitly expected to become ASI because many useful technologies have scaled to levels natural evolution didn’t. Our strongest weightlifters didn’t grow into thousand-horsepower cranes. Our quickest math savants are not cranking out a teraflop of FP32. But conversely, that’s why cranes and CPUs are economically interesting. Not really sure being able to carry on a plausible conversation on a “new subject” like the game example is much of an evidence of intelligence. ELIZA did it with a few kilobytes of RAM and some manually hardcoded rules. Having a huge set of training data just expands the opportunity for a plausible match. I think the lack of self-improvement and finite contexts are sort of damning. Outside of rare neurological disorders, I can’t make intelligent people forget how to ride a bike by reading the phone book to them.