So, turns out, all of this progress these models have been making over the years doesn't come from more training data, better algorithms, or more powerful hardware. They've just got humans on the other end looking at common questions it gets wrong and tweaking responses to those specific questions. https://www.404media.co/inside-project-lily-the-humans-reading-your-chatgpt-chats/