Soon, Kids Would be Building GPT-2 in Schools

AI is taking over coding jobs. When we say this, we don’t mean AI is coding better than people, it’s just that everyone is coding to build AI models. To a point that much of the other research is subsided, with generative AI at the forefront.  People are so proficient with LLMs that they don’t even remember GPT-2 being touted as an equally existentially risky piece of technology back in 2019 as GPT-5 is believed to be today, something that even OpenAI had warned about. Now, almost every coder wants to build a GPT-2 like model in their basement, and probably start hiding GPUs in the cellar. Now, what would happen if kids in schools started building GPT-2 like models as fun projects? This is bound to happen, like with any other technological innovation. Schools are beginning to integrate AI into their curricula, teaching students not just how to use AI tools, but also how to build them from scratch. https://twitter.com/ylecun/status/1752120638490488951 In the 202