

My son has doubled in size every month for the last few months. At this rate he’ll be fifty foot tall by the time he’s seven years old.
Yeah, it’s a stupid claim to make on the face of it. It also ignores practical realities. The first is those is training data, and the second is context windows. The idea that AI will successfully write a novel or code a large scale piece of software like a video game would require them to be able to hold that entire thing in their context window at once. Context windows are strongly tied to hardware usage, so scaling them to the point where they’re big enough for an entire novel may not ever be feasible (at least from a cost/benefit perspective).
I think there’s also the issue of how you define “success” for the purpose of a study like this. The article claims that AI may one day write a novel, but how do you define “successfully” writing a novel? Is the goal here that one day we’ll have a machine that can produce algorithmically mediocre works of art? What’s the value in that?
There’s no way they actually retrained it for this, that would be much too expensive. They’re just editing the initial prompt to convince it to act more “right wing” and it’s performing the assignment to the best of its ability. The problem is that a chat-bot doesn’t understand context, so it just plays the character it’s been given as full mask off all the time, and as a result you get this.