rvp I should've qualified
Well, i think you pretty much did that by specifying chatbot AI. Sure, you can probably train specialized AI's to write code. No doubt about that but i think it's a long, long way before it'll actually be trustworthy to write longer portions without close supervision and it will always (well, at least for the foreseeable future) somewhat choke on complex problems regarding more exotic topics as it can only rely on existing data but not do any research of it's own let alone actually understand concepts. Besides actually defining complex problems well enough to get some clear target for an AI to work towards for producing an useful solution seems to be quite a hurdle.
I guess it will become very good at writing common code snippets though. I'm seriously looking forward to just hand some AI a struct definition and have it write the boring command line parsing logic that fills it 😉
Actually the chess video, as silly as it is, can be seen as an example of the limitations of AI. I mean, one just has to look at how both engines start off quite reasonable and get more and more eccentric the further the game progresses. The reason should be pretty obvious: The more complex the game state gets the less data they have to draw from pushing them to make decisions based on states that are further and further away from actual reality reducing the chances for them to make sense.
Sure, a specialized AI might be able to interpolate and deduct from multiple somewhat close data points but they still don't understand concepts or are able to actually invent things as they are basically parrots on steroids and as soon as they are confronted with something they can't simply copy it's down to their interpolation abilities.
Edit: Yeah, probably kind of like trying to interpolate a hand without understanding the concept of a hand.