Is AI already learning from our old, poor-quality code?


 

In this Simple Talk opinion piece, Greg Low unpacks how AI models actually filter and weigh training data, why the most common answer isn’t always the best one, and why truth itself can depend on timing and context — not just quality.

A while back, I wrote about my experiences with trying to see if ChatGPT could answer questions as though it was a baseball umpire. It did quite poorly but, curiously, it got hard questions right and easy questions wrong – the complete opposite of what I thought it would do. As such, I’m sure that the problem was