DeepMind claims AlphaCode is first AI code generation system that performs at a competitive level in code competitions for human developers.

The researchers tested ChatGPT against QuixBugs 40 Python-only problems, and then manually checked whether the suggested solution was correct or not.