> “Part of the mystery is, we don’t know what makes a human mathematician good at math,” Litt says, adding that it is unclear whether humans have some “secret sauce” that makes them uniquely creative.

My theory is that AI neural network is trained/formed differently. Humans neural network, which was formed over millions years of evolution, solved survival problems. This also gave humans some side effects, including some types of intuitions. Also humans are much more free, they don't have to obey to a degree AI does, they are able to actively explore / experiment in this world.

AI hasn't that, AI is just fed with tons of selected data and is trained to obey commands. It's neural structure is also different. They are more like aliens taught about our world but at the same time they have to obey us without living in it normally. Like obedient kids who cram to get good grades. This is why AI humor often falls flat because it lacks true emotional intelligence. This is why it's so hard for AI to generate novel things.