Yann LeCun on AMI Labs, JEPA, and the AI World of 2030(nebius.science) |
Yann LeCun on AMI Labs, JEPA, and the AI World of 2030(nebius.science) |
From the interview, I see he still harps on about the limitations of LLMs and harps on about real world AI. I just can't take him seriously because pretty much everything he says is wrong and hypothetical. He still can't point to a single thing that an LLM fails at that require his so called "world models"
He'll just throw some random stuff out there like "we're not at level 5 driving yet" despite having hundreds of millions of miles driven autonomously every day. He just seems to keep holding on to his beliefs (much of them economic) and refuses to adjust his priors.
Those are two very different things; you know that, right? You could even drive billions of miles, but that doesn't mean we have attained Level 5.
Level 5 definition: https://www.zf.com/products/en/cars/stories/6_levels_of_auto...
> The vehicle can drive anywhere in road traffic and under all conditions without human beings.
I can't drive anywhere in road traffic under all conditions so I guess i'm not level 5? What piece of technology doesn't ever fail or require some kind of human intervention. I don't even think I trust my toaster when I'm out of the room.
Self driving is very much here. Sometimes it fails, because it's technology. The reason steering wheels exist is due to regulations. There are some Chinese cars like Apollo RT6 with a detachable steering wheel
I don't think JEPA is necessarily the solution (although I'm bullish on world models), but I don't understand why people feel so infuriated about LeCun. The reason he is famous today is because he spent years taking a contrarian stance, working on neural networks when they were seen as dead and buried. He was eventually proven right. Nowadays he holds strong views which contradict the LLM zeitgeist --- what's shocking about that?
No one has been more wrong and for longer about anything than Yann on LLMs.