Jeff Dean leaving Alphabet(nytimes.com) |
Jeff Dean leaving Alphabet(nytimes.com) |
1. https://www.lesswrong.com/posts/iKm2FhpWkuuBojm82/why-i-left...
At least it makes me feel like he reaching out might have made a difference on remembering this people killer robots are bad, and being part of it might not be on the best of their interests to go down on history for
2024: Google is on fire. Sergey coming back helped. Gemini, Veo. They've caught up. OpenAI is doomed.
2025: Google is seriously winning now. Nano Banana!! Google was destined to be the true winner of AI.
2026 H1: Google is slow as hell. Where is Gemini? Google is not launching anything, meanwhile just look at everyone else. Anthropic! And open source. What the hell are they doing over there?
2026 H2: Everyone is leaving Google. Google is doomed. PMs are destroying the company. They don't take risks.
Meanwhile, Microsoft: "Copilot!"
That said, I hope they write cool papers with various peers across the industry without worrying too much about the competing dynamics. That'd be a blessing for humanity, and good for their spirit.
Very silly to call every non start up a lifestyle business. It’s just a business. Start up are the weird thing that almost always an obscene waste of time and money, but sometime creates google.
The advantage to a PBC is to protecting founders from a serious problem with standard corporations: you might bring on investors who could subsequently demand you to pollute, exploit people, and do other immoral activities for profit.
Why is that so? Fast growth, when achieved honestly, is a result of solving user pain that others haven't. Maybe you think so because users != the public, but I think in totality the public is a collection of users who all have needs they want met.
They're also incredibly productive and can build/deliver really good stuff, so who knows :)
Sometimes I couldn't resist wondering if I'll ever do work that has a tenth of the impact of theirs.
Google's advanced AI cannot even exit a mobile app.
I had not read this before, but told many students the same about my PIN code and I a quiz about the last digits. Love it.
The four have so much influence within the company that they could have trivially set this up as part of Alphabet, if they wanted to. They are also ridiculously wealthy.
What's happening?!
Have they had enough of Google?
I feel the most exciting development these days is self-evolving agents. Especially if you have a way to verify their outputs with a formal system, or with a system developed since the 60s by armies of PhDs.
DeepMinds Gnome is a good example, where they use DFT to verify outputs. Approximating NP-problems is always fun for those who dare.
I am also building in this space. Its a mix between HPC, AI, and hard science. Pretty fun compared to waking everyday to LLM news that seem more like marketing stunts.
They are straddling the line between pushing it forward, and justifying the business case. It's hard to do both at the same time.
If throwing more money at inference while accumulating compounding technical debt is the new norm, then we are not solving the problem, and the solution space is already covered.
Perhaps there are marginal gains at the expense of quadrillion-params LLM models with 10x the cost and energy. We are simply making inefficiency more expensive, camouflaged by VC money and great marketing.
If that is not plateauing, then I guess I will have to reconsider what plateauing means.
https://www.lesswrong.com/posts/iKm2FhpWkuuBojm82/why-i-left...
[1] https://hr.ucmerced.edu/hr-units/talent-acquisition/senate-b...
[2] https://www.adp.com/spark/articles/2023/03/pay-transparency-...
https://www.ycombinator.com/library/Vy-jeff-dean-the-1-rule-...
The next chapter of our AI momentum
I doubt numbering vs names on TPU releases even crosses Jeff's radar. It's not the kind of thing he cares about.
Discovery Loop
Here are some Jeff Dean well sourced facts:
- Already part of engineering of Google indexing systems that lacked basic checksums and ran on non-ECC hardware, allowing silent data corruption.
- One of the authors of LevelDB a database with so many documented crash-consistency, recovery, and data-loss weaknesses for years. Just check their Github project. LevelDB current tracker contains unresolved crash consistency, recovery and corruption reports going back almost 12 years on GitHub
- In AI engineering technical lead, let TensorFlow lose researcher mind share to PyTorch, and caused Google fragmented landscape across TensorFlow and JAX.
- Had the people at Google who invented the Transformer architecture, but failed, to turn that lead into the first dominant public LLM.
- As AI engineering and VP management let Google Brain and DeepMind remain duplicated and internally competitive for too long.
- Let Noam Shazeer leave and then spent heavily to bring him back with nothing to show for.
- Part of Technical VP leadership who had Bard rushed to launch with factual errors in Google own promotional material.
- The first Gemini demonstration overstated how real-time and interactive the system actually was, being basically a fake.
- Part of the VP and AI technical leadership who had Google AI Overviews launched with weak source quality controls and repeated satire and low-quality web content as factual advice.
- Part of teams that launched AlphaChip performance claims that were difficult for outside researchers to reproduce and remain technically disputed.
- Jeff Dean public explanation of Gebru departure was contested and damaged confidence in Google scientific governance.
- Jeff Dean was part of the team at Google that removed or marginalized prominent internal AI ethics critics shortly before many of their warnings became product problems.
- Jeff Dean was one of the managers behind Project Dragonfly supporting censorship.
- Jeff Dean is part of the VP technical leadership approving Project Nimbus supporting an ongoing genocide.
Why? Because investors poured a bunch of money in to support fast growth and now they want their money back. And incremental growth won't do. Since 9 out of 10 of the investments fail, the surviving one has to continue to growth-hacking revenues.
This is such unbelievable revisionism! Can you imagine in 2022 saying "Oh of course you can brute force your way to AGI if you spend enough money per month". Nobody thought that! Come on!