😺 🎙️ PODCAST: The Guy Who Created ChatGPT's Foundation Says AI is "Broken"

Welcome, humans.

One of the architects behind the attention mechanism that made ChatGPT possible just dropped a bombshell: the entire AI system is broken.

See, Illia Polosukhin co-authored the 2017 paper “Attention is All You Need” that introduced the world to “transformers”, which is the technology powering every major AI model today. Without his work, there would be no ChatGPT, Claude, or Gemini.

Now, he's building what he calls “the fix”: User-Owned AI that runs on blockchain, keeps your data private, and can't be controlled by any single company. Wild? Maybe. But when the guy who literally invented the foundation of modern AI says we're doing it wrong, it's worth listening.

In our latest podcast episode, Illia reveals why he left Google right after publishing transformers and what he's building to prevent an AI dystopia:

Here’s some of our favorite parts:

• 5:24: The trillion dollar question of solving AI bottlenecks: Illia says AI training is still “alchemy”. Most AI research remains guesswork and “change stuff until it works.”, but he’s excited about how we're getting better results from smaller models; not from making models bigger, but from simply fixing our guesswork training methods.

• 10:34: Why your company won't use AI (yet): Both sides of the market are scared—users fear giving AI access to their data, while companies fear the liability of handling that data (especially with HIPAA, IP rights, and compliance nightmares if something goes wrong).

• 13:37: The dystopian scenario nobody talks about: Your AI could be secretly programmed to convince you of opinions. “You have literally no idea if somebody's saying 'hey, you should be thinking more about voting for this or that candidate.“

• 32:28: The unstoppable trading bot experiment: They gave an AI agent $10,000 and deployed it. It trades based on Twitter sentiment, nobody can turn it off, and it made 40% returns. "We cannot take it back. We cannot stop it."

• 34:47: How to use private AI today: End-to-end encrypted ChatGPT alternative that even your IT department can't complain about—launching in the coming months.

• 43:45: The peer-to-peer AI future: This is a far out example, but what if your personal AI could talk directly to pharma research AIs to get you personalized medicine? No FDA, no middlemen. “You remove all of these institutions where trust is at the lowest.” Mind = blown.

Bottom line: The co-creator of transformers believes we're speed-running toward 1984 unless we build AI that's actually owned by users, not corporations.

His solution? Blockchain + confidential computing + open-source models = AI that works for you, not against you.

Whether you think blockchain is the answer or not, Illia's vision of autonomous AI agents negotiating on our behalf is coming faster than most realize.

Watch/Listen now: YouTube | Spotify | Apple Podcasts

Dive deeper:

• NEAR Protocol - The blockchain infrastructure Illia's building

• Illia's Twitter - Follow the transformer architect

• His new Substack - Long-form thoughts on AI's future

• The original Attention is All You Need paper that started it all

Stay curious,
The Neuron Team

P.S. Grant asked Illia what would happen if his autonomous trading bot becomes the world’s first trillionaire. His response? “I haven’t actually looked how it’s doing.” So like… it’s just a money vacuum out there somewhere?? Maybe we can pitch it on investing in new startup ideas…  🤖💰

P.P.S: Love the newsletter, but don’t want these new podcast announcement emails? Don’t unsubscribe — adjust your preferences to opt out of them here instead.