Bubble or No Bubble, AI Keeps Progressing (ft. Relentless Learning + Introspection)
From AI Explained Official Podcast · · 12 min
This plays from the publisher's own server. We do not host a copy.
Description
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly).
https://app.grayswan.ai/ai-explained
This, plus models introspecting (hesitate before you berate), Nano Banana 2 possibly spotted, Chinese imagen and more.
AI Insiders ($9!): https://www.patreon.com/AIExplained
Chapters: 00:00 - Introduction 01:26 - Continual Learning (Nested Learning / HOPE) 07:00 - Introspection 10:54 - Image-Gen Progress
Nested Learning Post: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/
Nested Learning Paper: https://abehrouz.github.io/files/NL.pdf
Original Titans Paper: https://arxiv.org/pdf/2501.00663
Introspection: https://www.anthropic.com/research/introspection
Full Paper: https://transformer-circuits.pub/2025/introspection/index.html#mechanisms
Earlier Work: https://www.anthropic.com/research/mapping-mind-language-model https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html
Release Post: https://x.com/AnthropicAI/status/1983584136972677319
Non-hype Newsletter: https://signaltonoise.beehiiv.com/