Bubble or No Bubble, AI Keeps Progressing (ft. Relentless Learning + Introspection)
From AI Explained · · 12 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly).
https://app.grayswan.ai/ai-explained
This, plus models introspecting (hesitate before you berate), Nano Banana 2 possibly spotted, Chinese imagen and more.
AI Insiders ($9!): https://www.patreon.com/AIExplained
Chapters: 00:00 - Introduction 01:26 - Continual Learning (Nested Learning / HOPE) 07:00 - Introspection 10:54 - Image-Gen Progress
Nested Learning Post: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/
Nested Learning Paper: https://abehrouz.github.io/files/NL.pdf
Original Titans Paper: https://arxiv.org/pdf/2501.00663
Introspection: https://www.anthropic.com/research/introspection
Full Paper: https://transformer-circuits.pub/2025/introspection/index.html#mechanisms
Earlier Work: https://www.anthropic.com/research/mapping-mind-language-model https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html
Release Post: https://x.com/AnthropicAI/status/1983584136972677319
Non-hype Newsletter: https://signaltonoise.beehiiv.com/