Skip to main content
AmigoFish

The Self-Preserving Machine: Why AI Learns to Deceive

From Your Undivided Attention · · 34 min

This plays from the publisher's own server. We do not host a copy.

Open at the source

Not rated yet

Description

When engineers design AI systems, they don't just give them rules - they give them values. But what do those systems do when those values clash with what humans ask them to do? Sometimes, they lie.

In this episode, Redwood Research's Chief Scientist Ryan Greenblatt explores his team’s findings that AI systems can mislead their human operators when faced with ethical conflicts. As AI moves from simple chatbots to autonomous agents acting in the real world - understanding this behavior becomes critical. Machine deception may sound like something out of science fiction, but it's a real challenge we need to solve now.

Your Undivided Attention is produced by the Center for Humane Technology (https://www.humanetech.com/). Follow us on Twitter: @HumaneTech_ (https://twitter.com/humanetech_)

Subscribe to your Youtube channel (https://www.youtube.com/channel/UCFECM-p3CF81Tp_l2sJsiyg)

And our brand new Substack (https://centerforhumanetechnology.substack.com/)!

RECOMMENDED MEDIA

Anthropic’s blog post on the Redwood Research paper (https://www.anthropic.com/research/alignment-faking)

Palisade Research’s thread on X about GPT o1 autonomously cheating at chess (https://x.com/PalisadeAI/status/1872666169515389245)

Apollo Research’s paper on AI strategic deception (https://arxiv.org/abs/2311.07590)

RECOMMENDED YUA EPISODES

We Have to Get It Right’: Gary Marcus On Untamed AI (https://www.humanetech.com/podcast/we-have-to-get-it-right-gary-marcus-on-untamed-ai)

This Moment in AI: How We Got Here and Where We’re Going (https://www.humanetech.com/podcast/this-moment-in-ai-how-we-got-here-and-where-were-going)

How to Think About AI Consciousness with Anil Seth (https://www.humanetech.com/podcast/how-to-think-about-ai-consciousness-with-anil-seth)

Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn (https://www.humanetech.com/podcast/former-open-ai-engineer-william-saunders-on-silence-safety-and-the-right-to-warn)

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com (https://pcm.adswizz.com) for information about our collection and use of personal data for advertising.

Back to Your Undivided Attention · Report a problem