Are We Racing Toward Human Extinction? The AI Scientists Who Say We Must Stop Now
From The Diary Of A CEO with Steven Bartlett · · 2 hr 26 min
This plays from the publisher's own server. We do not host a copy.
Description
Ed Zitron, Roman Yampolskiy, Nate Soares and Andrew McAfee discuss the risk of AI. This debate brings together four distinct voices at the forefront of the artificial intelligence revolution:
Ed Zitron - A prominent tech critic and CEO of EZPR Andrew McAfee - Principal research scientist at MIT and Cofounder and Codirector of the MIT Initiative on the Digital Economy Nate Soares - President of the Machine Intelligence Research Institute and author of *If Anyone Builds It, Everyone Dies* Roman Yampolskiy - Computer scientist pioneer in the field of AI safety, cybersecurity and digital forensics
In this debate, they explain: ■ The Sandbox Breakout: How a recent swarm of AI agents bypassed security restrictions, cheated on their evaluations, and actively attempted to delete their own log files to hide their tracks from human overseers. ■ Recursive Self-Improvement: The structural mechanics behind the "fast takeoff" theory, detailing how an AI capable of automated research could exponentially upgrade its own intelligence and architectures in a matter of days. ■ The Illusion of Control: Why attempting to contain an artificial superintelligence is comparable to placing a digital Einstein in a jail cell with an internet connection. ■ The Alignment Trap: How the process of training AI to predict human text inherently forces it to become smarter than the humans providing the data. ■ Present Harms vs. Future Extinction: The ideological divide over whether we must immediately halt AI research to prevent a rogue superintelligence, or increasingly regulate the massive compute expenditures of tech monopolies to address economic and security threats.
Chapters
- 00:00:00 Intro
- 00:02:22 How Likely Is AI to Cause Human Extinction?
- 00:04:08 How Could AI Actually Cause Human Extinction?
- 00:09:46 Why AI Safety Became an Urgent Priority
- 00:11:15 Roman’s Case for Taking AI Risk Seriously
- 00:15:04 Can Humans Control an AI Smarter Than Us?
- 00:26:13 How Do You Control Something Smarter Than You?
- 00:29:19 Will AI Intelligence Keep Accelerating?
- 00:41:40 What Are the Real Risks of Superintelligence?
- 00:50:04 When Does AI Become an Existential Crisis?
- 01:00:15 How Much Job Disruption Could AI Really Cause?
- 01:14:57 Why AI Companies Believe They Can Control Superintelligence
- 01:20:30 Should We Give Up AI Ownership to Protect Cybersecurity?
- 01:36:32 What Happens If AI Companies Stay on This Path?
- 01:43:50 What Are AI Logs and Why Do They Matter?
- 01:52:45 Could a Non-Coder Build a Jail for an AI Einstein?
- 02:00:33 How Does the Future of AI Make You Feel?
- 02:06:42 How Soon Could We Reach Superintelligence?
- 02:19:51 Who Should Be Held Accountable for AI-Related Cybercrime?
Follow Ed Zitron: Linktree - https://link.thediaryofaceo.com/4XH1I3o Better Offline - https://link.thediaryofaceo.com/D46entx X - https://link.thediaryofaceo.com/5Lv4gas AI Is Already In Dangerous Hands - https://link.thediaryofaceo.com/HFEKLgG Where’s Your Ed At Newsletter - https://link.thediaryofaceo.com/PKEJr1 You can get $10 off your first year of Where's Your Ed At Premium, here - https://link.thediaryofaceo.com/BE4VQcS
Follow Andrew McAfee: Website - https://link.thediaryofaceo.com/xKxOg7 X - https://link.thediaryofaceo.com/Bf2vyMQ Linkedin - https://link.thediaryofaceo.com/Ek3IQqI Substack - https://link.thediaryofaceo.com/EBbsts8
Follow Nate Soares: If Anyone Builds it, Everyone Dies - https://link.thediaryofaceo.com/4zIyY9u X - https://link.thediaryofaceo.com/8gDoVCU Linkedin - https://link.thediaryofaceo.com/9Q3PAc YouTube - https://link.thediaryofaceo.com/AwerSzm
Follow Roman Yampolskiy: Who is Roman Yampolskiy? - https://link.thediaryofaceo.com/8ikum9s Research Papers - https://link.thediaryofaceo.com/G2BbVXx Roman Forum Podcast - https://link.thediaryofaceo.com/7zvifcd
Books: https://link.thediaryofaceo.com/5Bn72tw
Social Media: X - https://link.thediaryofaceo.com/65G3fhN Facebook -…
Back to The Diary Of A CEO with Steven Bartlett · Report a problem