Skip to main content
AmigoFish

1003: Building an AI Data Center End to End, with Lightning AI’s Frank Basso

From Super Data Science: ML & AI Podcast with Jon Krohn · · 1 hr 12 min

This plays from the publisher's own server. We do not host a copy.

Open at the source

Not rated yet

Description

Frank Basso, VP of Infrastructure at Lightning AI, joins Jon Krohn for a rare ground-level tour of the one layer of the AI stack the show had never covered in over a thousand episodes: the physical data center. Frank explains how Lightning AI provisions its 35,000-plus GPUs through hyperscale co-location, why everything new is liquid-to-chip cooled, how GPUs talk to each other over ultra-fast east-west networks, and what it’s actually like to stand inside a 110-decibel AI data hall. He also debunks the most persistent myths about data-center water and electricity use, and makes the case for fuel cells, nuclear power, and 800-volt DC distribution as the path forward.

Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.superdatascience.com/1003⁠ (https://www.superdatascience.com/1003)⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.

In this episode you will learn:

-

- (02:47) What actually makes an AI data center different from a traditional one

-

- (06:04) How Lightning AI provisions its 35,000+ GPUs through hyperscale co-location

-

- (24:01) Why liquid cooling doesn’t waste water, debunking the biggest data-center myth

-

- (29:46) East-west vs. north-south networks, explained

-

- (43:47) “Screaming banshees”: why AI data halls run at 105–110 decibels

-

- (51:52) Why data centers don’t actually drive up your power bill

Back to Super Data Science: ML & AI Podcast with Jon Krohn · Report a problem