Skip to main content
AmigoFish

Modal CEO: Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute

From 20VC with Harry Stebbings · · 1 hr 2 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik built Spotify's original music recommendation system.

-----------------------------------------------

Timestamps: 00:00 Intro 01:42 How Erik Fell in Love With Coding at Eight Years Old 03:43 Why Erik Rejects the “Eating Glass” Founder Narrative 05:32 Why Erik Hates Fundraising 05:56 Why Erik Has Never Made a Pitch Deck 06:25 Why Founders Shouldn’t Always Maximise Valuation 08:03 Why Early-Stage Startups Don’t Really Have Moats 08:52 Why Brand Matters More Than Ever in AI Infrastructure 11:43 Why Inference Is Becoming the New Cloud 12:32 Why Pure Inference Becomes a Commodity Business 13:25 Where the Gross Margins in Inference Will Come From 15:00 Why the Inference Market Will Fragment Into Specialized Products 16:33 Inside the “Open-Air Drug Market” for GPUs 17:30 Why Modal Wants to Aggregate the World’s Compute 19:05 How Modal Forecasts GPU Demand Growing 34% Month-on-Month 20:31 What Happens to GPU Prices Over Time? 21:14 Why AI Compute Demand Is Still Extremely Early 22:43 Does Specialized AI Hardware Threaten Nvidia? 23:41 Why CUDA Is Not Nvidia’s Real Moat 24:38 Can Neo-Clouds Successfully Move Up the Stack Into Inference? 26:47 What Happens to Open Models as Frontier Models Get Cheaper? 28:01 Can Europe Produce a Competitive Open Model? 28:39 Why Nvidia Is Backing the US Open-Model Ecosystem 29:52 Why Specialized Models Can Become Huge Businesses 30:25 The Bull Case for Jev at $100BN 32:57 How Modal Plans to Expand From a Product Into a Platform 34:41 How Modal’s Sandbox Business Reached a $300M Run Rate 35:46 Why Infrastructure Products Can Take Years to Find Their Killer Use Case 37:41 Why Modal Underinvested in Open-Model Inference 38:19 Has Open-Model Inference Already Peaked? 39:11 Modal Hits a $1BN Revenue Run Rate 39:38 How Big Can Modal Be in 12 Months? 40:55 Modal’s Next Big Revenue Opportunities 42:28 How Important Will Post-Training Become? 44:13 Why AI Agents Won’t Kill Software Engineers 45:26 Modal Spends ~$500K Per Month on Coding Agents 46:06 Will Coding-Agent Spend Keep Growing as Models Get Cheaper? 47:11 Why AI Training Data Is Such a Lucrative Market Today 48:46 Should Every Company Own Its Own Intelligence? 51:24 Is Model Routing a Defensible Business? 52:40 Why Erik Would Have Told OpenRouter Not to Sell 53:45 Why Erik Expects a 20–30% AI Market Pullback 54:18 Why Employee Secondaries Matter in the AI Talent War 55:25 Why Top AI Labs Are Paying Exceptional New Grads $20M+ 57:10 Why Erik Would Back TurboPuffer 57:39 What Erik Changed His Mind on About the Sandbox Market 58:04 Which AI Companies Erik Would Avoid Investing In 1:01:07 Why AI Drug Discovery Excites Erik Most

----------------------------------------------------------------------------------------------

Subscribe on Spotify: https://open.spotify.com/show/3j2KMcZTtgTNBKwtZBMHvl?si=85bc9196860e4466

Subscribe on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-twenty-minute-vc-20vc-venture-capital-startup/id958230465

Follow Harry Stebbings on X: https://twitter.com/HarryStebbings

Follow Erik Bernhardsson on X: https://twitter.com/bernhardsson

Follow 20VC on Instagram: https://www.instagram.com/20vchq

Follow 20VC on TikTok: https://www.tiktok.com/@20vc_tok

Visit our Website: https://www.20vc.com

Subscribe to our Newsletter: https://www.thetwentyminutevc.com/contact

-----------------------------------------------

#20vc #harrystebbings #erikbernhardsson #ceo #modal #ai #opensource #inference

Back to 20VC with Harry Stebbings · Report a problem