Modal CEO: Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute
From 20VC with Harry Stebbings · · 1 hr 2 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik built Spotify's original music recommendation system.
-----------------------------------------------
Timestamps: 00:00 Intro 01:42 How Erik Fell in Love With Coding at Eight Years Old 03:43 Why Erik Rejects the “Eating Glass” Founder Narrative 05:32 Why Erik Hates Fundraising 05:56 Why Erik Has Never Made a Pitch Deck 06:25 Why Founders Shouldn’t Always Maximise Valuation 08:03 Why Early-Stage Startups Don’t Really Have Moats 08:52 Why Brand Matters More Than Ever in AI Infrastructure 11:43 Why Inference Is Becoming the New Cloud 12:32 Why Pure Inference Becomes a Commodity Business 13:25 Where the Gross Margins in Inference Will Come From 15:00 Why the Inference Market Will Fragment Into Specialized Products 16:33 Inside the “Open-Air Drug Market” for GPUs 17:30 Why Modal Wants to Aggregate the World’s Compute 19:05 How Modal Forecasts GPU Demand Growing 34% Month-on-Month 20:31 What Happens to GPU Prices Over Time? 21:14 Why AI Compute Demand Is Still Extremely Early 22:43 Does Specialized AI Hardware Threaten Nvidia? 23:41 Why CUDA Is Not Nvidia’s Real Moat 24:38 Can Neo-Clouds Successfully Move Up the Stack Into Inference? 26:47 What Happens to Open Models as Frontier Models Get Cheaper? 28:01 Can Europe Produce a Competitive Open Model? 28:39 Why Nvidia Is Backing the US Open-Model Ecosystem 29:52 Why Specialized Models Can Become Huge Businesses 30:25 The Bull Case for Jev at $100BN 32:57 How Modal Plans to Expand From a Product Into a Platform 34:41 How Modal’s Sandbox Business Reached a $300M Run Rate 35:46 Why Infrastructure Products Can Take Years to Find Their Killer Use Case 37:41 Why Modal Underinvested in Open-Model Inference 38:19 Has Open-Model Inference Already Peaked? 39:11 Modal Hits a $1BN Revenue Run Rate 39:38 How Big Can Modal Be in 12 Months? 40:55 Modal’s Next Big Revenue Opportunities 42:28 How Important Will Post-Training Become? 44:13 Why AI Agents Won’t Kill Software Engineers 45:26 Modal Spends ~$500K Per Month on Coding Agents 46:06 Will Coding-Agent Spend Keep Growing as Models Get Cheaper? 47:11 Why AI Training Data Is Such a Lucrative Market Today 48:46 Should Every Company Own Its Own Intelligence? 51:24 Is Model Routing a Defensible Business? 52:40 Why Erik Would Have Told OpenRouter Not to Sell 53:45 Why Erik Expects a 20–30% AI Market Pullback 54:18 Why Employee Secondaries Matter in the AI Talent War 55:25 Why Top AI Labs Are Paying Exceptional New Grads $20M+ 57:10 Why Erik Would Back TurboPuffer 57:39 What Erik Changed His Mind on About the Sandbox Market 58:04 Which AI Companies Erik Would Avoid Investing In 1:01:07 Why AI Drug Discovery Excites Erik Most
----------------------------------------------------------------------------------------------
Subscribe on Spotify: https://open.spotify.com/show/3j2KMcZTtgTNBKwtZBMHvl?si=85bc9196860e4466
Subscribe on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-twenty-minute-vc-20vc-venture-capital-startup/id958230465
Follow Harry Stebbings on X: https://twitter.com/HarryStebbings
Follow Erik Bernhardsson on X: https://twitter.com/bernhardsson
Follow 20VC on Instagram: https://www.instagram.com/20vchq
Follow 20VC on TikTok: https://www.tiktok.com/@20vc_tok
Visit our Website: https://www.20vc.com
Subscribe to our Newsletter: https://www.thetwentyminutevc.com/contact
-----------------------------------------------
#20vc #harrystebbings #erikbernhardsson #ceo #modal #ai #opensource #inference