Skip to main content
AmigoFish

What Is torch.compile? Dynamo, PyTorch & Faster AI Models Explained

From IBM Technology · · 6 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Learn more about Faster AI Models here → https://ibm.biz/~9RJjTpaDF

One line can change how your AI model runs. Avery Blanchard explains how torch.compile, Dynamo, AOT Autograd, and Inductor optimize PyTorch models. Learn how graph breaks, recompilation, and kernel fusion affect AI performance.

00:00 – See What torch.compile Does to PyTorch Models 00:20 – Understand the Three torch.compile Stages 01:09 – See How PyTorch Starts Lazy Compilation 01:44 – Capture AI Model Operations with Dynamo 02:42 – Prepare PyTorch Graphs with AOT Autograd 03:32 – Generate Optimized Code with Inductor 04:35 – Understand Graph Breaks in torch.compile 05:21 – Avoid Recompilation & Benchmark Correctly 05:53 – Connect Dynamo, AOT Autograd & Inductor 06:10 – Diagnose Why torch.compile Isn't Faster

Continue your education in the course Compilation for Dataflow on Coursera here → ibm.biz/~E46ZY0koj

AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/~j9Ety2SXE

AI was used in the creation of the transcript and metadata for this video.

#pytorch #aimodels #machinelearning #aiengineering --------------------------------------------------------------------------------------------------------- Find us on YouTube: 🔵 IBM Technology: https://www.youtube.com/@IBMTechnology 🔵 IBM: https://www.youtube.com/@IBM 🔵 IBM Developer: https://youtube.com/@IBMDeveloperAdvocates

Back to IBM Technology · Report a problem