Run AI Models with Docker - No Setup, No Headaches
From Techno Tim · · 17 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
What is Docker Model Runner and why should you care? Docker’s new Model Runner makes it easy to run and develop with AI models, no messy dependencies or complicated setup. In this video, I’ll walk you through everything from getting started in the CLI, using it with Docker Compose, and developing locally with my open-source Next.js app techno-boto-chat.
Big thanks to Docker for sponsoring this video
Try Docker Model Runner for free: https://dockr.ly/4nOGjdm Download Docker Desktop: https://dockr.ly/4nQHOYq
Video Notes: https://technotim.live/posts/docker-model-runner/
Merch Shop 🛍️: https://l.technotim.live/shop Support me on Patreon: https://www.patreon.com/technotim Sponsor me on GitHub: https://github.com/sponsors/timothystewart6 Subscribe on Twitch: https://www.twitch.tv/technotim Become a YouTube member: https://www.youtube.com/channel/UCOk-gHyjcWZNj3Br4oxwh0A/join Gear Recommendations: https://l.technotim.live/gear Get Help in Our Discord Community: https://l.technotim.live/discord 2nd channel: https://www.youtube.com/@Technically-Tim
(Affiliate links may be included in this description. I may receive a small commission at no cost to you.)
00:00 - Intro: Why Docker Model Runner? 01:15 - What Is Docker Model Runner? 02:05 - Getting Started (CLI Basics) 03:47 - Using Docker Model Runner with Compose 04:30 - OpenWebUI with Docker Model Runner 05:54 - Developing locally with my techno-boto-chat 08:15 - Starting and configuring the application 10:07 - Running the application with NodeJS 11:59 - Docker Model Runner logging and debugging 14:10 - Running techno-boto-chat with Docker Compose 16:31 - Outro & Final Thoughts
Thank you for watching!