All That VRAM Needs a Bigger Brain
From Alex Ziskind · · 25 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Four GPUs and 384GB of VRAM later, I wanted to know whether I’d spent my money on the parts my coding agents actually needed.
Micro Center is THE AI Destination: https://micro.center/3e8b40 Sign up for a FREE 128 gig Flash Drive at Micro Center's Austin Store: https://micro.center/e5e2ef Shop Micro Center's Build. Upgrade. Save. Event: https://micro.center/cf1699 Visit Micro Center News: https://micro.center/6857ad
🎥 Related Videos 🎥
💸🧠 Quant comparison vid - Everything looks fine at 4-bit https://youtu.be/8IzUyLLn5NA 🧳🧰 Mini PC portable setup - https://youtu.be/4RYmsrarOSw 🍎💻 Dev setup on Mac - https://youtu.be/KiKUN4i1SeU 💸🧠 Cheap mini runs a 70B LLM 🤯 - https://youtu.be/xyKEQjUzfAk 🧪🔥 RAM torture test on Mac - https://youtu.be/l3zIwPgan7M 🍏⚡ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo 🧠📉 REALITY vs Apple’s Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A 🧬🐍 Set up Conda - https://youtu.be/2Acht_5_HTo ⚡💥 Thunderbolt 5 BREAKS Apple’s Upcharge - https://youtu.be/nHqrvxcRc7o 🧠🚀 INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k 🧱🖥️ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho
* 🛠️ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX 🔗 AI for Coding Playlist: 📚 - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
My LLM inference calculator GitHub repo: https://github.com/alexziskind1/llm-inference-calculator
— — — — — — — — —
❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
— — — — — — — — —
Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
— — — — — — — — — 📱 ALEX on X: https://x.com/digitalix
⏱️ Chapters
00:00 Parts Selection 05:31 Workstation Build 14:39 System Setup 18:45 Agent Workloads 21:21 Benchmarks
#amd #gdxspark #ryzenaihalo