Skip to main content
AmigoFish

All That VRAM Needs a Bigger Brain

From Alex Ziskind · · 25 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Four GPUs and 384GB of VRAM later, I wanted to know whether I’d spent my money on the parts my coding agents actually needed.

Micro Center is THE AI Destination: https://micro.center/3e8b40 Sign up for a FREE 128 gig Flash Drive at Micro Center's Austin Store: https://micro.center/e5e2ef Shop Micro Center's Build. Upgrade. Save. Event: https://micro.center/cf1699 Visit Micro Center News: https://micro.center/6857ad

🎥 Related Videos 🎥

💸🧠 Quant comparison vid - Everything looks fine at 4-bit https://youtu.be/8IzUyLLn5NA 🧳🧰 Mini PC portable setup - https://youtu.be/4RYmsrarOSw 🍎💻 Dev setup on Mac - https://youtu.be/KiKUN4i1SeU 💸🧠 Cheap mini runs a 70B LLM 🤯 - https://youtu.be/xyKEQjUzfAk 🧪🔥 RAM torture test on Mac - https://youtu.be/l3zIwPgan7M 🍏⚡ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo 🧠📉 REALITY vs Apple’s Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A 🧬🐍 Set up Conda - https://youtu.be/2Acht_5_HTo ⚡💥 Thunderbolt 5 BREAKS Apple’s Upcharge - https://youtu.be/nHqrvxcRc7o 🧠🚀 INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k 🧱🖥️ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho

* 🛠️ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX 🔗 AI for Coding Playlist: 📚 - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw

My LLM inference calculator GitHub repo: https://github.com/alexziskind1/llm-inference-calculator

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

— — — — — — — — —

Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

— — — — — — — — — 📱 ALEX on X: https://x.com/digitalix

⏱️ Chapters

00:00 Parts Selection 05:31 Workstation Build 14:39 System Setup 18:45 Agent Workloads 21:21 Benchmarks

#amd #gdxspark #ryzenaihalo

Back to Alex Ziskind · Report a problem