I Ran A 27B Model On A Hand-Sized PCโฆ Didn't Expect This
From Alex Ziskind ยท ยท 19 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
I Ran a 27B Model on This Tiny PC. I Was Fixing the Wrong Thing. ๐น Try out ChatLLM - http://chatllm.abacus.ai/ltf and Abacus AI DeepAgent - http://deepagent.abacus.ai/ltf
๐ป Run Windows on a Mac: https://prf.hn/click/camref:1100libNI (affiliate) Use COUPON: ZISKIND10
๐ Gear Links ๐ ๐งโก The Khadas Mind Pro plus dock deal: https://link.amazon/B04w9tltf ๐ ๏ธ๐ The little dock: https://link.amazon/B0g6vWx6K โก Thunderbolt 5 cable: https://amzn.to/40u9M3b ๐ฅ๏ธ Thunderbolt 5 dock: https://amzn.to/4fsyN35 ๐งโก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW ๐ ๏ธ๐ My NVMe SSD: https://amzn.to/3YLEySo ๐ฆ๐ฎ My gear: https://www.amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ ๐ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M ๐ How long can they last? | ULTIMATE BATTERY TEST - https://youtu.be/u1XJAOf_W5w ๐ป 83 M3 MacBook Pros, and the one for YOU - https://youtu.be/ZPd2v3dteUc ๐จโ๐ป 15" MacBook Air | developer's dream - https://youtu.be/A1IOZUCTOkM ๐ค INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
๐ ๏ธ Developer Productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
๐ฑ LET'S CONNECT ON SOCIAL MEDIA ALEX ON TWITTER: https://twitter.com/digitalix
โ โ โ โ โ โ โ โ โ
โฑ๏ธ Chapters 00:00 Tiny PC 02:08 Integrated Graphics 06:58 GPU Upgrade 09:55 Model Optimization 12:47 Connection Bandwidth 14:24 Testing Pitfalls
#๏ธโฃ #softwaredevelopment #macbook #llm