Llama Cpp Flags That Instantly Speed It Up
From Alex Ziskind ยท ยท 2 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Stop wasting your hardwareโhere is how to 2x or 3x your local LLM performance
๐ Gear Links ๐
๐ช๐ชHighly rated precision driver kit: https://amzn.to/4fkMVfg ๐ปโ Favorite 15" display with magnet: https://amzn.to/3zD1DhQ ๐งโก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW ๐ ๏ธ๐ My nvme ssd: https://amzn.to/3YLEySo ๐ฆ๐ฎ My gear: https://www.amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
๐งณ๐งฐ Mini PC portable setup - https://youtu.be/4RYmsrarOSw ๐๐ป Dev setup on Mac - https://youtu.be/KiKUN4i1SeU ๐ธ๐ง Cheap mini runs a 70B LLM ๐คฏ - https://youtu.be/xyKEQjUzfAk ๐งช๐ฅ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M ๐โก FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo ๐ง ๐ REALITY vs Appleโs Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A ๐งฌ๐ Set up Conda - https://youtu.be/2Acht_5_HTo โก๐ฅ Thunderbolt 5 BREAKS Appleโs Upcharge - https://youtu.be/nHqrvxcRc7o ๐ง ๐ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k ๐งฑ๐ฅ๏ธ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho
* ๐ ๏ธ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX ๐ AI for Coding Playlist: ๐ - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
draftbench GitHub Repo: https://github.com/alexziskind1/draftbench
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
โ โ โ โ โ โ โ โ โ ๐ฑ ALEX on X: https://x.com/digitalix
#macstudio #llm #claudecode