In search of frontier AI at home
From sentdex · · 36 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Analyzing a handful of local models that fit within a specific GPU memory ceiling, looking to learn how much compression impacts performance, how differently compressed models @ similar size compare, and how kv cache impacts attention in some cases.
Benchmarks writeup: https://hkinsley.com/reflections/in-search-of-the-frontier-at-home DeepSeek V4 Flash: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash RTX Pro 6K discord: https://discord.gg/gzpPGAAwDj
Neural Networks from Scratch book: https://nnfs.io Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://discord.gg/sentdex Reddit: https://www.reddit.com/r/sentdex/ Support the content: https://pythonprogramming.net/support-donate/ Twitter: https://twitter.com/sentdex Instagram: https://instagram.com/sentdex Facebook: https://www.facebook.com/pythonprogramming.net/ Twitch: https://www.twitch.tv/sentdex