Skip to main content
AmigoFish

A Closer Look At Kimi K3's INSANE Architecture Breakthrough

From bycloud · · 17 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Need high quality cloud GPUs? Check out Verda now, and use the code BYCLOUD-50 to get $50 of compute credits for just $5! https://verda.com/?utm_source=bycloud&utm_medium=referral&utm_campaign=sponsorship&utm_content=kimi

The 6 months gap between open source and closed source might not exist now. Moonshot AI's latest Kimi K3 just topped the LLM leaderboard, coming in as the 3rd best model in the world, while being open weights. In this video, I will be breaking down how they have achieve this insane feat.

my latest project: Intuitive AI Academy We just wrote a new piece on Optimization!! https://intuitiveai.academy/ limited time code "LOCKIN" for 35% off yearly plan

My Newsletter (weekly top research papers) https://mail.bycloud.ai/

My Patreon https://www.patreon.com/c/bycloud

Kimi K3 Technical Report [Paper] https://www.alphaxiv.org/abs/2607.24653

MoonEP [GitHub] https://github.com/moonshotAI/moonep

Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI

This video is supported by the kind Patrons & YouTube Members: 🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, ZyanSheep, THEVIERAOS, Ricardo Raphael Corona-Moreno, superchordate

[Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Business Inquiries] bycloud@smoothmedia.co [Other Inquiries] bycloudai@gmail.com [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] @Booga04 Manim Animations created by https://x.com/miyashita_03 [Ko-fi] https://ko-fi.com/bycloudai

Back to bycloud · Report a problem