Running a 120B model offline on Surface RTX Spark Dev Box with Intelligent Terminal
From Microsoft Developer · · 8 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
See what's possible with Intelligent Terminal running a local model on Surface Laptop Ultra. A 120b parameter local models runs entirely locally on the laptop's NVIDIA RTX Spark N1X with 128 GB of unified memory. See how these powerful new devices can complete complex flows such as writing new agent skills with context all without going to the cloud.
Learn more about Surface Laptop Ultra: Surface Laptop Ultra: https://www.microsoft.com/en-us/surface/devices/surface-laptop-ultra
and
Surface RTX Spark Dev Box: Surface RTX Spark Dev Box: https://www.microsoft.com/en-us/surface/devices/surface-rtx-spark-dev-box
Get Intelligent Terminal on GitHub: https://github.com/microsoft/intelligent-terminal or the Microsoft Store: https://apps.microsoft.com/detail/9nmqc2ssjx24