Skip to main content
AmigoFish

Running a 120B model offline on Surface RTX Spark Dev Box with Intelligent Terminal

From Microsoft Developer · · 8 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

See what's possible with Intelligent Terminal running a local model on Surface Laptop Ultra. A 120b parameter local models runs entirely locally on the laptop's NVIDIA RTX Spark N1X with 128 GB of unified memory. See how these powerful new devices can complete complex flows such as writing new agent skills with context all without going to the cloud.

Learn more about Surface Laptop Ultra: Surface Laptop Ultra: https://www.microsoft.com/en-us/surface/devices/surface-laptop-ultra

and

Surface RTX Spark Dev Box: Surface RTX Spark Dev Box: https://www.microsoft.com/en-us/surface/devices/surface-rtx-spark-dev-box

Get Intelligent Terminal on GitHub: https://github.com/microsoft/intelligent-terminal or the Microsoft Store: https://apps.microsoft.com/detail/9nmqc2ssjx24

Back to Microsoft Developer · Report a problem