Skip to main content
AmigoFish

Support new AI models on day zero with vLLM

From Red Hat · · 1 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

The most important enterprise infrastructure has always been open source, and AI inference is no exception. Red Hat CTO for AI Brian Stevens explains how vLLM provides day-zero model support and open collaboration across accelerators! #vLLM #RedHat #OpenSource #AIInference #EnterpriseAI

➡️ See how open source gives you full control over model scaling: https://red.ht/future-of-inference

Back to Red Hat · Report a problem