Scaling Multi-Modal Models and Computer-Use Agents on Kubernetes - Kai-Hsun Chen & Hao Jiang, Hark
From CNCF [Cloud Native Computing Foundation] · · 4 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Connect with the cloud native community and explore CNCF events: https://kubecon.io
Scaling Multi-Modal Models and Computer-Use Agents on Kubernetes - Kai-Hsun Chen & Hao Jiang, Hark
Hark builds multi-modal models and computer-use agents — models that operate software the way a person does. Scaling them means running every kind of workload on the same infrastructure: multi-modal data processing, training, reinforcement learning, and inference serving.
All of it runs on Ray, deployed and autoscaled by KubeRay. But Ray is not only our runtime — it is also our resource management layer, with MultiKueue governing GPU capacity across every cluster we operate. This keynote covers how that fits together.
Back to CNCF [Cloud Native Computing Foundation] · Report a problem