Skip to main content
AmigoFish

Scaling Agent Workloads at Vercel

From Software Engineering Daily · · 51 min

This plays from the publisher's own server. We do not host a copy.

Open at the source

Not rated yet

Description

Most AI agent setups today are built around a single session, where one user interacts with one agent at a time. However, that model breaks down when an agent has to serve a business, where thousands of requests can arrive at once and each session needs to be isolated, durable, and recoverable. Getting agents to run reliably at that scale has meant a lot of hand-rolled infrastructure beneath the agent itself.

eve (https://eve.dev/) is an open source, cloud-native agent framework from Vercel (https://vercel.com/) that removes much of the agent scaling burden. In the eve framework, an agent is defined declaratively through configuration files and these files compile into infrastructure as code so the platform provisions only what the agent actually uses.

Andrew Barba (https://x.com/andrew_barba) is a Member of Technical Staff at Vercel, and Shar Dara (https://x.com/shardara)is the Product Lead for eve at Vercel. In this episode, they join Kevin Ball to discuss what it means for an agent framework to be cloud-native, why they chose to express agents in plain English, and their view that company building is becoming agent building.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

The post Scaling Agent Workloads at Vercel (https://softwareengineeringdaily.com/podcasts/scaling-agent-workloads-at-vercel/) appeared first on Software Engineering Daily (https://softwareengineeringdaily.com).

Back to Software Engineering Daily · Report a problem