Skip to main content
AmigoFish

The Importance of Guardrails in AI

From Kunal Kushwaha · · 58 sec

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

AI agents are writing and shipping code. What stops one from doing something it was never asked to do?

I caught up with Gautam Korlam, co-founder of Gitar (now part of Sonar), and he told me about the time he accidentally deleted a monorepo at Uber. Backup saved it.

His takeaway: when you talk to an agent in natural language, it may or may not do what you actually meant. So at Gitar they built what they call the judge, agents that sit around the main flows and check every input and output for prompt injection and other funky behaviour before it goes through. Guardrails from day one, not bolted on later.

Back to Kunal Kushwaha · Report a problem