Skip to main content
AmigoFish

1017: Vector Search, Agentic Memory and Effective RAG, with MongoDB’s Pete Johnson

From Super Data Science: ML & AI Podcast with Jon Krohn · · 57 min

This plays from the publisher's own server. We do not host a copy.

Open at the source

Not rated yet

Description

In Episode #1017, Pete Johnson (Field CTO of AI at MongoDB) joins Jon Krohn to explain why four out of five organizations have AI steering committees and success metrics, yet only one in five sees a return on the investment. Having made nineteen stops across six countries this year advising more than a hundred companies on their AI strategies, Pete has an unusually wide view of what is actually working in production. In this episode, he traces the history of SQL and denormalization, unpacks why the embedding model is the most underrated choice in a RAG pipeline, explains Matryoshka embeddings and lays out what better agentic memory looks like.

Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.superdatascience.com/1017⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ (https://www.superdatascience.com/1003)⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.

In this episode you will learn:

- (00:06:34) Why the AI ROI gap happens and what to do differently

- (00:18:21) Jevons paradox, bank tellers and toll booth workers

- (00:24:05) From Codd’s 1970 paper to denormalization

- (00:32:31) Why the embedding model is not a commodity

- (00:40:20) What better agentic memory looks like

Back to Super Data Science: ML & AI Podcast with Jon Krohn · Report a problem