How to Prompt AI Well: Trust, Evidence & Context Rot | Stanford CS193T Lecture 2 with Cynthia Bailey
From Stanford Online · · 1 hr 16 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Explore AI courses and programs from Stanford Online: https://stanford.io/4BYTekh
How do you get reliable, useful results from AI? In this Stanford CS193T: Thinking with AI lecture recording, Senior Lecturer Cynthia Bailey covers how to prompt effectively, treating AI like a capable but new hire and using techniques like detailed scope-of-work prompts, the "interview me" pattern, and prompt postmortems you can reuse. She digs into trust and observability (catching confident mistakes, grounding answers in your own data, knowing when to demand evidence over assertions), the mechanics of managing long conversations (context rot, "lost in the middle," knowing when to start fresh), and resource-mindful habits that are good for your wallet and the planet alike. The lecture closes on a thread that recurs all quarter: how to stay the one steering the AI, rather than letting your own skills and independent judgment quietly atrophy.
Key questions answered in this lecture recording: Q: How should I write prompts for ChatGPT or Claude? A: Bailey says there is no special style to adopt; write naturally, but be direct, specific and detailed, covering who, what, when, where, how and why plus what success looks like.
Q: What is the interview me prompting technique? A: Give the AI a high-level goal and tell it to interview you before starting work (for example, at least ten questions), so it gathers the requirements you might not think to state.
Q: Can I ask an AI chatbot how confident it is in its answer? A: No. Bailey explains the model has no access to its own past internal calculations; asking it to rate its confidence or check for bias just starts a new text generation that sounds like an answer.
Q: How do I know if an AI answer is trustworthy? A: Ask for evidence, not assertions: request citations and open every one, and search any quote to confirm it was not subtly altered.
Q: Should I start a new chat for every topic? A: Yes for new topics: unrelated history dilutes focus and wastes tokens. For the same topic it depends, since long chats can suffer context rot, odd fixations and lost-in-the-middle effects.
Q: How can I avoid losing skills by relying on AI? A: Bailey asks the AI to explain what it did so she can do it herself next time, keeps a document of these mini lessons, and urges students to set up an external early-warning check, since you won't notice skills dulling on your own.
Chapters: 0:00 Core prompting skills: lecture overview 5:08 Prompt writing style and system prompts 11:19 Assigning a role to the AI 13:48 Grounding AI with your own examples 16:57 Prompt like a manager: AI as eager intern 22:54 Interview-me and prompt postmortem patterns 27:51 Q&A: does AI use harm the environment? 31:50 Why AI can't rate its own confidence 36:56 Ask for evidence, not assertions 39:56 Observability: making AI work visible 46:32 Reasoning models and chain of thought 53:39 Context management: new topic, new chat 57:17 Context rot, primacy and recency bias 1:05:05 Resource management and independent voice
About the speaker: Cynthia Bailey is a Senior Lecturer in the Computer Science Department at Stanford University. In 2023-2024, she served as an AI Policy Fellow in the United States Senate through the American Association for the Advancement of Science (AAAS). Her scholarship focuses on computer science education, AI/machine learning, and the social impacts of technology, including creating courses such as Equity and Governance for Artificial Intelligence and Race and Gender in Silicon Valley. Her teaching and research awards include the Lloyd W. Dinkelspiel Award for exceptional contributions to undergraduate education at Stanford, the Lasting Impact Award from the International Computing Education Research conference, a "Top 10 Papers of All Time" award at the 50th anniversary of the ACM SIGCSE Technical Symposium, and the Stanford Society of Women Engineers' Professor of the Year. She has consulted for Apple, NASA, law…