StatQuest with Josh Starmer
StatQuest with Josh StarmerVideo
- Format:
- YouTube channel
- New videos:
- Irregular
- Typical length:
- about 25 minutes
- Latest video:
About this show
Statistics, Machine Learning, Data Science, and AI seem like very scary topics, but since each technique is really just a combination of small and simple steps, they are actually quite simple. My goal with StatQuest is to break down the major methodologies into easy-to-understand pieces. That said, I don't dumb down the material. Instead, I build up your understanding so that you are smarter.
Contact, Video Index, Etc: https://statquest.org
Videos come from the channel's public YouTube feed. The artwork is the newest video thumbnail. Last updated . Names, artwork and text belong to their publishers.
Cosmos
Similar by topic and creator
- Wolfram
Shares the topics Education and Technology. - Unstoppable Gadgets
Shares the topics Education and Technology. - Wes Roth
Shares the topics Education and Technology.
Similar shows
Explore more
Videos
Reinforcement Learning with GRPO, Clearly Explained!!!
· 26 min
In 2024, the GRPO method for training Reasoning Models took the world by storm by simplifying the Reinforcement Learning stage of aligning a Large Language Model. In this StatQuest, we go through the GRPO loss function one step at at time, learning exactly what it does and how it does it. BAM! NOTE: This StatQuest assumes that you are already familiar with... The Main Ideas of Neural Networks: https://youtu.be/CqOfi41LfDw Backpropagation: https://youtu.be/IN2XmBhILt4 Decoder-Only Transformers: https://youtu.be/bQ5BoolX9Ag If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:00 The main ideas of GRPO 6:18 A few details about GRPO 8:15 GRPO, one step at a time 23:28 Summary 24:20 The KL Divergence term #StatQuest
Not rated yetLinear Discriminant Analysis (LDA): Concepts and Code
Sign up for FREE Concepts and Code Livestreams at: https://live.statquest.org/masterclasses ALSO, enrollment is now OPEN for the StatQuest Machine Learning Workshop! We'll spend five days diving into the fundamentals of machine learning, breaking down everything from linear regression and decision trees to random forests and neural networks. Learn more at https://live.statquest.org/statquest-introduction-to-machine-learning If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:36 Support Vector Machines: Concepts! 32:06 Shameless self promotion 34:25 Using SVMs in Python 44:39 Visualizing the SVC classifier #StatQuest
Not rated yetPrincipal Component Analysis (PCA): Concepts and Code
· 1 hr 0 min
Sign up for FREE Concepts and Code Livestreams at: https://live.statquest.org/masterclasses You can play with the PCA code here: https://github.com/StatQuest/concepts_and_code_pca If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:36 Support Vector Machines: Concepts! 32:06 Shameless self promotion 34:25 Using SVMs in Python 44:39 Visualizing the SVC classifier #StatQuest
Not rated yetSupport Vector Machines (SVM): Concepts and Code
· 53 min
Sign up for FREE Concepts and Code Livestreams at: https://live.statquest.org/masterclasses ALSO, here are the files for this livestream: https://github.com/StatQuest/concepts_and_code_svms DOUBLE ALSO, enrollment is now OPEN for our first StatQuest Machine Learning Workshop! We'll spend five days diving into the fundamentals of machine learning, breaking down everything from linear regression and decision trees to random forests and neural networks. Learn more at https://live.statquest.org/statquest-introduction-to-machine-learning If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:36 Support Vector Machines: Concepts! 32:06 Shameless self promotion 34:25 Using SVMs in Python 44:39 Visualizing the SVC classifier #StatQuest
Not rated yetTriple BAM! Live with Jon Krohn, Josh Starmer, and Luis Serrano!
· 1 hr 1 min
If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #StatQuest
Not rated yetNaive Bayes: Concepts and Code
· 1 hr 15 min
Sign up for FREE Concepts and Code Classes at: https://live.statquest.org/masterclasses ALSO, you can download the files associated with this concepts and code livestream here: https://github.com/StatQuest/concepts_and_code_naive_bayes DOUBLE ALSO, enrollment is now OPEN for our first StatQuest Machine Learning Workshop! We'll spend five days diving into the fundamentals of machine learning, breaking down everything from linear regression and decision trees to random forests and neural networks. Learn more at https://live.statquest.org/statquest-introduction-to-machine-learning In this Concepts and Code Livestream, we go over the theory of Naive Bayes and then build a Naive Bayes Classifier in R and Python. DOUBLE BAM!!! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Introduction and general silliness 4:37 Classic Naive Bayes (Multinomial) 21:57 Gaussian Naive Bayes 33:44 Questions! 37:24 Coding a Naive Bayes Classifier with AI 1:07:47 A special silly song for Scotland 1:09:17 More questions!! #StatQuest
Not rated yetThe GELU, SiLU and SwiGLU activation functions, clearly explained!!!
· 24 min
There's a new activation function in town. Actually, there are a bunch of new activation functions in town. This StatQuest gives you the essential information you need at the very start, followed by a surprisingly interesting derivation of each of these new activation functions. It turns out that Dropout is all you need. Who knew? If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:45 TL;DW (too long, didn't watch) 3:06 Background and why the Sigmoid and ReLU activation functions fail 9:18 How dropout improves training 11:16 GELU = Input dependent dropout 16:54 General equation for a class of activation functions 18:13 SiLU = Input dependent dropout 19:20 SwiGLU = Input dependent dropout with two extra weights. #StatQuest
Not rated yetAnother three (3) more lessons from my Pop!
· 3 min
Since September 4th is Global Frank Starmer Day (and also his birthday), we'll celebrate by talking about another three (3) more lessons from him that influenced me over the span of my career so far. If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:40 Always be curious 1:37 Exercise your mind and your body 2:19 Make friends with everyone you can #StatQuest
Not rated yetTRIPLE BAM!!! With Josh, Luis and special guest Brandon Rohrer
· 1 hr 1 min
Made with Restream Studio. Livestream on 30+ platforms at once via https://restream.io Come join us in this Live Q/A where our guest is Brandon Rohrer, author of the very popular (and most excellent) Brandon Rohrer blog https://brandonrohrer.com/ and Senior Staff Machine Learning Engineer at Patreon. Feel free to post your questions beforehand or ask them live!
Not rated yetThe Simplex Algorithm, Mathematical Details!!!
· 26 min
In the StatQuest, Optimization with Linear Programming (and the Simplex Algorithm), Main Ideas!!!, we learned the Main Ideas of Linear Programming and the Simplex Algorithm. Now let's dive into the nitty gritty details of how it's done, one step at a time. BAM! NOTE: This StatQuest is brought to you by Gurobi, the solver trusted by experts. To learn more see: https://www.gurobi.com/?utm_source=youtube&utm_medium=social&utm_content=statquest-video Also, Gurobi is free for academics: https://www.gurobi.com/academics?utm_source=youtube&utm_medium=social&utm_content=statquest-video If you want to check out the original version of the second (fancier) example, here's the link to Daniel D. Suthers's webpage for a course at the University of Hawai'i at Manoa: https://www2.hawaii.edu/~suthers/courses/ics311f20/Notes/Topic-21.html If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:13 Terminology and setting up the matrix for the first example 7:58 Solving the first example with the Simplex Algorithm 20:00 Setting up the matrix for the second example 22:27 Solving the second example with the Simplex Algorithm #StatQuest #linearprogramming #simplexmethod
Not rated yetOptimization with Linear Programming (and the Simplex Algorithm), Main Ideas!!!
· 24 min
If you've ever wondered how airplane schedules are optimized, warehouses are optimized or how crops are optimized, then you've wondered about Linear Programming. This StatQuest introduces you to the main ideas of how Linear Programming can be used to optimize problems, and, specifically, we'll learn about the Simplex Algorithm. BAM! NOTE: This StatQuest is brought to you by Gurobi, the solver trusted by experts. To learn more see: https://www.gurobi.com/?utm_source=youtube&utm_medium=social&utm_content=statquest-video Also, Gurobi is free for academics: https://www.gurobi.com/academics?utm_source=youtube&utm_medium=social&utm_content=statquest-video If you want to check out the original version of the second (fancier) example, here's the link to Daniel D. Suthers's webpage for a course at the University of Hawai'i at Manoa: https://www2.hawaii.edu/~suthers/courses/ics311f20/Notes/Topic-21.html If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:34 An example of an optimization problem 9:20 Why we need Linear Programming 12:18 The main ideas of the Simplex Algorithm 19:28 A fancier example #StatQuest #linearprogramming #simplexmethod
Not rated yetStatQuest: Random Forests Part 2: Missing data and clustering
· 10 min
NOTE: This StatQuest is the updated version of the original Random Forests Part 3 and includes two minor corrections. Last time we talked about how to create, use and evaluate random forests. Now it's time to see how they can deal with missing data and how they can be used to cluster samples, even when the data comes from all kinds of crazy sources. NOTE: This StatQuest is based on Leo Breiman's (one of the creators of Random Forests) website: https://www.stat.berkeley.edu/~breiman/RandomForests/cc_home.htm For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #statquest #randomforest
Not rated yetFalse Discovery Rates, FDR, clearly explained
· 18 min
One of the best ways to prevent p-hacking is to adjust p-values for multiple testing. This StatQuest explains how the Benjamini-Hochberg method corrects for multiple-testing and FDR. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #statistics #pvalue #fdr
Not rated yetThe Essence of Linear Regression!!!
· 32 min
This StatQuest takes you through basic linear regression, step-by-step, explaining both the method and the motivation behind the method. Each step is broken down into easy-to-understand parts so that anyone can develop a deep understanding of how to do and interpret a linear regression. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 9:45 Quantifying Prediction Accuracy with the Sum of Squared Residuals 14:43 Fitting a Line with Least Squares 17:11 Assessing Predictions with R-Squared 24:29 Assessing Predictions with a p-value 30:03 Putting it all together #StatQuest
Not rated yetHow AI works in Super Simple Terms!!!
· 22 min
In this StatQuest we explain how AI, like ChatGPT, works. However, instead of using lots of complicated math, we're going to use a super simple example and super simple terms. If math scares you, this StatQuest is for you! And even if math doesn't scare you, this StatQuest will give you a deeper understanding of what goes on under the hood. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:24 Main Idea #1: How an AI writes poems 10:21 Main Idea #2: How an AI is created 16:31 Main Idea #3: How an AI is aligned to do useful things #StatQuest
Not rated yetStatQuest: Career Advice from Tech Industry Leaders
· 5 min
This year, for my Pop's birthday, we're going to hear from current tech industry leaders that all started out working for my pop in the IT-Lab at the Medical University of South Carolina. These leaders have started all kinds of startups, pioneered Oscar award winning computer graphics and designed the best user interfaces that I've ever seen. I believe the advice that these leaders give is so valuable that I've awarded them the rare, but highly coveted, Quadruple Bam!!! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:07 Ask questions to uncover the real problem 1:44 Value everyone's contribution 2:24 Small steps lead to significant progress 3:18 Unix pipes as a software design pattern #StatQuest
Not rated yetReinforcement Learning with Human Feedback (RLHF), Clearly Explained!!!
· 18 min
Generative Large Language Models, like ChatGPT and DeepSeek, are trained on massive text based datasets, like the entire Wikipedia. However, this training alone fails to teach the models how to generate polite and useful responses to your prompts. Thus, LLMs rely on Supervised Fine-Tuning and Reinforcement Learning with Human Feedback (RLHF) to align the models to how we actually want to use them. This StatQuest explains every step in training an LLM, with special attention to how RLHF is done. NOTE: This video is based on the original manuscript for Instruct-GPT: https://arxiv.org/abs/2203.02155 Also, you should check out Serrano Academy if you can: https://www.youtube.com/@SerranoAcademy If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:25 Pre-Training an LLM 5:06 Supervised Fine-Tuning 7:35 Reinforcement Learning with Human Feedback (RLHF) 10:07 RLHF - training the reward model 15:02 RLHF - using the reward model #StatQuest
Not rated yetReinforcement Learning with Neural Networks: Mathematical Details
· 25 min
Here we go through the math required to update a parameter in a neural network using reinforcement learning and we do it one step a time. We show how the derivatives are calculated (BAM!), then updated (DOUBLE BAM!!), and then used to optimize the parameters (TRIPLE BAM!!!). If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 4:09 Calculating a derivative 12:16 Updating the derivative with a reward 15:39 Updating a parameter in the neural network 16:28 A second example #StatQuest
Not rated yetReinforcement Learning with Neural Networks: Essential Concepts
· 24 min
Reinforcement Learning has helped train neural networks to win games, drive cars and even get ChatGPT to sound more human when it responds to your prompt. This StatQuest covers the essential concepts of how this process works. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 4:01 Backpropagation review 6:25 The problem with standard backpropagation 7:04 Taking a guess to calculate the derivative 11:20 Using a reward to update the derivative 14:56 Alternative rewards 16:01 Updating a parameter with the updated derivative 16:56 A second example 22:05 Summary #StatQuest
Not rated yetReinforcement Learning: Essential Concepts
· 18 min
Reinforcement Learning is one of the most useful methodologies for training AI systems right now, and, while it might seem intimidating, is actually very similar to how you and I learn. This StatQuest cuts through the hype and helps you learn the essential concepts behind reinforcement learning one step at a time. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:07 Updating the Policy, part 1 7:04 Understanding the Learning Rate 9:19 Updating the Policy, part 2 14:29 Reinforcement Learning Terminology #StatQuest
Not rated yet