Skip to main content
AmigoFish

StatQuest with Josh Starmer

StatQuest with Josh StarmerVideo

Format:
YouTube channel
New videos:
Irregular
Typical length:
about 25 minutes
Latest video:
Not rated yet

About this show

Statistics, Machine Learning, Data Science, and AI seem like very scary topics, but since each technique is really just a combination of small and simple steps, they are actually quite simple. My goal with StatQuest is to break down the major methodologies into easy-to-understand pieces. That said, I don't dumb down the material. Instead, I build up your understanding so that you are smarter.

Contact, Video Index, Etc: https://statquest.org

Videos come from the channel's public YouTube feed. The artwork is the newest video thumbnail. Last updated . Names, artwork and text belong to their publishers.

Cosmos

Similar by topic and creator

See the full Cosmos

Similar shows

See all Education shows

Explore more

Videos

  • Reinforcement Learning with GRPO, Clearly Explained!!!

    · 26 min

    In 2024, the GRPO method for training Reasoning Models took the world by storm by simplifying the Reinforcement Learning stage of aligning a Large Language Model. In this StatQuest, we go through the GRPO loss function one step at at time, learning exactly what it does and how it does it. BAM! NOTE: This StatQuest assumes that you are already familiar with... The Main Ideas of Neural Networks: https://youtu.be/CqOfi41LfDw Backpropagation: https://youtu.be/IN2XmBhILt4 Decoder-Only Transformers: https://youtu.be/bQ5BoolX9Ag If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:00 The main ideas of GRPO 6:18 A few details about GRPO 8:15 GRPO, one step at a time 23:28 Summary 24:20 The KL Divergence term #StatQuest

    Not rated yet
  • Linear Discriminant Analysis (LDA): Concepts and Code

    Sign up for FREE Concepts and Code Livestreams at: https://live.statquest.org/masterclasses ALSO, enrollment is now OPEN for the StatQuest Machine Learning Workshop! We'll spend five days diving into the fundamentals of machine learning, breaking down everything from linear regression and decision trees to random forests and neural networks. Learn more at https://live.statquest.org/statquest-introduction-to-machine-learning If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:36 Support Vector Machines: Concepts! 32:06 Shameless self promotion 34:25 Using SVMs in Python 44:39 Visualizing the SVC classifier #StatQuest

    Not rated yet
  • Principal Component Analysis (PCA): Concepts and Code

    · 1 hr 0 min

    Sign up for FREE Concepts and Code Livestreams at: https://live.statquest.org/masterclasses You can play with the PCA code here: https://github.com/StatQuest/concepts_and_code_pca If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:36 Support Vector Machines: Concepts! 32:06 Shameless self promotion 34:25 Using SVMs in Python 44:39 Visualizing the SVC classifier #StatQuest

    Not rated yet
  • Support Vector Machines (SVM): Concepts and Code

    · 53 min

    Sign up for FREE Concepts and Code Livestreams at: https://live.statquest.org/masterclasses ALSO, here are the files for this livestream: https://github.com/StatQuest/concepts_and_code_svms DOUBLE ALSO, enrollment is now OPEN for our first StatQuest Machine Learning Workshop! We'll spend five days diving into the fundamentals of machine learning, breaking down everything from linear regression and decision trees to random forests and neural networks. Learn more at https://live.statquest.org/statquest-introduction-to-machine-learning If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:36 Support Vector Machines: Concepts! 32:06 Shameless self promotion 34:25 Using SVMs in Python 44:39 Visualizing the SVC classifier #StatQuest

    Not rated yet
  • Triple BAM! Live with Jon Krohn, Josh Starmer, and Luis Serrano!

    · 1 hr 1 min

    If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #StatQuest

    Not rated yet
  • Naive Bayes: Concepts and Code

    · 1 hr 15 min

    Sign up for FREE Concepts and Code Classes at: https://live.statquest.org/masterclasses ALSO, you can download the files associated with this concepts and code livestream here: https://github.com/StatQuest/concepts_and_code_naive_bayes DOUBLE ALSO, enrollment is now OPEN for our first StatQuest Machine Learning Workshop! We'll spend five days diving into the fundamentals of machine learning, breaking down everything from linear regression and decision trees to random forests and neural networks. Learn more at https://live.statquest.org/statquest-introduction-to-machine-learning In this Concepts and Code Livestream, we go over the theory of Naive Bayes and then build a Naive Bayes Classifier in R and Python. DOUBLE BAM!!! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Introduction and general silliness 4:37 Classic Naive Bayes (Multinomial) 21:57 Gaussian Naive Bayes 33:44 Questions! 37:24 Coding a Naive Bayes Classifier with AI 1:07:47 A special silly song for Scotland 1:09:17 More questions!! #StatQuest

    Not rated yet
  • The GELU, SiLU and SwiGLU activation functions, clearly explained!!!

    · 24 min

    There's a new activation function in town. Actually, there are a bunch of new activation functions in town. This StatQuest gives you the essential information you need at the very start, followed by a surprisingly interesting derivation of each of these new activation functions. It turns out that Dropout is all you need. Who knew? If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:45 TL;DW (too long, didn't watch) 3:06 Background and why the Sigmoid and ReLU activation functions fail 9:18 How dropout improves training 11:16 GELU = Input dependent dropout 16:54 General equation for a class of activation functions 18:13 SiLU = Input dependent dropout 19:20 SwiGLU = Input dependent dropout with two extra weights. #StatQuest

    Not rated yet
  • Another three (3) more lessons from my Pop!

    · 3 min

    Since September 4th is Global Frank Starmer Day (and also his birthday), we'll celebrate by talking about another three (3) more lessons from him that influenced me over the span of my career so far. If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:40 Always be curious 1:37 Exercise your mind and your body 2:19 Make friends with everyone you can #StatQuest

    Not rated yet
  • TRIPLE BAM!!! With Josh, Luis and special guest Brandon Rohrer

    · 1 hr 1 min

    Made with Restream Studio. Livestream on 30+ platforms at once via https://restream.io Come join us in this Live Q/A where our guest is Brandon Rohrer, author of the very popular (and most excellent) Brandon Rohrer blog https://brandonrohrer.com/ and Senior Staff Machine Learning Engineer at Patreon. Feel free to post your questions beforehand or ask them live!

    Not rated yet
  • The Simplex Algorithm, Mathematical Details!!!

    · 26 min

    In the StatQuest, Optimization with Linear Programming (and the Simplex Algorithm), Main Ideas!!!, we learned the Main Ideas of Linear Programming and the Simplex Algorithm. Now let's dive into the nitty gritty details of how it's done, one step at a time. BAM! NOTE: This StatQuest is brought to you by Gurobi, the solver trusted by experts. To learn more see: https://www.gurobi.com/?utm_source=youtube&utm_medium=social&utm_content=statquest-video Also, Gurobi is free for academics: https://www.gurobi.com/academics?utm_source=youtube&utm_medium=social&utm_content=statquest-video If you want to check out the original version of the second (fancier) example, here's the link to Daniel D. Suthers's webpage for a course at the University of Hawai'i at Manoa: https://www2.hawaii.edu/~suthers/courses/ics311f20/Notes/Topic-21.html If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:13 Terminology and setting up the matrix for the first example 7:58 Solving the first example with the Simplex Algorithm 20:00 Setting up the matrix for the second example 22:27 Solving the second example with the Simplex Algorithm #StatQuest #linearprogramming #simplexmethod

    Not rated yet
  • Optimization with Linear Programming (and the Simplex Algorithm), Main Ideas!!!

    · 24 min

    If you've ever wondered how airplane schedules are optimized, warehouses are optimized or how crops are optimized, then you've wondered about Linear Programming. This StatQuest introduces you to the main ideas of how Linear Programming can be used to optimize problems, and, specifically, we'll learn about the Simplex Algorithm. BAM! NOTE: This StatQuest is brought to you by Gurobi, the solver trusted by experts. To learn more see: https://www.gurobi.com/?utm_source=youtube&utm_medium=social&utm_content=statquest-video Also, Gurobi is free for academics: https://www.gurobi.com/academics?utm_source=youtube&utm_medium=social&utm_content=statquest-video If you want to check out the original version of the second (fancier) example, here's the link to Daniel D. Suthers's webpage for a course at the University of Hawai'i at Manoa: https://www2.hawaii.edu/~suthers/courses/ics311f20/Notes/Topic-21.html If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:34 An example of an optimization problem 9:20 Why we need Linear Programming 12:18 The main ideas of the Simplex Algorithm 19:28 A fancier example #StatQuest #linearprogramming #simplexmethod

    Not rated yet
  • StatQuest: Random Forests Part 2: Missing data and clustering

    · 10 min

    NOTE: This StatQuest is the updated version of the original Random Forests Part 3 and includes two minor corrections. Last time we talked about how to create, use and evaluate random forests. Now it's time to see how they can deal with missing data and how they can be used to cluster samples, even when the data comes from all kinds of crazy sources. NOTE: This StatQuest is based on Leo Breiman's (one of the creators of Random Forests) website: https://www.stat.berkeley.edu/~breiman/RandomForests/cc_home.htm For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #statquest #randomforest

    Not rated yet
  • False Discovery Rates, FDR, clearly explained

    · 18 min

    One of the best ways to prevent p-hacking is to adjust p-values for multiple testing. This StatQuest explains how the Benjamini-Hochberg method corrects for multiple-testing and FDR. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #statistics #pvalue #fdr

    Not rated yet
  • The Essence of Linear Regression!!!

    · 32 min

    This StatQuest takes you through basic linear regression, step-by-step, explaining both the method and the motivation behind the method. Each step is broken down into easy-to-understand parts so that anyone can develop a deep understanding of how to do and interpret a linear regression. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 9:45 Quantifying Prediction Accuracy with the Sum of Squared Residuals 14:43 Fitting a Line with Least Squares 17:11 Assessing Predictions with R-Squared 24:29 Assessing Predictions with a p-value 30:03 Putting it all together #StatQuest

    Not rated yet
  • How AI works in Super Simple Terms!!!

    · 22 min

    In this StatQuest we explain how AI, like ChatGPT, works. However, instead of using lots of complicated math, we're going to use a super simple example and super simple terms. If math scares you, this StatQuest is for you! And even if math doesn't scare you, this StatQuest will give you a deeper understanding of what goes on under the hood. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:24 Main Idea #1: How an AI writes poems 10:21 Main Idea #2: How an AI is created 16:31 Main Idea #3: How an AI is aligned to do useful things #StatQuest

    Not rated yet
  • StatQuest: Career Advice from Tech Industry Leaders

    · 5 min

    This year, for my Pop's birthday, we're going to hear from current tech industry leaders that all started out working for my pop in the IT-Lab at the Medical University of South Carolina. These leaders have started all kinds of startups, pioneered Oscar award winning computer graphics and designed the best user interfaces that I've ever seen. I believe the advice that these leaders give is so valuable that I've awarded them the rare, but highly coveted, Quadruple Bam!!! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:07 Ask questions to uncover the real problem 1:44 Value everyone's contribution 2:24 Small steps lead to significant progress 3:18 Unix pipes as a software design pattern #StatQuest

    Not rated yet
  • Reinforcement Learning with Human Feedback (RLHF), Clearly Explained!!!

    · 18 min

    Generative Large Language Models, like ChatGPT and DeepSeek, are trained on massive text based datasets, like the entire Wikipedia. However, this training alone fails to teach the models how to generate polite and useful responses to your prompts. Thus, LLMs rely on Supervised Fine-Tuning and Reinforcement Learning with Human Feedback (RLHF) to align the models to how we actually want to use them. This StatQuest explains every step in training an LLM, with special attention to how RLHF is done. NOTE: This video is based on the original manuscript for Instruct-GPT: https://arxiv.org/abs/2203.02155 Also, you should check out Serrano Academy if you can: https://www.youtube.com/@SerranoAcademy If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:25 Pre-Training an LLM 5:06 Supervised Fine-Tuning 7:35 Reinforcement Learning with Human Feedback (RLHF) 10:07 RLHF - training the reward model 15:02 RLHF - using the reward model #StatQuest

    Not rated yet
  • Reinforcement Learning with Neural Networks: Mathematical Details

    · 25 min

    Here we go through the math required to update a parameter in a neural network using reinforcement learning and we do it one step a time. We show how the derivatives are calculated (BAM!), then updated (DOUBLE BAM!!), and then used to optimize the parameters (TRIPLE BAM!!!). If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 4:09 Calculating a derivative 12:16 Updating the derivative with a reward 15:39 Updating a parameter in the neural network 16:28 A second example #StatQuest

    Not rated yet
  • Reinforcement Learning with Neural Networks: Essential Concepts

    · 24 min

    Reinforcement Learning has helped train neural networks to win games, drive cars and even get ChatGPT to sound more human when it responds to your prompt. This StatQuest covers the essential concepts of how this process works. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying a book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! paypal: https://www.paypal.me/statquest venmo: @JoshStarmer Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 4:01 Backpropagation review 6:25 The problem with standard backpropagation 7:04 Taking a guess to calculate the derivative 11:20 Using a reward to update the derivative 14:56 Alternative rewards 16:01 Updating a parameter with the updated derivative 16:56 A second example 22:05 Summary #StatQuest

    Not rated yet
  • Reinforcement Learning: Essential Concepts

    · 18 min

    Reinforcement Learning is one of the most useful methodologies for training AI systems right now, and, while it might seem intimidating, is actually very similar to how you and I learn. This StatQuest cuts through the hype and helps you learn the essential concepts behind reinforcement learning one step at a time. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:07 Updating the Policy, part 1 7:04 Understanding the Learning Rate 9:19 Updating the Policy, part 2 14:29 Reinforcement Learning Terminology #StatQuest

    Not rated yet