Skip to main content
AmigoFish

StatQuest with Josh Starmer

StatQuest with Josh StarmerVideo

Format:
YouTube channel
New videos:
Irregular
Typical length:
about 25 minutes
Latest video:
Not rated yet
CosmosOpen at the sourceReport a problemIs this your show? Get a badge

About this show

Statistics, Machine Learning, Data Science, and AI seem like very scary topics, but since each technique is really just a combination of small and simple steps, they are actually quite simple. My goal with StatQuest is to break down the major methodologies into easy-to-understand pieces. That said, I don't dumb down the material. Instead, I build up your understanding so that you are smarter.

Contact, Video Index, Etc: https://statquest.org

Covers: statistics, machine learning, data science, neural networks, linear programming, optimization, random forests, large language models

Videos come from the channel's public YouTube feed. The artwork is the newest video thumbnail. Last updated . Names, artwork and text belong to their publishers.

Recently on this show

Summary of recent videos, drawn from the publisher's feed.

This video channel breaks down statistics, machine learning, data science and AI into small, easy-to-follow steps. Recent videos cover reinforcement learning with GRPO, linear discriminant analysis, principal component analysis, support vector machines, naive Bayes, and newer activation functions like GELU and SwiGLU.

Report a problem with this summary

Cosmos

Similar in subject

See the full Cosmos

Similar shows

See all Education shows

Explore more

Videos

  • Human Stories in AI: Rick Marks

    · 31 min

    In this episode we have special guest Rick Marks, a professor at the University of North Carolina Chapel Hill School of Data Science and Society. Before UNC, Rick was a director at Google's Advanced Technology and Projects group, exploring new interaction approaches for ambient computing environments. And before that, Rick founded the PlayStation Magic Lab at PlayStation R&D. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #StatQuest

    Not rated yet
  • Essential Matrix Algebra for Neural Networks, Clearly Explained!!!

    · 30 min

    Although you don't need to know matrix algebra to understand the ideas behind neural networks, if you want to code them or read the latest manuscripts about the field, then you'll need to understand matrix algebra. This video teaches the essential topics in matrix algebra and shows how a neural network can be written as a matrix equation, and then shows how understand PyTorch documentation, error messages and the equations for Attention, which is the fundamental concept behind ChatGPT. Note: If you want to learn more about neural networks... https://youtu.be/CqOfi41LfDw ...backpropagation... https://youtu.be/IN2XmBhILt4 ...the ReLU activation function... https://youtu.be/68BZ5f7P94E ...tensors... https://youtu.be/L35fFDpwIM4 ...SoftMax... https://youtu.be/KpKog-L9veg ...Transformers and Attention... https://youtu.be/zxQyTK8quyY For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 2:35 Introduction to linear transformations 5:57 Linear transformations in matrix notation 7:34 Matrix multiplication 11:03 Matrix multiplication consolidates a sequence of linear transformations 13: 46 Order matters for matrix multiplication 15:18 Transposing a matrix 16:37 Matrix notation and equations 18:51 Using matrix equations to describe a neural network 24:26 nn.Linear() documentation explained 26:38 1-D vs 2-D error messages explained 27:17 The matrix equation for Attention explained #StatQuest #neuralnetworks #matrixalgebra

    Not rated yet
  • Word Embedding in PyTorch + Lightning

    · 32 min

    Word embedding is the first step in lots of neural networks, including Transformers (like ChatGPT) and other state of the art models. Here we learn how to code a stand alone word embedding network from scratch and with nn.Linear. We then learn how to load and use pre-trained word embedding values with nn.Embedding. NOTE: This StatQuest assumes that you are already familiar with Word Embedding, if not, check out the 'Quest: https://youtu.be/viZrOnJclY0 For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:53 Importing modules 2:48 Encoding the training data 6:55 Word Embedding from scratch 16:54 Graphing the embedding values 21:17 Printing out predicted words 20:37 Word Embedding with nn.Linear 28:12 Loading and using pre-trained Embedding values with nn.Embedding #StatQuest #neuralnetworks #transformers

    Not rated yet
  • The Golden Play Button, Clearly Explained!!!’

    · 2 min

    The Golden Play Button is usually super confusing. In this video, we break it down and walk you through it one-step-at-a-time. By the end of this StatQuest, you'll completely understand The Golden Play Button. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest

    Not rated yet
  • Another 3 lessons from my Pop!!!

    · 6 min

    Since September 4th is Global Frank Starmer Day (and also his birthday), I thought we'd celebrate by talking about another three lessons that influenced my older sister and my older brothers. For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:52 To solve problems, draw a picture 2:46 To remember, draw a picture 4:24 To solve a problem, start. #StatQuest

    Not rated yet
  • Decoder-Only Transformers, ChatGPTs specific Transformer, Clearly Explained!!!

    · 36 min

    Transformers are taking over AI right now, and quite possibly their most famous use is in ChatGPT. ChatGPT uses a specific type of Transformer called a Decoder-Only Transformer, and this StatQuest shows you how they work, one step at a time. And at the end (at 32:14), we talk about the differences between a Normal Transformer and a Decoder-Only Transformer. BAM! NOTE: If you're interested in learning more about Backpropagation, check out these 'Quests: The Chain Rule: https://youtu.be/wl1myxrtQHQ Gradient Descent: https://youtu.be/sDv4f4s2SB8 Backpropagation Main Ideas: https://youtu.be/IN2XmBhILt4 Backpropagation Details Part 1: https://youtu.be/iyn2zdALii8 Backpropagation Details Part 2: https://youtu.be/GKZoOHXGcLo If you're interested in learning more about the SoftMax function, check out: https://youtu.be/KpKog-L9veg If you're interested in learning more about Word Embedding, check out: https://youtu.be/viZrOnJclY0 If you'd like to learn more about calculating similarities in the context of neural networks and the Dot Product, check out: Cosine Similarity: https://youtu.be/e9U0QAFbfLI Attention: https://youtu.be/PSs6nxngL6k If you'd like to learn more about Normal Transformers, see: https://youtu.be/zxQyTK8quyY For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:34 Word Embedding 7:26 Position Encoding 10:10 Masked Self-Attention, an Autoregressive method 22:35 Residual Connections 23:00 Generating the next word in the prompt 26:23 Review of encoding and generating the prompt 27:20 Generating the output, Part 1 28:46 Masked Self-Attention while generating the output 30:40 Generating the output, Part 2 32:14 Normal Transformers vs Decoder-Only Transformers #StatQuest

    Not rated yet
  • Transformer Neural Networks, ChatGPT's foundation, Clearly Explained!!!

    · 36 min

    Transformer Neural Networks are the heart of pretty much everything exciting in AI right now. ChatGPT, Google Translate and many other cool things, are based on Transformers. This StatQuest cuts through all the hype and shows you how a Transformer works, one-step-at-a time. NOTE: If you're interested in learning more about Backpropagation, check out these 'Quests: The Chain Rule: https://youtu.be/wl1myxrtQHQ Gradient Descent: https://youtu.be/sDv4f4s2SB8 Backpropagation Main Ideas: https://youtu.be/IN2XmBhILt4 Backpropagation Details Part 1: https://youtu.be/iyn2zdALii8 Backpropagation Details Part 2: https://youtu.be/GKZoOHXGcLo If you're interested in learning more about the SoftMax function, check out: https://youtu.be/KpKog-L9veg If you're interested in learning more about Word Embedding, check out: https://youtu.be/viZrOnJclY0 If you'd like to learn more about calculating similarities in the context of neural networks and the Dot Product, check out: Cosine Similarity: https://youtu.be/e9U0QAFbfLI Attention: https://youtu.be/PSs6nxngL6k For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 1:26 Word Embedding 7:30 Positional Encoding 12:53 Self-Attention 23:37 Encoder and Decoder defined 23:53 Decoder Word Embedding 25:08 Decoder Positional Encoding 25:50 Transformers were designed for parallel computing 27:13 Decoder Self-Attention 27:59 Encoder-Decoder Attention 31:19 Decoding numbers into words 32:23 Decoding the second token 34:13 Extra stuff you can add to a Transformer #StatQuest #Transformer #ChatGPT

    Not rated yet
  • What is a Logit?

    · 29 sec

    I used to see references to logit values or logits, and was like, "What the heck are those?". Well, now I've got everything cleared up with this song. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #StatQuest

    Not rated yet
  • Logistic vs Logit Functions

    · 30 sec

    Gosh, here are some terms that I could never get straight. But now I have this sweat tune to get stuck in my head and help me remember the difference between the Logistic and Logit functions. BAM! If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer #StatQuest

    Not rated yet
  • Attention for Neural Networks, Clearly Explained!!!

    · 15 min

    Attention is one of the most important concepts behind Transformers and Large Language Models, like ChatGPT. However, it's not that complicated. In this StatQuest, we add Attention to a basic Sequence-to-Sequence (Seq2Seq or Encoder-Decoder) model and walk through how it works and is calculated, one step at a time. BAM!!! NOTE: This StatQuest is based on two manuscripts. 1) The manuscript that originally introduced Attention to Encoder-Decoder Models: Neural Machine Translation by Jointly Learning to Align and Translate: https://arxiv.org/abs/1409.0473 and 2) The manuscript that first used the Dot-Product similarity for Attention in a similar context: Effective Approaches to Attention-based Neural Machine Translation https://arxiv.org/abs/1508.04025 NOTE: This StatQuest assumes that you are already familiar with basic Encoder-Decoder neural networks. If not, check out the 'Quest: https://youtu.be/L8HKweZIOmg For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 3:14 The Main Idea of Attention 5:34 A worked out example of Attention 10:18 The Dot Product Similarity 11:52 Using similarity scores to calculate Attention values 13:27 Using Attention values to predict an output word 14:22 Summary of Attention #StatQuest #neuralnetwork #attention

    Not rated yet