Skip to main content
AmigoFish

Lec 07. Scaling Rules for Optimization

From MIT OpenCourseWare: Free Courses from the institute · · 1 hr 27 min

This plays from the publisher's own server. We do not host a copy.

Open at the source

Not rated yet

Description

MIT 6.7960 Deep Learning, Fall 2024 Instructor: Jeremy Bernstein View the complete course: https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/ YouTube Playlist: https://www.youtube.com/playlist?list=PLUl4u3cNGP63URZnh5iqBzDTDYPUTQT-8

Uploaded 11-02-26

This video explores neural computation from a spectral perspective, discusses feature learning and hyperparameter transfer, and presents scaling rules for transferring hyperparameters across network width and depth.

License: Creative Commons BY-NC-SA More information at https://ocw.mit.edu/terms More courses at https://ocw.mit.edu Support OCW at http://ow.ly/a1If50zVRlQ

We encourage constructive comments and discussion on OCW’s YouTube and other social media channels. Personal attacks, hate speech, trolling, and inappropriate comments are not allowed and may be removed. More details at https://ocw.mit.edu/comments.

Learn more about your ad choices. Visit megaphone.fm/adchoices

Learn more about your ad choices. Visit megaphone.fm/adchoices (https://megaphone.fm/adchoices)

Back to MIT OpenCourseWare: Free Courses from the institute · Report a problem