Skip to main content
AmigoFish

Per-Layer Embeddings (PLE) in Gemma 4 explained

From Google for Developers · · 2 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Learn how per-layer embeddings, or PLE, work in Gemma 4 E2B and E4B, Google's open source language model. Google DeepMind’s Maarten Grootendorst breaks down how PLE gives each token a layer-specific embedding for more diverse representation, boosting model performance without increasing the parameters used during computation.

Subscribe to Google for Developers → https://goo.gle/developers

Products Mentioned: Gemma 4 Speaker: Maarten Grootendorst

Back to Google for Developers · Report a problem