Skip to main content
AmigoFish

Build a Production Pipeline Live: Raw Files to a Medallion Lakehouse in 60 Minutes

From codebasics · · 52 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Raw data rarely arrives ready for analysis. The medallion architecture gives your data pipeline a clear structure, moving data step by step from raw ingestion to clean, business-ready tables.

In this live session, we will explain what the bronze, silver and gold layers are and why the split exists. We will show you how to build bronze and silver layers with Delta tables in Databricks, then build gold tables and make your pipeline safe to re-run.

Resource link: https://codebasics.io/playback/build-a-production-pipeline-live-raw-files-to-a-medallion-lakehouse-in-60-minutes

Meet the panel:

Harun Raseed Basheer: https://www.linkedin.com/in/harunraseed/ Kirandeep Marala: https://www.linkedin.com/in/kirandeepmarala/

Do you want to learn technology from me? Check https://codebasics.io/?utm_source=description&utm_medium=yt&utm_campaign=description&utm_id=description for my affordable video courses.

Need help building AI, data solutions? My company https://www.atliq.com/ can help. Click on the Contact button on that website.

🎥 Codebasics Hindi channel: https://www.youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg

#️⃣ Social Media #️⃣

🧑‍🤝‍🧑 Discord for Community Support: https://discord.gg/r42Kbuk 🏫 Skool Community for Support & Networking - https://resources.codebasics.io/6J8mXg 📸 Codebasics' Instagram: https://www.instagram.com/codebasicshub/ 📝 Codebasics' Linkedin : https://www.linkedin.com/company/codebasics/ 📱 Dhaval's X handle : https://x.com/dpcodebasics

------

📝 Dhaval's Linkedin : https://www.linkedin.com/in/dhavalsays/ 📝 Hem's Linkedin: https://www.linkedin.com/in/hemvad/

📽️ Hem's Instagram for daily tips: https://www.instagram.com/hemvadivel/ 📸 Dhaval's Personal Instagram: https://www.instagram.com/dhavalcodebasics

🔗 Patreon: https://www.patreon.com/codebasics?fan_landing=true

Back to codebasics · Report a problem