End to End Data Engineering Project using Databricks Free Edition | FMCG Domain @codebasics
End to End Data Engineering Project using Databricks Free Edition | FMCG Domain  @codebasics
Uploaded November 2025 | Updated November 2026, 1 day ago
This is an end end to data engineering project using databricks free edition that is perfect for beginners as well as advanced users. In FMCG domain, we are building an ETL pipeline for a real life industry use case where a big retail company acquires a small one and we will build the data pipeline to consolidate data from both the companies in a single lakehouse architecture.
The tech stack data engineering project is: Python, SQL, Amazon S3, Medallion architecture, Spark, BI dashboard and Genie.

Signup to Databricks Free Edition: bit.ly/4nK0NTN

Databricks foundations video: youtube.com/watch?v=761SQ9Hxbic

Code, dataset and other resources: resources.codebasics.io/pD0lLR

๐Ÿš€ Ready to go from Data Analyst to AI-Enabled Data Engineer? Our live bootcamp takes you from dashboards to production pipelines: resources.codebasics.io/5yaUOR

๐ŸŽฎ Want to learn by doing? Datakata is a free, super fun game where you build data pipelines hands-on: resources.codebasics.io/Ahkp3O

Get Certified by Codebasics with this Databricks Mini Course : resources.codebasics.io/dgbaAX

โญ๏ธ Timestamps โญ๏ธ
00:00:00 Intro
00:00:57 Project Introduction
00:02:57 Stakeholder Discussion
00:04:22 2 Learning Paths
00:04:40 Tech Architecture
00:09:47 Data Model
00:16:42 Signup to Databricks free edition
00:17:26 Setup Catalog. Data Import
00:27:36 AWS Account Setup
00:30:48 Upload Data to S3
00:32:50 Databricks S3 Connection
00:34:34 Dimension Data Processing
01:40:23 Fact Processing - Historical Load
02:02:11 Fact Processing - Incremental Load
02:25:51 Orchestration
02:38:07 Denormalized Table and Genie
02:43:24 Dashboarding
02:54:46 Stakeholder Review Meeting
02:55:55 Conclusion


Do you want to learn technology from me? Check codebasics.io/?utm_source=description&utm_medium=yt&utm_campaign=description&utm_id=description for my affordable video courses.

Need help building software or data analytics/AI solutions? My company atliq.com can help. Click on the Contact button on that website.

๐ŸŽฅ Codebasics Hindi channel: youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg

#๏ธโƒฃ Social Media #๏ธโƒฃ

๐Ÿง‘โ€๐Ÿคโ€๐Ÿง‘ Discord for Community Support: discord.gg/r42Kbuk
๐Ÿ“ธ Codebasics' Instagram: instagram.com/codebasicshub
๐Ÿ“ Codebasics' Linkedin : linkedin.com/company/codebasics

------

๐Ÿ“ Dhaval's Linkedin : linkedin.com/in/dhavalsays
๐Ÿ“ Hem's Linkedin: linkedin.com/in/hemvad

๐Ÿ“ฝ๏ธ Hem's Instagram for daily tips: instagram.com/hemvadivel
๐Ÿ“ธ Dhaval's Personal Instagram: instagram.com/dhavalsays

๐Ÿ”— Patreon: patreon.com/codebasics?fan_landing=true
End to End Data Engineering Project using Databricks Free Edition | FMCG Domain80% of MakeMyTrip Code Is AI-WrittenData Engineering Fundamentals for AnalystsCareer Guidance for AI Product Managers 2026 | Codebasics Learners Week Day 5Top 3 Skills Hiring Managers Look for in AI EngineersDont Miss the AI Revolution Like BitcoinIs AI PM the Right Career Track for You?Responsible AI & UX DesignI Built an AI Voice Agent in 30 Minutes (Beginner Friendly)Who are these strangers? | Google io connect india 2026High school kid builds an app with AIIs AI Replacing Data Analysts? A Real Analyst Shows His Workflow
codebasics |

End to End Data Engineering Project using Databricks Free Edition | FMCG Domain

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER