Data engineering is learned by building. This page collects my hands-on projects — each one a practical, end-to-end solution with the architecture, the steps, and the lessons I took from building it.
Featured project
Building an End-to-End Data Pipeline with Azure Data Factory and Databricks
What it does: Takes a raw Kaggle dataset through a full medallion-style flow — landed in an Azure Data Lake Storage “bronze” container, cleaned and prepared with Databricks and Python, then written to a “gold” container, ready for analysis. Azure Data Factory orchestrates every step.
Tools: Azure Data Factory · Azure Databricks · Azure Data Lake Storage · Python / Spark
What you’ll learn: Setting up the Azure resources, connecting ADF to ADLS and Databricks with linked services, writing the Databricks cleaning notebook, and orchestrating and monitoring the whole pipeline with triggers and alerts.
More projects on the way
New builds are added here as I complete them. In the meantime, my articles cover the foundations these projects build on — start with the latest posts on the blog.
