Data engineering is learned by building. This page collects my hands-on projects — each one a practical, end-to-end solution with the architecture, the steps, and the lessons I took from building it.

Featured project

Building an End-to-End Data Pipeline with Azure Data Factory and Databricks

What it does: Takes a raw Kaggle dataset through a full medallion-style flow — landed in an Azure Data Lake Storage “bronze” container, cleaned and prepared with Databricks and Python, then written to a “gold” container, ready for analysis. Azure Data Factory orchestrates every step.

Tools: Azure Data Factory · Azure Databricks · Azure Data Lake Storage · Python / Spark

What you’ll learn: Setting up the Azure resources, connecting ADF to ADLS and Databricks with linked services, writing the Databricks cleaning notebook, and orchestrating and monitoring the whole pipeline with triggers and alerts.

→ Read the full project

More projects on the way

New builds are added here as I complete them. In the meantime, my articles cover the foundations these projects build on — start with the latest posts on the blog.

→ Visit the blog

Scroll to Top