← Portfolio Other

Energy Supplier Data Lakehouse

Azure Databricks lakehouse ingesting smart-meter reads at scale with automated ETL and data quality checks.

Built a cloud data lakehouse for a UK energy supplier processing millions of half-hourly smart-meter readings each day. Implemented a medallion architecture (bronze/silver/gold) on Azure Databricks with Delta Lake, orchestrated by Azure Data Factory.

Added automated data-quality gates and reconciliation between meter feeds and the billing system, cutting settlement disputes and giving analysts a clean, query-ready gold layer for consumption forecasting.

Technologies Used

Azure Databricks Apache Spark Delta Lake Azure Data Factory Python Data Lake