I will be your data engineer for etl pipelines and data lakehouse

Pipelines failing overnight? Reports running on yesterdays data?

I build production Azure Databricks pipelines that run on schedule, recover from failures on their own, and keep a full audit trail.

Im a Databricks Certified Professional and Azure certified Data Engineer with 7+ years of experience in insurance, healthcare and financial services.

What Ill build for you:

• ETL/ELT pipelines in Azure Databricks, ADF and PySpark
• Medallion architecture (Bronze, Silver, Gold) on Delta Lake
• Unity Catalog governance and SCD Type 2 history tracking
• Failure alerts, audit logging and data reconciliation
• Scheduling, CI/CD and handover documentation

Recent Azure Databricks projects:

• Slide Insurance: moved from daily to hourly data across 900+ tables, with automatic failure recovery and alerts before bad data reached Power BI
• Verto Health: built a metadata-driven pipeline that adds new hospital data sources without code changes, with full audit history in Unity Catalog

How it works:

1. Share your source, destination and number of tables
2. I review your data and confirm the scope
3. I build, test and hand over a working pipeline

Bigger project or migration? Message me for a custom quote.