I will azure data factory etl pipelines and migrate data to adls gen2

Einige Informationen werden in englischer Sprache angezeigt.

Indien

Ich spreche Hindi, Urdu, Englisch

Data Engineer

I am a Data Engineer with experience in building scalable ETL pipelines, data transformation workflows, and cloud-based analytics solutions. I specialize in AWS Data Engineering services including AWS...

Über diesen Service

Looking to migrate your legacy on-premise data warehouse to Azure without downtime? You are in the right place!

I am a Cloud & Data Engineer specializing in designing robust, enterprise-grade data ingestion pipelines. I will help you move large-scale transactional databases or set up automated incremental loads efficiently.

What I Offer:

On-Premise to Cloud Migration: Seamless data movement from MS SQL Server to Azure Data Lake Storage (ADLS Gen2).
Metadata-Driven Pipelines: Advanced ADF architecture using Parent-Child designs and ForEach loops for parallel processing.
Incremental Load (Watermark Logic): Custom control table architecture with dynamic T-SQL to ensure efficient daily loads without redundancy.
Dynamic Partitioning: Structuring clean directory hierarchies using ADF expressions and saving data in high-performance Snappy-compressed Parquet format.
Self-Hosted IR Setup: End-to-end SHIR configuration and complex JRE/JVM troubleshooting.

Tech Stack: Azure Data Factory (ADF), ADLS Gen2, MS SQL Server, T-SQL, Parquet.

Please contact me before placing an order to discuss your project requirements!