I will build scalable etl data pipelines using python pyspark and AWS

Einige Informationen werden in englischer Sprache angezeigt.
Saurabh

Indien

Ich spreche Englisch

2 Aufträge abgeschlossen

Data Engineer, ETL Pipelines, Databricks, SQL, Azure, AWS

Are you looking for a professional Data Engineer to build robust, scalable ETL pipelines? You're in the right place! 🔹 Python, PySpark, Pandas & SQL 🔹 AWS Glue, S3 & Redshift 🔹 Azure Databricks & A...
Mehr lesen
Über diesen Service

End-to-End ETL Pipelines

  • Design and implement scalable data pipelines using Python, PySpark, AWS Glue, and Databricks for efficient data processing.


AWS Data Engineering

  • Build S3-to-Redshift pipelines with data ingestion, transformation, validation, partitioning, and incremental loading.


Azure Data Engineering

  • Develop scalable solutions using Azure Databricks, ADLS, PySpark, and Delta Lake for modern cloud data platforms.


Data Cleaning & Transformation

  • Use Pandas, PySpark, and SQL to clean, transform, merge, validate, and standardize structured and semi-structured data.


Performance Optimization

  • Optimize Spark and ETL workloads using partitioning, broadcast joins, predicate pushdown, AQE, and optimized Parquet/Delta formats.
Mehr lesen
build scalable etl data pipelines using python pyspark and AWS
Vollbild
build scalable etl data pipelines using python pyspark and AWS

Zielplattform:

Amazon Redshift

•

PostgreSQL

•

mySQL

+2 mehr

Tools und Plattformen:

AWS Glue DataBrew

•

Andere

Verwandte Tags