Kategorien durchsuchen
Entdecken
Fiverr Pro
Deutsch
$
USD
Satish P
@satish_sp
Data Engineer
Indien
Englisch
Über mich
I am a Data Engineer with 5+ years of experience designing and developing scalable data pipelines, ETL frameworks, and data lake architectures across AWS and Azure cloud platforms. I have strong expertise in Python, PySpark, SQL, Apache Spark, Databricks, Snowflake, and Apache Airflow.
Kompetenzen
Satish P
offline •
Meine Dienstleistungen
Programmierung & Technik
I will build and automate etl pipelines using airflow pyspark and AWS
Portfolio
Arbeitserfahrung
Data Engineer
Qualcomm • Vollzeit
Aug 2025 - Present • 9 mos
Designed scalable data pipelines ingesting semiconductor wafer probe test data from Automated Test Equipment (ATE) into AWS S3 data lake. Built PySpark and Databricks based ETL pipelines processing millions of wafer test records daily. Implemented S3 data lake architecture managing raw, processed, and curated manufacturing datasets. Developed ingestion frameworks for high volume CSV and Parquet wafer test files from manufacturing systems. Built and managed Apache Airflow DAGs orchestrating ingestion, transformation, and loading workflows. Implemented PySpark transformations generating wafer level and die level yield analytics datasets.
Data Engineer
United Airlines • Vollzeit
Oct 2023 - Jul 2025 • 1 yr 9 mos
Designed ETL pipelines migrating pilot records from SQL Server to AWS Redshift for FAA PRD compliance. Automated ingestion and transformation using Python, AWS Glue, Lambda, and PySpark. Developed Apache Airflow DAGs with proactive monitoring using AWS SNS. Deployed data pipelines across development, staging, and production environments. Implemented data validation frameworks ensuring regulatory data accuracy and collaborating with DevOps teams to automate infrastructure.
