Kategorien durchsuchen
Entdecken
Fiverr Pro
Deutsch
$
USD
Dinesh Kaushal
@dinesh_kaushal_
Azure Data Engineer , Pyspark , Databricks , ADF Pipelines Expert
Indien
Englisch, Hindi, Punjabi
Über mich
Azure Data Engineer with expertise in PySpark, Azure Data Factory, and Databricks. I build, optimize, and fix scalable data pipelines for efficient data processing. Skilled in ETL/ELT, SQL, and big data workflows. I help improve performance, reduce costs, and ensure reliable data systems. Focused on clean code, quick delivery, and clear communication. Let’s build efficient data solutions together.
Kompetenzen
Dinesh Kaushal
offline •
Meine Dienstleistungen
Beratung im Bereich Datentechnik
I will build scalable etl pipelines using azure data factory and databricks
Portfolio
Arbeitserfahrung
Senior Data Engineer
IBM
Oct 2020 - Present • 5 yrs 7 mos
Data Engineer with 5+ years of experience working in a multinational company, specializing in building scalable and efficient data solutions on Microsoft Azure. Extensive hands-on experience with Azure Data Factory (ADF), Azure Databricks, PySpark, and SQL for designing, developing, and optimizing end-to-end data pipelines. Worked on ingesting data from multiple sources, transforming large datasets, and delivering clean, reliable data for analytics and reporting. Strong expertise in: - Building ETL/ELT pipelines using Azure Data Factory - Developing and optimizing PySpark jobs in Databricks - Writing efficient SQL queries and data models - Handling large-scale data processing and performance tuning - Debugging and fixing pipeline failures and bottlenecks Experienced in working with Azure Data Lake (ADLS) and implementing best practices for scalable and cost-efficient data architectures. Focused on delivering production-ready solutions with high reliability, optimized performance, and clear documentation. Comfortable working in fast-paced environments and collaborating with cross-functional teams to solve complex data challenges.
