
Neha K
Data Engineer
Kompetenzen

Meine Dienstleistungen


Arbeitserfahrung
Data Engineer
Accenture • Vollzeit
Sep 2024 - Present • 2 yrs 1 mo
● Designed and optimised ETL/ELT pipelines on Databricks and GCP using PySpark, SQL, and Python, improving reporting efficiency by 30% and enabling reliable, analytics-ready data delivery. ● Built and optimised complex data models and SQL/PySpark transformations, reducing processing time by 60% and powering BI dashboards with 99.9% uptime. ● Leveraged advanced SQL on BigQuery for large-scale data processing, transformation, and curation into a data lake, enhancing pipeline scalability and performance. ● Applied data quality checks and governance controls using Identity and Access Management (IAM), ensuring compliance, secure access management, and improved data integrity. ● Developed and maintained Apache Airflow DAGs to orchestrate and schedule ingestion and transformation workflows, reducing manual effort and improving SLA adherence across financial data pipelines. ● Built and maintained CI/CD pipelines in Azure DevOps with Git-based version control, enabling faster deployments, streamlined release cycles, and reduced production incidents. ● Collaborated with analysts and business teams to translate requirements into reliable data assets and customised dashboards, driving a 15% increase in operational efficiency.