Shashank G

Staff Data Engineer

Dec 2025 - Present • 7 mos

Optimized BigQuery data processing by architecting efficient ETL pipelines, delivering over £80,000 in annual cloud cost savings with aim to reach £250k annual savings. Automated Dataform provisioning with CI/CD integration, enabling seamless onboarding for multiple teams and accelerating time-to-value for data workflows. Onboarded 4 teams onto Dataform within 3 months. Mentored a team of 4 data engineers, identifying and facilitating learning opportunities to upskill team members and foster professional growth. Drove technical strategy and direction for the team, collaborating with stakeholders to evaluate trade-offs and align architectural decisions with business objectives. Collaborated with energy trading and forecasting teams to design and deliver short- term gas and power forecast data pipelines, enabling timely and accurate market insights that directly supported trading decisions. Partnered with product and analytics teams to define data requirements and design scalable data models, ensuring reliable and timely delivery of business-critical datasets for decision- making.

Lead Data Engineer

Jan 2025 - Dec 2025 • 11 mos

Leading a team of 4-5 Data Engineers working on multiple projects. Aligned business objectives and data migration with technical requirements through close collaboration with trading teams, building new batch and streaming ETL pipelines for energy trading platform collating data from various sources into BigQuery. Migrating Data Factory jobs to cloud composer Airflow in GCP. Additionally, ad-hoc DAG automation for front and middle office. Migrate and Optimize Spark job notebooks (in both Scala and Python) to improve performance and cost efficiency. Mentoring junior engineers, graduates and apprentices on best practices in data engineering, fostering a culture of continuous learning and improvement within the team. Automate and improve infrastructure using IaC (Terraform). Building reusable modules for other teams to use as a plug-and-play easy to use pipelines.

Senior Scala Engineer (Software Engineer)

Apr 2022 - Jun 2024 • 2 yrs 2 mos

Providing technical leadership in one of the biggest customer migration projects using Functional Scala (Cats, Cats Effects, FS2 and HTTP4S and serverless AWS stack including ECS tasks, Lambdas, Step Functions, EventBridge etc. Acted as a bridge between technical teams and non-technical stakeholders, effectively communicating complex data engineering aspects in a clear and concise manner. Created generic easy-to-use Kafka to BigQuery, GCS and Google PubSub integration for multiple data sources to create single source of truth for the organization. Built tools and connectors using Functional Scala and Python to integrate Kafka with webhooks and streaming pipelines as both data source and sink. Built reusable Python modules for schema conversion and data transcoding. Managed the migration from GKE to Cloud Composer for Airflow, introducing new custom plugins for monitoring and alerting on 10+ different projects. Created re-usable Terraform modules for all infrastructure, covering 10+ different automation tools.