Danish V

Data Engineer

Self Employed • Selbstständig

Jul 2025 - Present • 1 yr 2 mos

o Architected and optimized ETL pipelines, ensuring efficient data flow, reliability, and scalability. o Implemented Apache Airflow for workflow orchestration, automating data workflows and optimizing performance. o Developed and maintained data models in DBT, enabling efficient transformations and analytics. o Led the migration of legacy ETL jobs to GCP BigQuery, improving query performance and cost efficiency. o Built API integrations for seamless data extraction and ingestion from external sources. o Managed databases, ensuring data integrity, indexing, and performance tuning. o Collaborated with cross-functional teams, including data analysts and business stakeholders, to define data strategies and ensure data availability for analytics. o Mentored junior engineers, fostering best practices in data engineering, ETL, and cloud-based solutions.

Data Engineer

FOMO RE • Freiberufler

Jun 2024 - Jan 2025 • 7 mos

o Automated data extraction from IoT sensors and third-party APIs using Python, enabling real-time monitoring of solar energy metrics. o Built scalable ETL pipelines using Apache Airflow to orchestrate data ingestion, transformation, and loading into BigQuery for analytics. o Developed SQL-based data models in BigQuery, optimizing storage and query performance for large-scale energy datasets. o Implemented data visualization dashboards using Dash and Plotly, providing real-time insights on energy production, consumption, and system efficiency. o Leveraged GCP services such as Compute Engine for processing large data workloads and Cloud Functions for event-driven data processing. o Optimized database performance through indexing, partitioning, and data normalization to ensure efficient queries. o Integrated APIs for weather data, grid status, and energy consumption to enhance predictive analytics and decision-making.