
Joan M
Senior Data Engineer
Kompetenzen

Meine Dienstleistungen

Arbeitserfahrung
Senior Data Engineer
Gelato • Vollzeit
May 2022 - Present • 4 yrs
- Architected cloud-native data pipelines on GCP and AWS processing 10M+ daily events and terabytes of data, reducing latency by 60% and improving processing throughput by 5x. - Engineered large-scale data processing with DBT on BigQuery, handling distributed computation of 500GB+ daily datasets with optimized partitioning, clustering and incremental strategies. - Pioneered AI-powered monitoring leveraging LLMs and MCPs for automated error detection and root cause analysis, with alerting notifications via email and Slack, reducing incident response time over 50%. - Migrated old replication to real-time streaming pipelines using CDC and Datastream, enabling immediate business insights. - Optimized data workflows reducing cloud compute costs by 70% through efficient resource allocation and query optimization.