
Arpit Pati
Kompetenzen

Meine Dienstleistungen


Arbeitserfahrung
Senior AI Data Engineer
Freelancing Career • Vollzeit
Jun 2024 - Apr 2026 • 1 yr 10 mos
Autonomous AI Agents: Leveraged LLMs to build agents for automated schema mapping and semantic analysis, streamlining complex data migrations from legacy SQL to modern Cloud Data Warehouses. Big Data Engineering: Developed high-scale ETL/ELT pipelines using PySpark on Dataproc and Dataform, implementing CDC compaction and deterministic hashing for high-accuracy financial data processing and orchestrating the pipelines using Airflow and Cloud composer. API & Microservices: Scaled a GraphQL gateway and Java Spring Boot microservices to aggregate disparate data sources into a single, high-performance endpoint for client-facing applications. Infrastructure as Code: Managed cloud resources using Terraform and implemented CI/CD practices to ensure rapid, reliable deployment of data infrastructure.
Software Engineer
Tata Consultancy Services • Vollzeit
Jul 2020 - Dec 2021 • 1 yr 5 mos
Architected enterprise data solutions using PL/SQL to process and validate large-scale structured datasets, ensuring high availability and integrity. Implemented end-to-end automation for system testing and data validation, driving a 30% increase in process efficiency and establishing scalable quality protocols.