Kategorien durchsuchen
Entdecken
Fiverr Pro
Deutsch
$
USD
JoseM
@jose_mcatpo
Data Engineer
Peru
Spanisch, Englisch, Portugiesisch
Über mich
I am a Data Engineer with strong experience in Big Data technologies and scalable data processing.
I specialize in building, optimizing, and maintaining ETL pipelines using Apache Spark and SQL in large-scale data environments.
My experience includes:
- Spark (performance tuning and optimization)
- ETL pipeline development
- SQL query optimization
- Data processing for large datasets
- Hadoop ecosystems
I focus on delivering efficient, scalable, and reliable solutions that reduce processing time and improve performance.
Kompetenzen
JoseM
offline •
Durchschnittliche Antwortzeit: 1 Stunde
Meine Dienstleistungen
Daten-ETLs
I will build or optimize your data pipeline using spark and etl
Arbeitserfahrung
Data Engineer
Telefonica Moviles España SA • Vollzeit
Mar 2020 - Present • 6 yrs 2 mos
Started my career in the BI & Big Data area, focusing on data analysis and report development using Teradata. I worked extensively on writing complex SQL queries to support business reporting and decision-making. I was also involved in data ingestion processes, using tools like Hive and Sqoop to extract large-scale telecommunications data (CDRs) and load it into Teradata. Additionally, I handled data ingestion from multiple sources including relational databases and flat files. Over time, I expanded into Big Data development, building and maintaining ETL pipelines using Apache Spark, Hive, and NiFi. These pipelines integrated data from various sources and were designed for scalability and performance. I later took on leadership responsibilities, leading development teams and defining best practices for ETL development and data architecture. I contributed to the design of efficient data workflows and scalable processing solutions in production environments. Key highlights: - ETL pipeline development with Spark, Hive, and NiFi - Large-scale data ingestion (CDR processing) - SQL and Teradata optimization - Big Data architecture design - Technical leadership and team coordination
Data Science practitioner
PERU • Teilzeit
Feb 2019 - Dec 2019 • 10 mos
Create regression models using the R programming language to predict the prices of international bonds. Also use web scraping to extract data from websites.
