Kategorien durchsuchen
Entdecken
Fiverr Pro
Deutsch
$
USD
I will develop cloud based data workflows with gcp bigquery airflow and dataflow
I’m working on a Google Cloud project for MINT Automation,where a Python script ingests data from an Application API and stores it as a CSV in Google Cloud Storage, triggered via Cloud Composer. A Clo...
Über diesen Service
I will design and build cloud-based data workflows using Google Cloud Platform (GCP), BigQuery, Airflow, and Dataflow.
With 4+ years of experience as a GCP Data Engineer, I specialize in:
Building ETL/ELT pipelines for data ingestion and transformation
Developing data warehouses in BigQuery with partitioning & clustering
Automating workflows with Apache Airflow / Cloud Composer
Implementing data quality checks & validation scripts using Python and SQL
Migrating data from sources like Salesforce, Oracle, Hive, MySQL into BigQuery
Whether you need a simple ETL pipeline or a complete end-to-end data engineering solution, I can deliver scalable, optimized, and reliable workflows tailored to your business needs.
Mein Portfolio
FAQ
Q1: What information do you need from me to get started?
I will need access to your data source (database, API, or files), destination details (e.g., BigQuery dataset), and any specific transformation/business logic you want applied.
Q2:Can you work with multiple data sources?
Yes, I can integrate data from various sources such as Salesforce, Oracle, Hive, MySQL, APIs, and Google Cloud Storage into BigQuery or other targets.
Q3: Do you also set up scheduling and automation?
Yes, I use Apache Airflow / Cloud Composer to schedule and automate workflows so your pipelines run reliably without manual intervention.
Q4: Can you validate and ensure the quality of the data?
Absolutely. I include data quality checks such as row count validation, schema consistency, and custom Python/SQL tests to ensure accurate data ingestion.
Q5: What if I need future changes or support after delivery?
I offer revisions as part of each package, and I’m also available for long-term support through Fiverr’s ongoing projects or custom offers.
