Data Engineer Consultant
Design and build scalable data ingestion pipelines on Google Cloud Platform, optimize performance, and implement orchestration and monitoring strategies.
Skills
About This Role
1-
Enterprise Data Ingestion and Data Engineering: Design and build scalable, reusable ingestion pipelines (realtime and batch) on GCP (GCS, BigQuery, Dataflow).
Develop parameterized pipelines using Google-native services and/or Informatica IDMC mappings and taskflows.
Implement CDC patterns, idempotent loads, late arriving data handling, and schema evolution.
Optimize BigQuery ingestion strategies (batch vs. streaming, partitioning, clustering).
Establish version control, CI/CD, and environment promotion (dev/test/prod).
Results
GCP-native pipelines (Dataflow, Composer, Cloud Run) and/or IDMC mappings/taskflows.
BigQuery schema designs (raw / stage / curated zones with partitioning & clustering).
CI/CD pipelines, deployment artifacts, and operational runbooks.
2-
Data Mapping & Transformation Design :Profile source data and analyze data quality and patterns.
Design field level mappings, business rules, joins, aggregations, and derivations.
Implement transformations using BigQuery SQL, Dataflow, or IDMC transformation logic.
Results
Source to Target Mapping (STM) document.
Transformation mappings.
3-
Orchestration, Automation & Reliability Engineering : Build and parameterize end to end workflows using Cloud Composer (Airflow) and/or IDMC taskflows.
Define job dependencies, schedules, SLAs, and failure handling strategies.
Implement retries, backoff strategies, checkpoints, and restartability.
Integrate monitoring, logging, and alerting using Cloud Monitoring, Cloud Logging, and ChatOps tools.
Results
Production ready orchestration workflows with environment aware parameters.
Scheduling calendar, dependency diagrams, and SLA matrix.
Alerting, monitoring dashboards, and operational SOPs.
4-
Data Pipelines Monitoring, Performance & Cost Optimization : Monitor pipeline health, data freshness, volumes, and anomaly patterns.
Support and monitor data pipelines during off hours and weekends, troubleshooting and resolving issues to ensure SLA compliance.
Track and manage SLAs related to runtime, failures, cost, and data latency.
Optimize BigQuery performance (query refactoring, partition pruning, materialized views).
Manage and optimize GCP costs (storage lifecycle, slot usage, query optimization, caching).
Results
Daily/weekly operational and SLA reports.
Performance and cost optimization plans with before/after metrics.
BigQuery tuning guidelines and data materialization strategy.
Requirements
- 5+ years of experience as a Data Engineer or ETL Developer.
- Skills required technical, managerial : Strong experience with Google Cloud Platform: BigQuery, GCS, Data Stream, Dataflow, Cloud Composer, IAM, Cloud Monitoring.
- Proficiency in SQL (BigQuery optimized) and data modeling for analytics.
- Hands on experience building production grade, scalable data pipelines.
- Experience with CI/CD, Git based version control, and DevOps practices.
- [Optional] Experience with Informatica Intelligent Data Management Cloud (IDMC) CDI, Mass Ingestion, Taskflows.
- Bachelor s degree in Computer Science, Information Technology, Information Systems, or a related.
- Tagged as: cdi. , ci/cd , devops , ETL , informatica , SQL
Your resume, rewritten
for this exact role.
Sign up free — Base Career tailors your CV to this job description in 60 seconds.
01 / 05
Resume Tailored to This Job
Your keywords, structure, and story — rewritten to match this exact role and pass ATS filters.
Free · No card · 60 seconds
02 / 05
Cover Letter for This Role, Done
Job-specific cover letters written in Gulf professional tone — ready in seconds, not hours.
Free · No card · 60 seconds
03 / 05
See How Well You Fit This Role
AI match score with clear reasons — know your fit before investing time in the application.
Free · No card · 60 seconds
04 / 05
Use Autofill When You Apply
Autofill any application form on Workday, LinkedIn, Bayt, Greenhouse — with your tailored content.
Free · No card · 60 seconds
05 / 05
Track It. Follow Up at the Right Time.
Visual pipeline for every application with AI-timed follow-up reminders so nothing slips.
Free · No card · 60 seconds
Similar Jobs
Senior Data Engineer
ISIT · Riyadh
Senior Data Engineer 📍 Riyadh | Saudi Arabia Requirements: • 4+ years of Data Engineering experience • Strong Python & SQL skills • Experience with Apache Spark & Airflow • Data Warehouse & Data Lake expertise • ETL/
Skills
Senior Data Engineer I
HungerStation | هنقرستيشن · Riyadh
Hungerstation is part of the Delivery Hero Group, the world’s pioneering local delivery platform, our mission is to deliver an amazing experience—fast, easy, and to your door. We operate in around 65 countries worldwide.
Skills
3 days ago
Tailor Resume↗Tailor Resume ↗Data Modeler / Big Data Engineer
TAWANTECH ·
Design scalable data architectures, manage Data Lake environments, and support data governance with strong SQL and Cloudera knowledge.
Skills
3 days ago
Tailor Resume↗Tailor Resume ↗Data Architect / Data Engineer (AI Hub) - Riyadh
EY · Riyadh
Within Assurance, we assist our clients to address the accounting and financial reporting challenges facing their business. You will be part of a team that provides insight and services that accelerate analytics, decisio
Skills
4 days ago
Tailor Resume↗Tailor Resume ↗Senior Data Engineer
TestCrew | Quality Engineering & Software Testing ·
We are looking for a Data Engineer with 4+ years of experience to join a dynamic team working on scalable data platforms and modern analytics solutions. If you are passionate about building robust data pipelines and work
Skills
4 days ago
Tailor Resume↗Tailor Resume ↗Senior Big Data Engineer
BBI · الرياض
Responsibilities: Design, implement, and optimize data pipelines for batch and real-time data processing using Cloudera (Hadoop, Hive, Spark, Impala) and Informatica (PowerCenter, Cloud Data Integration) Build data ext
Skills
5 days ago
Tailor Resume↗Tailor Resume ↗Data Modeler / Big Data Engineer
TAWANTECH ·
We are seeking a Data Modeler / Big Data Engineer to design scalable data architectures and support the bank's enterprise data platform, analytics, and digital transformation initiatives. Key Responsibilities Design and
Skills
5 days ago
Tailor Resume↗Tailor Resume ↗Senior Data Engineer
BBI · الرياض
Design, develop, and maintain scalable data pipelines for the efficient collection, storage, and processing of large datasets. Develops and design best practices around data collection and maintain orchestration of data
Skills
5 days ago
Tailor Resume↗Tailor Resume ↗Data Engineer (Google Cloud Platform | BigQuery | Data Engineering)
Astek Middle East ·
We are looking for a highly skilled Data Engineer to join our Data Engineering & Analytics team and play a key role in designing, building, and operating scalable enterprise-grade data engineering solutions on Google Clo
Skills
5 days ago
Tailor Resume↗Tailor Resume ↗2.2K+
Cover Letters & Follow-ups
1.8K+
Resumes Tailored
190.5K+
Jobs Tracked
Trusted by professionals at
Stop applying blindly.
Start getting hired.
Base Career automates the hardest parts of job searching — apply smarter, not harder.
AI Resume in 60s
Your resume rewritten for this exact role using the job description as the brief.
ATS-Optimized
Get past automated screening filters with the right keywords matched to each job.
Application Tracker
Track every job, follow-up, and interview in one visual kanban board.
Free plan · No credit card required