{bc}
Apply
workday

Senior Associate GCP Data Engineer

Equinix
Bengaluru, IND
Full-time
Senior · 2+ years experience
Hybrid
Discovered 3 weeks ago
airflowbigquerydbtdockergcpgit

Full Job Posting

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Cloud Dataflow, Cloud Composer (Apache Airflow), Dataform/dbt and Cloud Functions
  • Build real-time streaming data pipelines using Cloud Pub/Sub, Kafka and Dataflow
  • Implement automated data quality checks and monitoring across all data workflows
  • Optimize pipeline performance and cost efficiency through proper resource allocation and scheduling
  • Architect and implement data lake and data warehouse solutions using Dataproc, BigQuery, Cloud Storage, and Cloud SQL
  • Design optimal data models, partitioning strategies, and clustering for analytical workloads
  • Manage data lifecycle policies and implement automated archival and retention strategies
  • Ensure data security, encryption, and access control across all storage layers
  • Build and optimize BigQuery datasets for analytics and reporting use cases
  • Create and maintain dimensional models and fact tables for business intelligence
  • Implement data marts and aggregation layers for improved query performance
  • Support self-service analytics through proper data cataloging and documentation
  • Having good knowledge of Dataplex and Analytics hub
  • Integrate data from various sources including databases, APIs, SaaS applications, and file systems
  • Implement change data capture (CDC) solutions for real-time data synchronization
  • Work with third-party data providers and external data feeds
  • Implement comprehensive monitoring and alerting using Cloud Monitoring and Cloud Logging
  • Troubleshoot data pipeline issues and implement robust error handling mechanisms
  • Maintain data lineage documentation and impact analysis capabilities
  • Qualifications Technical Skills
  • GCP Services: 2+ years hands-on experience with BigQuery, Cloud Dataflow Cloud Composer, Cloud Storage, Cloud Pub/Sub, Dataform/dbt and Cloud Functions
  • Programming: Proficiency in Python/Java and SQL; experience with Spark/Beam development
  • Data Technologies: Strong understanding of Apache Beam, Apache Airflow, and distributed computing concepts
  • Database Systems: Experience with both RDBMS (Cloud SQL, PostgreSQL, MySQL) and NoSQL (Bigtable, Firestore) databases
  • Infrastructure as Code: Experience with Terraform, Cloud Deployment Manager, or similar tools
  • Professional Experience
  • Bachelor's degree in computer science, Engineering, or related field
  • 2+ years of experience in data engineering or related roles
  • 2+ years of specific experience with Google Cloud Platform
  • Experience with version control systems (Git) and CI/CD pipelines
  • Knowledge of data modelling techniques and dimensional modelling
  • Preferred Qualifications
  • Google Cloud Professional Data Engineer certification
  • Experience with containerization (Docker, Kubernetes/GKE)
  • Experience with data governance and compliance frameworks (GDPR, HIPAA, SOX)
  • Familiarity with business intelligence tools (Looker, Tableau, Power BI)
  • Experience with streaming technologies beyond GCP (Kafka, Spark Streaming)
  • Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.
  • Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.
  • We use artificial intelligence in our hiring process. Learn more here.

Qualifications

  • Technical Skills
  • GCP Services: 2+ years hands-on experience with BigQuery, Cloud Dataflow Cloud Composer, Cloud Storage, Cloud Pub/Sub, Dataform/dbt and Cloud Functions
  • Programming: Proficiency in Python/Java and SQL; experience with Spark/Beam development
  • Data Technologies: Strong understanding of Apache Beam, Apache Airflow, and distributed computing concepts
  • Database Systems: Experience with both RDBMS (Cloud SQL, PostgreSQL, MySQL) and NoSQL (Bigtable, Firestore) databases
  • Infrastructure as Code: Experience with Terraform, Cloud Deployment Manager, or similar tools
  • Professional Experience
  • Bachelor's degree in computer science, Engineering, or related field
  • 2+ years of experience in data engineering or related roles
  • 2+ years of specific experience with Google Cloud Platform
  • Experience with version control systems (Git) and CI/CD pipelines
  • Knowledge of data modelling techniques and dimensional modelling
  • Google Cloud Professional Data Engineer certification
  • Experience with containerization (Docker, Kubernetes/GKE)
  • Experience with data governance and compliance frameworks (GDPR, HIPAA, SOX)
  • Familiarity with business intelligence tools (Looker, Tableau, Power BI)
  • Experience with streaming technologies beyond GCP (Kafka, Spark Streaming)
  • Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.
  • Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.
  • We use artificial intelligence in our hiring process. Learn more here.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Equinix

Senior Director AI, Chief Revenue Organization

Toronto, CAN

Discovered 2 days agoFull-time

Senior Data Scientist

Bengaluru, IND

Discovered 3 days agoFull-time

Expert, Global Operations Products & Service Delivery

Toronto, CAN

Discovered 4 days agoFull-time

Senior Business Analyst, Global Ops Scalability

Toronto, CAN

Discovered 4 days agoFull-time

Senior Technology Program Manager

Toronto, CAN

Discovered 6 days agoFull-time

Staff Engineer, Salesforce Production Support & AI Operations

Bengaluru, IND

Discovered 1 weeks agoFull-time

Operations, Controls Engineer - Manchester

Manchester, GBR

Discovered 1 weeks agoFull-time

Senior Manager, Global Benefits Solutions

Bengaluru, IND

Discovered 1 weeks agoFull-time