{bc}
Apply
smartrecruiters

GCP Data Engineer (Google Cloud)

NCS Australia
Sydney, AUS
Full-time
Hybrid
Discovered 3 weeks ago
bashbigquerydockergcpgitkubernetes

Full Job Posting

Responsibilities

  • Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
  • Infrastructure Management: Architect and optimize data models within BigQuery for performance and cost efficiency, supporting high-volume analytical workloads.
  • Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
  • Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
  • Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.
  • Strong background and experience in Google (GCP) along with a background as a GCP Data Engineer.
  • Experience with real-time streaming data processing using technologies like Pub/Sub and Dataflow Streaming.
  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Experience with version control systems (e.g., Git).
  • Deep understanding of DataOps principles and automated testing for data quality.
  • Previous experience in a similar role as a Cloud Engineer developing, implementing or managing secure Google Cloud solutions at an enterprise level
  • Previous experience building infrastructure as code with Terraform at an advanced level
  • Ability to script in at least one of the following languages: Python, Bash
  • Applied knowledge of CI/CD concepts and deployment of platform solutions
  • Solutions experience leveraging GCP-based core services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, BigQuery, Pub/Sub, etc.
  • Be well-versed in networking concepts, including virtual private clouds (VPCs), subnets, load balancing, firewalls, and DNS
  • Experience designing secure and scalable network architectures on Google Cloud
  • Security-focused with a deep understanding of cloud security principles, threats, and mitigation techniques
  • Hold one more of the following Professional Level Google Cloud certifications: Cloud Architect, Cloud DevOps Engineer, Cloud Developer or other professional-level Google Cloud certifications
  • Why NCS?
  • This is a place for people who like to get stuck in, bring ideas to life and make things happen. You'll work alongside experienced people who care about what they do, contribute to meaningful work and have the support to keep learning and grow your career. Whether you want to deepen your expertise, explore something new or take your career in a different direction, there's room to make it your own. We value Adventure, Excellence, Integrity, Ownership and Unity - bringing curiosity, collaboration and accountability to the way we work with our clients and each other.
  • Ready to make extraordinary happen?
  • We'd love to hear from you.
  • We celebrate diversity and inclusion
  • We value different perspectives, experiences and strengths our people bring. We're committed to an inclusive workplace where everyone has the opportunity to contribute, grow and succeed, and to providing equal employment opportunities and reasonable adjustments throughout the recruitment process.
  • Important information
  • Applicants will need valid Australian work rights and may be required to undergo relevant background, probity and police checks.
  • Agencies: NCS accepts candidate submissions only from agencies on our preferred supplier panel through the NCS Agency Portal.
  • At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart. Our team brings this belief to life by partnering with our clients and communities to make tomorrow together.
  • We are committed to creating an environment that prioritises innovation, collaboration, and purposeful work. Our diverse team is empowered to make a meaningful impact with curiosity, creativity and resilience to shape better outcomes. Join us and accept the challenge of creating a better tomorrow.

Qualifications

  • Strong background and experience in Google (GCP) along with a background as a GCP Data Engineer.
  • Experience with real-time streaming data processing using technologies like Pub/Sub and Dataflow Streaming.
  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Experience with version control systems (e.g., Git).
  • Deep understanding of DataOps principles and automated testing for data quality.
  • Previous experience in a similar role as a Cloud Engineer developing, implementing or managing secure Google Cloud solutions at an enterprise level
  • Previous experience building infrastructure as code with Terraform at an advanced level
  • Ability to script in at least one of the following languages: Python, Bash
  • Applied knowledge of CI/CD concepts and deployment of platform solutions
  • Solutions experience leveraging GCP-based core services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, BigQuery, Pub/Sub, etc.
  • Be well-versed in networking concepts, including virtual private clouds (VPCs), subnets, load balancing, firewalls, and DNS
  • Experience designing secure and scalable network architectures on Google Cloud
  • Security-focused with a deep understanding of cloud security principles, threats, and mitigation techniques
  • Hold one more of the following Professional Level Google Cloud certifications: Cloud Architect, Cloud DevOps Engineer, Cloud Developer or other professional-level Google Cloud certifications

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at NCS Australia

Account Manager (Technology Consulting)

Brisbane, AUS

Discovered 3 days agoFull-time

Application Security Developer

Sydney, AUS

Discovered 4 days agoFull-time

Cloud Engineer – Azure

Sydney, AUS

Discovered 5 days agoFull-time

Client Service Consultant (Technology Consulting)

Brisbane, AUS

Discovered 6 days agoFull-time

Oracle HCM Solution Designer

Sydney, AUS

Discovered 1 weeks agoFull-time

Account Executive - Technology Services

Sydney, AUS

Discovered 1 weeks agoFull-time

AI & Power Platform Technical Lead

Melbourne, AUS

Discovered 1 weeks agoFull-time

Senior Full Stack Engineer - AI / Conversational Systems

Sydney, AUS

Discovered 1 weeks agoFull-time