workday
Data Engineer
News Corp
Bengaluru, IND
Full-time
Junior · 2–4 years experience
Onsite
Discovered 1 months ago
bigquerygcppythonsnowflakesql
Key Skills for This Role
bigquerygcppythonsnowflakesql
Full Job Posting
Key Responsibilities
- The Data Engineer will primarily focus on the development, deployment, and operational
- maintenance of the data pipelines.
- ● Pipeline Development & Maintenance: Develop, deploy, and maintain scalable ETL/ELT
- pipelines in GCP using Cloud Composer and PySpark on Dataproc following established
- architectural patterns.
- ● Performance Optimization: Implement and utilize BigQuery features like Partitioning,
- Clustering, and Materialized Views to improve query performance and contribute to GCP
- cost management.
- ● Data Integration: Assist in the implementation of BigLake components to ensure
- structured and unstructured data is accessible with unified governance.
- ● Code & Infrastructure Deployment: Utilize Terraform and CircleCI for deploying and
- managing pipeline code and related infrastructure to ensure a modular and reproducible
- environment.
- ● Data Operations & Monitoring: Implement robust logging, alerting, and data quality
- checks within pipelines to actively monitor data flow and ensure data reliability.
- ● Collaboration: Work with senior engineers and cross-functional teams to understand
- business requirements and translate them into efficient data solutions.
- ● Skill Development: Proactively seek out and learn new GCP services and tools to enhance
- data processing capabilities.
- Skills & Competencies
- ● Experience: Mid Level - 2 - 4 years of hands-on Data Engineering experience.
- ● GCP Proficiency: Solid knowledge of GCP services with a focus on BigQuery, DataForm,
- Cloud Composer, Cloud Storage, Cloud functions and Dataproc.
- ● Transformation Tools: Proficiency in Dataform for managing version-controlled SQL
- workflows and modeling within BigQuery.
- ● Strong Coding: Excellent Python and SQL skills. You write modular code that is easy to
- test and maintain.
- ● Architectural Knowledge: Solid understanding of Data Modeling (Star Schema,
- Snowflake) and Data Operations.
- ● Automation Mindset: Experience with CI/CD tools and Infrastructure-as-Code is essential.
- ● Domain Knowledge: Experience in the News or Media industry is a strong plus.
Qualifications
- Mid Level - 2 - 4 years of hands-on Data Engineering experience.
- ● GCP Proficiency: Solid knowledge of GCP services with a focus on BigQuery, DataForm,
- Cloud Composer, Cloud Storage, Cloud functions and Dataproc.
- ● Transformation Tools: Proficiency in Dataform for managing version-controlled SQL
- workflows and modeling within BigQuery.
- ● Strong Coding: Excellent Python and SQL skills. You write modular code that is easy to
- test and maintain.
- ● Architectural Knowledge: Solid understanding of Data Modeling (Star Schema,
- Snowflake) and Data Operations.
- ● Automation Mindset: Experience with CI/CD tools and Infrastructure-as-Code is essential.
- ● Domain Knowledge: Experience in the News or Media industry is a strong plus.
- Equal Opportunity Employer
- All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
- Reasonable Accommodation
- We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at [email protected]. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
- Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.
- This job is posted with NTS Technology Services Pvt. Ltd.
About News Corp
Publishing & News Media22300 employeesFounded 2013
Global media and information services company.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at News Corp
Associate Engineer, Defensive Security Operations
Bengaluru, IND
MidFull-time
Discovered YesterdayView →
Engineer, Vulnerability Management
Bengaluru, IND
Discovered TodayFull-time
Associate Engineer, Enterprise Security
Bengaluru, IND
Discovered TodayFull-time
Associate Engineer, Defensive Security Operations
Bengaluru, IND
Discovered TodayFull-time
Engineer, Vulnerability Management
Bengaluru, IND
Discovered YesterdayFull-time
Associate Engineer, Enterprise Security
Bengaluru, IND
Discovered YesterdayFull-time
Associate Engineer, Defensive Security Operations
Bengaluru, IND
Discovered YesterdayFull-time
Principal Engineer
Bengaluru, IND
Discovered 3 days agoFull-time
Principal Engineer
Sydney, AUS
Discovered 3 days agoFull-time
