{bc}
Apply
workday

Data Engineer

Lloyds Technology Centre
Hyderabad, IND
Full-time
Mid
Discovered 3 days ago

Full Job Posting

Key Responsibilities

  • Design, develop and maintain reusable data products, ingestion pipelines and transformation frameworks on Google Cloud Platform.
  • Develop and optimise SQL, Python, PySpark and dbt transformations supporting batch and large-scale data processing.
  • Build and operate orchestration workflows using Cloud Composer / Apache Airflow and processing solutions using BigQuery, Dataproc and Cloud Storage.
  • Implement data-quality controls covering schema validation, completeness, duplication, reconciliation, business-date alignment and exception handling.
  • Apply engineering standards through version control, peer review, unit testing, automated deployment and CI/CD practices.
  • Monitor production pipelines, investigate failures and improve reliability, performance, recovery and operational support.
  • Work with Product Owners, Business Analysts, Data Modelers, Architects, BI colleagues and Quality Engineers to deliver end-to-end outcomes.
  • Produce clear technical designs, data lineage, runbooks and support documentation.
  • What You'll Need
  • Strong hands-on experience with GCP, BigQuery, Cloud Storage, Dataproc and Cloud Composer / Apache Airflow.
  • Advanced SQL and practical experience with Python, PySpark and dbt.
  • Experience building scalable ETL / ELT pipelines, reusable data products and governed data layers.
  • Knowledge of Git, CI/CD, automated testing, infrastructure-as-code and Terraform.
  • Understanding of data warehousing, dimensional models, metadata, lineage and data-quality controls.
  • Experience with performance tuning, monitoring, incident investigation and production support.
  • Knowledge of secure cloud engineering, access controls, encryption and regulated-data handling.
  • Strong analytical, documentation and stakeholder communication skills.

Qualifications

  • Experience with performance tuning, monitoring, incident investigation and production support.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Lloyds Technology Centre

Lead Software Engineer

Hyderabad, IND

Discovered TodayFull-time

Solution Architect

Hyderabad, IND

Discovered 2 days agoFull-time

Compliance Manager

Hyderabad, IND

Discovered 2 days agoFull-time

Lead Software Engineer

Hyderabad, IND

Discovered 2 days agoFull-time

Lead Software Engineer

Hyderabad, IND

Discovered 3 days agoFull-time

Quality Engineer

Hyderabad, IND

Discovered 3 days agoFull-time

Senior Software Engineer

Hyderabad, IND

Discovered 3 days agoFull-time

Senior DevOps Engineer

Hyderabad, IND

Discovered 3 days agoFull-time