Azure Data Engineer

Role overview

Responsibilities

• Design and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks; develop large-scale processing with PySpark, Spark SQL, Python, and SQL.
• Translate business requirements into data solutions; build ingestion, transformation, validation, orchestration, and monitoring workflows.
• Create reusable integration and data-quality frameworks; support reporting, analytics, and AI/ML initiatives.
• Maintain data quality, integrity, availability, reliability, and performance; collaborate with analysts, architects, reporting teams, and stakeholders.
• Troubleshoot production issues and pipeline bottlenecks; participate in reviews, testing, deployment, release management, and production support.
• Apply cloud security, governance, compliance, and operational practices; contribute to CI/CD automation and platform stability.

Qualifications and expertise

• 5–8 years in data engineering and cloud data platform development; hands-on Azure Data Factory and Azure Databricks expertise.
• Experience building scalable ETL/ELT pipelines and enterprise data integration frameworks; proficiency in PySpark, Spark SQL, Python, and SQL.
• Experience with Snowflake, cloud analytics platforms, and Apache Airflow workflow orchestration.
• Understanding of data warehousing, dimensional modeling, and Lakehouse architectures; experience with GitHub Actions, CI/CD, and DevOps practices.
• Knowledge of governance, monitoring, MLOps, AI lifecycle management, security, compliance, and cloud best practices.
• Healthcare data processing and healthcare analytics exposure is preferred.
• Strong analytical, troubleshooting, problem-solving, and communication skills; able to work independently and cross-functionally.

Benefits

• Competitive salary and benefits package, learning and certification opportunities, flexible work hours, and employee engagement initiatives.
• Annual health check-ups and insurance coverage including life, personal accident, and hospitalization.

Work environment

• The employer says it supports hybrid work and flexible hours.
• The office is described as accessibility-friendly, with ergonomic setups and assistive technologies.