DataEngineer (Azure Data bricks)

About the Role

Key Responsibilities

• Design and implement scalable data warehouse and data lakehouse architectures on Microsoft Azure using Databricks and Delta Lake.
• Build and maintain data pipelines that ingest, clean, transform, and load large data volumes from relational and non-relational sources, APIs, and flat files.
• Write optimized production-grade PySpark and Python code in Azure Databricks for transformations and advanced analytics.
• Migrate legacy EDW workloads, including SQL stored procedures, Unix scripts, and legacy ETL tools, to an Azure and Databricks cloud stack.
• Use Azure Data Factory, ADLS Gen2, Azure Key Vault, and Azure SQL/Synapse services.
• Monitor, troubleshoot, and optimize Spark clusters, SQL queries, and ETL jobs for speed, efficiency, and cost effectiveness.
• Lead data engineers, conduct code reviews, enforce CI/CD and automated testing practices, and guide technical problem solving.

Required Skills and Qualifications

• 6 to 10 years of core experience in data engineering, business intelligence, or enterprise data warehousing.
• Deep understanding of Kimball, Inmon, and Data Vault modeling; star and snowflake schemas; and SCD Types 1, 2, and 3.
• Extensive background designing enterprise-grade data integration frameworks and orchestrating complex workflows.
• Strong Python proficiency, including Pandas, core Python, object-oriented programming, automation, and API integration.
• At least 4 years of hands-on experience with Databricks, Apache Spark, PySpark, Spark SQL, and Delta Lake.
• Proven expertise in Azure Data Factory and ADLS Gen2.
• Expert SQL skills for complex queries, window functions, query tuning, and legacy stored procedure migration.

Preferred Skills

• Experience migrating on-premise EDW environments such as SQL Server, Teradata, Oracle, and Unix shell scripting to the cloud.
• Experience with CI/CD and DevOps practices using Azure DevOps, Git, or GitHub Actions.
• Understanding of data governance, data quality frameworks, and compliance standards such as RBAC and Unity Catalog.
• Azure Data Engineer Associate (DP-203) or Databricks Certified Data Engineer Professional certification.

Work Mode and Location

• Hybrid role located in Bangalore or Hyderabad.

Employment Details

• Full-time position.
• The posting lists one opening.
• The application deadline is September 30, 2026.

Hiring Process

• The process includes a screening call, technical round, culture-fit conversation, and offer stage.
• The hiring process is typically completed within 2 to 3 weeks.