{bc}
Apply
linkedin

Azure Databricks Lead - Airline Domain

HTC Global Services
Abu Dhabi Emirate, UAE
contract
Mid-Senior
3 days ago
AirlineAzureDatabricksDomain
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

AirlineAzureDatabricks
Smart Apply

Full Job Posting

Overview

  • Exciting Opportunity Alert! 🌟 HTC Global Services is hiring Azure Data bricks - Lead (Airline Project) for an 1-year extendable contract in Abu Dhabi, UAE (Onsite).
  • HTC Global Services - a leading CMM level 5 global provider of innovative IT and Business Process Services and Solutions since 1990 with headquarters in Troy, Michigan, USA.
  • Lead and manage a team of Data Engineers, providing technical guidance, mentorship, and performance coaching.
  • Design, develop, and optimize large-scale data pipelines using Azure Databricks and PySpark.
  • Architect and implement modern data lake and lakehouse solutions using Azure Data Lake Storage (ADLS).
  • Build and maintain batch and real-time streaming data pipelines using technologies such as Azure Event Hubs, Kafka, Spark Streaming, or Structured Streaming.
  • Collaborate with Solution Architects, Data Scientists, Product Owners, and business stakeholders to define data requirements and technical solutions.
  • Establish data engineering best practices, coding standards, CI/CD processes, and governance frameworks.
  • Ensure high availability, scalability, security, and performance of data platforms.
  • Drive Agile delivery, sprint planning, effort estimation, and technical reviews.
  • Troubleshoot complex data engineering challenges and optimize platform performance.
  • Evaluate emerging technologies and recommend improvements to the organization's data architecture.

Technical Skills

  • Strong experience with Azure Data Engineering ecosystem.
  • Expert-level proficiency in Azure Databricks.
  • Strong hands-on experience with PySpark and Apache Spark.
  • Experience with Azure Data Lake Storage (ADLS Gen2).
  • Expertise in designing and implementing streaming data solutions using:

• Azure Event Hubs

  • Apache Kafka
  • Real-time data processing frameworks
  • Experience with Azure Data Factory (ADF) for orchestration and ETL workflows.
  • Strong SQL and data modeling skills.
  • Experience with Delta Lake and Lakehouse architecture.
  • Knowledge of CI/CD pipelines, Azure DevOps, Git, and Infrastructure as Code.
  • Experience working with large-scale enterprise data platforms.
  • Strong experience with

Databricks Unity Catalog

  • for enterprise data governance, access control, metadata management, and secure data sharing across multiple workspaces.
  • Hands-on experience with

Lakeflow Declarative Pipelines (formerly Delta Live Tables)

  • for building scalable, reliable, and maintainable data ingestion and transformation pipelines.
  • Expertise in implementing data quality checks, monitoring, lineage, and orchestration using Databricks-native pipeline capabilities.
  • Experience working with

Databricks Genie

  • and AI-powered conversational analytics to enable business users to interact with enterprise data through natural language interfaces.
  • Knowledge of integrating Generative AI capabilities within the Databricks ecosystem, including leveraging Databricks AI/BI, Genie Spaces, and Lakehouse AI features.
  • Strong understanding of Delta Lake optimization techniques, including partitioning, clustering, performance tuning, and data lifecycle management.
  • Experience in designing and implementing modern Lakehouse architectures using Databricks, Unity Catalog, Delta Lake, and Azure Data Lake Storage (ADLS).

Preferred Qualifications

  • Databricks Certified Data Engineer Professional.
  • Experience implementing enterprise-wide data governance frameworks using Unity Catalog.
  • Exposure to Databricks AI/BI, Genie, Mosaic AI, Vector Search, and Retrieval-Augmented Generation (RAG) architectures.
  • Experience supporting self-service analytics and business intelligence solutions using Databricks Lakehouse Platform.
  • Experience leading modernization initiatives involving migration from traditional data warehouses to Databricks Lakehouse.
  • Interested candidates please do share your updated CV to mubeenakamal.basha@htcinc.com mentioning your Current CTC, expected CTC and notice period details.
  • #HTCGlobalServices #ITJobs #hiring #lookingforjob #careers #jobs #immediatejoiner #recruitment #technology #jobseekers #interview #lookingforjobchange #newjob #Uaejobs #DataLead #Azuredata #ADB #Databricks

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at HTC Global Services

SAP FICO S/4 Hana Consultant

Abu Dhabi Emirate, UAE

3 days agofulltime

Senior SAP EWM Consultant (Embedded)

Abu Dhabi Emirate, UAE

1 weeks agocontract

Azure Data Architect - Airline Domain

Abu Dhabi Emirate, UAE

1 weeks agocontract

Oracle Apex Developer

Dubai, UAE

3 weeks agocontract

SAP SuccessFactors ECP Consultant (UAE Payroll)

Abu Dhabi Emirate, UAE

3 weeks agocontract

Senior Node JS Backend Developer (AI Project)

Abu Dhabi Emirate, UAE

3 weeks agocontract

Product Owner (Data Migration) - Airline Domain

Abu Dhabi Emirate, UAE

3 weeks agocontract

SAP ECP and EC consultant with UAE Payroll Experience

Abu Dhabi Emirate, UAE

3 weeks agofulltime