{bc}
Apply
smartrecruiters

Databricks Engineer - Senior/ Lead

Blend360
Hyderabad, IND
Full-time
Lead · 6+ years experience
Remote
Discovered 2 weeks ago
azuredatabricksdelta-lakegitpythonspark

Full Job Posting

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure Databricks
  • Implement ETL/ELT workflows using PySpark, Spark SQL, and Python
  • Optimize Spark jobs for performance, cost, and scalability
  • Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)
  • Build and manage Delta Lake tables (ACID, time travel, schema evolution)
  • Integrate Databricks with Azure Data Lake Storage (ADLS Gen2)
  • Develop complex queries and transformations using SQL
  • Collaborate with data scientists, analysts, and stakeholders to support analytics and ML use cases
  • Ensure data quality, validation, and monitoring
  • Follow best practices for security, access control, and governance in Azure
  • Experience with Azure Data Factory
  • Exposure to CI/CD pipelines (Azure DevOps, GitHub Actions)
  • Basic understanding of data modeling
  • Familiarity with cloud security and RBAC in Azure
  • Exposure to streaming data (Spark Structured Streaming, Event Hub, Kafka)
  • Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

Qualifications

  • 6+ years of experience in Data Engineering
  • Strong hands-on experience with Azure Databricks
  • Proficiency in Python for data processing
  • Strong knowledge of SQL (joins, window functions, performance tuning)
  • Hands-on experience with Apache Spark / PySpark
  • Experience working with Delta Lake
  • Knowledge of Azure Data Lake Storage (ADLS Gen2)
  • Understanding of distributed computing concepts
  • Experience with Git version control

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Blend360

Lead / Manager, Data Scientist

Hyderabad, IND

Discovered 3 days agoFull-time

Program Delivery Lead

Columbia, USA

Discovered 3 days agoFull-time

Client Business Unit (CBU) Leader - Financial Services

Columbia, USA

Discovered 3 days agoFull-time

Director, Program Management

Stamford, USA

Discovered 3 days agoFull-time

Associate CoBrand Acquisition Program Manager - Campaign Manager

Dallas, USA

Discovered 4 days agoContract

Sr IT Delivery Manager

Hyderabad, IND

Discovered 1 weeks agoFull-time

VP, AWS NA Practice Lead

Columbia, USA

Discovered 1 weeks agoFull-time

Associate CoBrand Acquisition Program Manager - Campaign Manager

Dallas, USA

Discovered 1 weeks agoContract