{bc}
workday

Chief Lakehouse Architect – Databricks CoE

Jade Global
Pune, IND
Full-time
Senior · 12–15 years experience
Onsite
Discovered 2 weeks ago
awsazuredatabricksdelta-lakegcpspark

Full Job Posting

Key Responsibilities

  • Define Databricks reference architectures (batch, streaming, ML, GenAI)
  • Own standards for Delta Lake, medallion architecture, Unity Catalog
  • Design multi-workspace Databricks platform architectures
  • Lead Databricks migrations from legacy data warehouses programs
  • Design, Review and approve architecture for all Databricks deals
  • Mentor architects and senior Databricks engineers
  • Define Databricks FinOps framework
  • Optimize cluster policies, DBU usage, and job scheduling
  • Work with engineering teams on performance-to-cost optimization
  • Advise leadership and clients on Databricks cost strategies

Experience

  • 12–15 years in data architecture
  • 5–7 years hands-on Databricks & Apache Spark
  • 3+ years designing enterprise Databricks platforms, managing Databricks costs at scale
  • Databricks platform internals & optimization
  • Spark performance tuning and scalability
  • Delta Lake internals (ACID, compaction, Z-order)
  • Databricks Jobs, Workflows, CI/CD, IaC
  • Cloud-native Databricks (AWS / Azure / GCP)
  • Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing
  • Cloud billing & monitoring tools
  • Cost optimization patterns for Spark workloads
  • Databricks Data Engineer Professional
  • FinOps Practitioner

Skills

  • Databricks platform internals & optimization
  • Spark performance tuning and scalability
  • Delta Lake internals (ACID, compaction, Z-order)
  • Databricks Jobs, Workflows, CI/CD, IaC
  • Cloud-native Databricks (AWS / Azure / GCP)
  • Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing
  • Cloud billing & monitoring tools
  • Cost optimization patterns for Spark workloads
  • Certifications (Preferred)
  • Databricks Data Engineer Professional
  • FinOps Practitioner

Preferred Qualifications

  • Certifications (Preferred)

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Jade Global