{bc}
Apply
zoho_recruit

Databricks Engineer

DATAECONOMY
Hyderabad, IND
Full-time
Senior · 5+ years experience
Hybrid
Discovered 2 months ago
DatabricksApache SparkPySparkScalaETLELT

Full Job Posting

Qualification: BTech/MTech/MCA

  • Mode of Work: Hybrid
  • Design, develop, and maintain scalable data engineering solutions using Databricks and Apache Spark.
  • Create and deploy custom ETL/ELT pipelines to ingest, transform, and process large volumes of structured and unstructured data.
  • Configure, manage, and optimize Databricks clusters for performance, scalability, and cost efficiency.
  • Implement and manage Lakehouse architectures using Databricks best practices.
  • Develop and maintain data workflows utilizing Delta Lake and Delta Live Tables (DLT).
  • Design and implement Medallion Architecture (Bronze, Silver, Gold layers) for reliable and scalable data processing.
  • Configure and govern data assets using Unity Catalog, ensuring data security, access control, and compliance.
  • Collaborate with data architects, analysts, and business stakeholders to translate business requirements into technical solutions.
  • Monitor data pipelines and troubleshoot performance or data quality issues.
  • Optimize Spark jobs and workflows to improve processing efficiency and reduce execution time.
  • Follow DevOps and CI/CD best practices for deployment and release management.

Requirements

  • 5-10 years of experience in Data Engineering or Big Data technologies.
  • Strong understanding of Databricks architecture and core platform capabilities.
  • Hands-on experience in setting up and managing Databricks clusters.
  • Strong expertise in Apache Spark (PySpark/Scala Spark).
  • Experience developing and deploying custom ETL pipelines in Databricks.
  • Experience implementing Medallion Architecture within Databricks.
  • Hands-on experience with Delta Live Tables (DLT).
  • Strong understanding and implementation experience with Unity Catalog.
  • Experience working with Delta Lake and Lakehouse architecture principles.
  • Knowledge of data modeling, data quality, and performance tuning techniques.
  • Familiarity with version control tools such as Git.

Benefits

  • Comprehensive Medical Coverage: Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
  • Robust Protection Plans: Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
  • Retirement Benefits: PF and Gratuity provided as per standard government regulations.
  • Flexible Work Options: Enjoy hybrid work arrangements & flexible working hours
  • Generous Leave Policy: 21 days of annual leave, in addition to 10 company-declared holidays.
  • Employee Well-being Spaces: Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at DATAECONOMY

Tableau Developer

Hyderabad, IND

Discovered 2 days agoFull-time

Tech Lead - Data Engineering

Pune, IND

Discovered 2 days agoFull-time

Cloud Data Engineer

Gurugram, IND

Discovered 2 days agoFull-time

Enterprise AI Architect

Hyderabad, IND

Discovered 2 days agoFull-time

Business Analyst (Investment banking)

, IND

Discovered 1 months agoFull-time

PLSQL Developer

Hyderabad, IND

Discovered 1 months agoFull-time

Business Analyst (Investment banking)

Pune, IND

Discovered 1 months agoFull-time

FDE - Agentic Ai

Hyderabad, IND

Discovered 1 months agoFull-time