Sr. Data Engineer - Databricks
Role Overview
Anblicks is seeking experienced Senior Data Engineers to design, build, and optimize scalable data platforms and high-performance ETL/ELT pipelines.
The role uses Databricks, Apache Spark, Python, Java, and SQL to deliver enterprise-grade data solutions.
The position is based in Hyderabad, India, follows a hybrid model, requires 6+ years of experience, and has six openings.
Key Skills for This Role
Full Job Posting
Role Overview
Anblicks is seeking experienced Senior Data Engineers to design, build, and optimize scalable data platforms and high-performance ETL/ELT pipelines.
The role uses Databricks, Apache Spark, Python, Java, and SQL to deliver enterprise-grade data solutions.
The position is based in Hyderabad, India, follows a hybrid model, requires 6+ years of experience, and has six openings.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark.
- Build ingestion, transformation, processing, validation, monitoring, logging, and error-handling frameworks for large-scale datasets.
- Develop and optimize workloads using Python, Java, Spark, and SQL, including complex SQL queries.
- Tune Spark jobs, queries, pipelines, and data processing workloads for performance and scalability.
- Collaborate with stakeholders, analysts, architects, and engineering teams to deliver data solutions.
- Contribute to cloud-based data platforms, modern architectures, security, governance, and operational excellence.
- Troubleshoot production issues and mentor junior engineers while contributing to reusable frameworks and technical standards.
Required Qualifications
- 6-10 years of professional experience in software development and/or data engineering delivering production-grade data solutions.
- Strong hands-on experience with data engineering, ETL/ELT development, Databricks, and Apache Spark.
- Strong Python and Java programming skills and advanced SQL proficiency.
- Experience designing scalable data pipelines and distributed data processing solutions.
- Understanding of data warehousing, data modeling, data ingestion, transformation, data quality, and pipeline optimization.
- Strong troubleshooting, debugging, and performance tuning capabilities.
- Experience in Agile development environments and cross-functional collaboration.
- Bachelor's degree in computer science, computer engineering, software engineering, or a related technical field, or equivalent professional experience.
Preferred Qualifications
- Experience with AWS cloud services and cloud-based data platforms.
- Experience with Delta Lake and Databricks Workflows, Jobs, notebooks, clusters, and deployment practices.
- Experience with CI/CD, Git, and DevOps practices for data engineering.
- Exposure to AdTech, MarTech, Customer Data Platforms, or customer analytics environments.
Workplace
- Hyderabad, India; hybrid work model.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Anblicks
Project Manager
, IND
Anblicks is seeking an experienced Technical Project Manager to lead delivery of software, data engineering, analytics, and cloud initiatives. The role owns project plans, risks, budgets, releases, stakeholder communicat
Sr Sales Executive for Dallas - Director/ Vice-President
Dallas, USA
UI Developer-Dallas TX-Remote for Addison - Mid-Senior level
, USA
Senior Data Engineer for Dallas - Mid-Senior level
Dallas, USA
Engineer III - App Engg & AI
Ahmedabad, IND
Anblicks is seeking an AI-focused software engineer to build secure, production-ready applications using LLMs, retrieval, tool integration, and agentic workflows. The role covers backend, APIs, user-facing components, te
Sr. Engineer II - App Engg & AI
, IND
Anblicks is seeking a Senior Engineer II to own a customer-facing analytics and reporting application built with React, TypeScript, and a FastAPI backend. The full-stack role has a frontend focus and requires production
Engineer III - App Engg & AI
, IND
Anblicks is seeking an AI-focused software engineer to build, integrate, test, and support production-ready applications using LLMs, RAG, agentic workflows, and enterprise APIs. The role requires 3 to 5+ years of softwar
Sr. Engineer II - App Engg & AI
, IND
Anblicks is seeking a senior full-stack engineer with a backend focus to own the API and data-serving layer of a customer-facing metrics and reporting platform. The role requires Python, FastAPI, PostgreSQL, React, and T
Project Manager
, IND
Sr Sales Executive for Dallas - Director/ Vice-President
Dallas, USA
UI Developer-Dallas TX-Remote for Addison - Mid-Senior level
, USA
Senior Data Engineer for Dallas - Mid-Senior level
Dallas, USA
Engineer III - App Engg & AI
Ahmedabad, IND
Sr. Engineer II - App Engg & AI
, IND
Engineer III - App Engg & AI
, IND
Sr. Engineer II - App Engg & AI
, IND