{bc}
Apply
successfactors

Consultant | Databricks + Pyspark | Mumbai | Engineering | Data Modernization & Migration

Deloitte US | Together Makes Progress
Mumbai, IND
Mid · 3–5 years experience
Hybrid
Discovered 1 weeks ago
azureazure-data-factorydatabricksdelta-lakegitpostgresql

Full Job Posting

Experience

  • 3–5 years of experience in data engineering, with a strong emphasis on Azure Databricks. Proficiency in PySpark or Spark SQL for data transformation. Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory (ADF). Strong foundation in SQL and relational databases (SQL Server, Oracle, or PostgreSQL).
  • Develop and maintain ETL/ELT pipelines using Azure Databricks to move and transform data across diverse sources. Implement data processing workflows using PySpark and Spark SQL within Databricks notebooks. Manage and organize data within Delta Lake, utilizing features like Delta tables and schema enforcement. Use Azure Data Factory (ADF) to orchestrate Databricks notebooks and workflows. Integrate various data sources (SQL Server, Oracle, etc.) into the Azure Databricks ecosystem. Support data cataloging and documentation efforts to ensure data discoverability. Troubleshoot and resolve issues related to Spark jobs, data pipelines, and data quality. Soft Skills: Strong problem-solving and analytical abilities. Ability to work effectively within agile, cross-functional teams. Strong communication skills for technical documentation and team collaboration.

Technical Skills

  • Develop and maintain ETL/ELT pipelines using Azure Databricks to move and transform data across diverse sources. Implement data processing workflows using PySpark and Spark SQL within Databricks notebooks. Manage and organize data within Delta Lake, utilizing features like Delta tables and schema enforcement. Use Azure Data Factory (ADF) to orchestrate Databricks notebooks and workflows. Integrate various data sources (SQL Server, Oracle, etc.) into the Azure Databricks ecosystem. Support data cataloging and documentation efforts to ensure data discoverability. Troubleshoot and resolve issues related to Spark jobs, data pipelines, and data quality. Soft Skills: Strong problem-solving and analytical abilities. Ability to work effectively within agile, cross-functional teams. Strong communication skills for technical documentation and team collaboration.

Preferred Qualifications

  • Bachelor’s degree in Computer Science or a related field. Databricks Certified Data Engineer Associate is highly desirable. Experience with version control (Git). Job Details: Location: Mumbai (Hybrid)

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Deloitte US | Together Makes Progress

Assistant Manager | Financial Due Diligence | Bengaluru | M&A-Transaction Diligence, Execution & Rep

Bengaluru, IND

Discovered Today

Senior Consultant | SAP SD | Ahmedabad | SAP | DSA LS&HC

Ahmedabad, IND

Discovered Today

Team Lead | GCP SRE| Bengaluru | Engineering | Hybrid Cloud Engineering

Bengaluru, IND

Discovered Today

T&T - OIDS - Database / ETL Expert - Senior Consultant - Bhubaneswar

Bhubaneswar, IND

Discovered Today

Team Lead | GCP DevOps | Bengaluru | Engineering | Hybrid Cloud Engineering

Bengaluru, IND

Discovered Today

Assistant Manager | Internal Audit | Bengaluru | Internal audit

Bengaluru, IND

Discovered Today

Senior Consultant | SAP CPI | Bengaluru | SAP | DSA Consumer & TMT

Bengaluru, IND

Discovered Today

Director | Financial Due Diligence | Mumbai | M&A-Transaction Diligence, Execution & Reporting

Mumbai, IND

Discovered Today