{bc}
Apply
linkedin

Data Platform Modernization Engineer - Junior (Databricks)

NTT DATA North America
Karnataka, IND
Full-time
Mid-Senior
Onsite
Discovered 1 months ago
Data engineeringDatabricksApache SparkPythonPySparkSQL

Full Job Posting

Role Overview

NTT DATA is seeking a Data Platform Modernization Engineer - Junior (Databricks) in Bangalore, Karnataka, India.

The role focuses on migrating Informatica and AWS Glue workloads to the Databricks Lakehouse.

The engineer will work with senior developers and technical leads to resolve technical issues and dependencies.

Day-to-Day Job Duties

  • Analyze Informatica workflows, mappings, and AWS Glue jobs to understand transformation logic and source-to-target mappings.
  • Develop Databricks notebooks, transformations, and pipelines using Python, PySpark, Spark SQL, and Databricks SQL.
  • Implement Bronze, Silver, and Gold processing with batch and incremental Delta Lake pipelines.
  • Maintain Databricks Jobs, Workflows, and Lakeflow Declarative Pipelines as required.
  • Reuse frameworks for logging, auditing, data quality, error handling, and notifications.
  • Convert Informatica logic and AWS Glue or database processing into Databricks implementations.
  • Perform unit testing, source-to-target reconciliation, integration testing, regression testing, UAT, and production validation.
  • Investigate pipeline issues, participate in reviews, prepare documentation, and support deployment, monitoring, stabilization, and cutover.

Basic Qualifications

  • Have 3–6 years of experience in data engineering, ETL development, or application and data platform development.
  • Have hands-on experience with Databricks and Apache Spark.
  • Have strong development skills in Python or PySpark and SQL.
  • Have experience with Databricks notebooks, Spark SQL or Databricks SQL, Delta Lake, and Databricks Jobs or Workflows.
  • Have developed batch or incremental ETL or ELT pipelines.
  • Have experience with Informatica PowerCenter, AWS Glue, SSIS, or a similar ETL technology.
  • Have experience with relational databases, SQL processing, data validation, unit testing, and troubleshooting.
  • Understand layered data architectures such as Bronze, Silver, and Gold.
  • Can work within established frameworks and follow coding standards.
  • Have strong analytical, problem-solving, and communication skills.
  • Hold a bachelor's degree in Computer Science, Information Technology, Engineering, or have equivalent experience.

Nice to Have

  • Databricks certification is advantageous.
  • Experience with Lakeflow Declarative Pipelines or Delta Live Tables is advantageous.
  • Experience with Unity Catalog, Databricks Asset Bundles, or CI/CD is advantageous.
  • Experience with AWS S3, Glue, Redshift, Lambda, Auto Loader, streaming ingestion, CDC, or SCD processing is advantageous.
  • Experience with performance optimization, data quality frameworks, or cloud data modernization projects is advantageous.

About NTT DATA

NTT DATA is a technology services provider focused on enterprise AI, cloud, security, connectivity, data centers, and application services.

The company states that remote or hybrid arrangements may be available for some positions but can change based on client requirements.

In-office attendance near an NTT DATA office or client site may be required for meetings or events depending on business needs.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at NTT DATA North America

BPO Business Support Specialist

Gurugram, IND

Discovered 3 days agoFull-time

ServiceNow Consultant - REMOTE

, CAN

Discovered 1 weeks ago

AI Solution Architect / FDE (AWS and Azure) -

, CAN

Discovered 2 weeks agoFull-time

AI Solution Architect/FDE (AWS and Azure)

Toronto, CAN

Discovered 2 weeks ago

Java Backend Developer

London, GBR

Discovered 3 weeks agoFull-time

Industry Consulting Manager

Noida, IND

Discovered 4 weeks agoFull-time

Java Developer

Chennai, IND

Discovered 4 weeks agoFull-time

AI Solution Architect

Toronto, CAN

Discovered 1 months ago