{bc}
workday

Lead Data Engineer

Mastercard
Pune, IND
Full-time
Lead · 8+ years experience
Onsite
Discovered 1 weeks ago
databricksdbtjenkinspythonspark

Full Job Posting

Key Responsibilities

  • Set and enforce design standards, patterns, and best practices for pipelines built on Databricks, Spark, Python, PySpark, and dbt.
  • Provide technical leadership and direction to a team of engineers, owning architecture and design reviews.
  • Lead the design of CI/CD (GitLab, Jenkins), DataOps, and data observability strategy for the team.
  • Own Databricks platform administration standards and deployment governance using Databricks Asset Bundles.
  • Drive resolution of complex technical challenges across pipelines and the platform.
  • Mentor and grow engineers, establishing a strong code review and quality culture.
  • Partner with product and stakeholders on roadmap, prioritization, and technical trade-offs.
  • Own the deployment, migration, and upgrade strategy for the team's data platforms.

Required Qualifications

  • Bachelor's or Master's degree in computer science or a related technical field.
  • 8+ years of data engineering experience, including demonstrated technical leadership.
  • Expert hands-on experience with Databricks (including administration), Spark, Python, and PySpark.
  • Deep dbt/TDD and CI/CD (GitLab, Jenkins) expertise.
  • Proven ability to define engineering standards and lead a team's practices.
  • Strong architecture and platform ownership across observability, cost, and performance.
  • Excellent communication and stakeholder management skills.
  • Ideally you have experience in banking, e-commerce, credit cards or payment processing and exposure to both SaaS and premises-based architectures. In addition, you have a post-secondary degree in computer science, mathematics, or quantitative science.
  • Corporate Security Responsibility
  • All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard’s security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Mastercard